Concepts inAn adaptive model for optimizing performance of an incremental web crawler
Incremental compiler
The term incremental compiler may refer to two different types of compiler.
more from Wikipedia
Web crawler
A Web crawler is a computer program that browses the World Wide Web in a methodical, automated manner or in an orderly fashion. Other terms for Web crawlers are ants, automatic indexers, bots, Web spiders, Web robots, or¿especially in the FOAF community¿Web scutters. This process is called Web crawling or spidering. Many sites, in particular search engines, use spidering as a means of providing up-to-date data.
more from Wikipedia