Aliweb

Aliweb

ALIWEB (Archie Like Indexing for the WEB) is considered the first Web search engine, as its predecessors were either built with different purposes (the Wanderer, Gopher) or were literally just indexers (Archie, Veronica and Jughead).

First announced in November 1993[1] by developer Martijn Koster, and presented in May 1994[2] at the First International Conference on the World Wide Web at CERN in Geneva, ALIWEB preceded WebCrawler by several months.[3]

ALIWEB allowed users to submit the locations of index files on their sites[3][4] which enabled the search engine to include webpages and add user-written page descriptions and keywords. This empowered webmasters to define the terms that would lead users to their pages, and also avoided setting bots (e.g. the Wanderer, JumpStation) which used up bandwidth. As relatively few people submitted their sites, ALIWEB was not very widely used.

Martijn Koster, who was also instrumental in the creation of the Robots Exclusion Standard,[5][6] detailed the background and objectives of ALIWEB with an overview of its functions and framework in the paper he presented at CERN.[2]

Koster is not associated with a commercial website which uses the aliweb name.[7]