This was prepared for tutorial at HPDC-4 Conference |
It starts with motivation and Identification of four components of a Web Search system -- Information Gathering and Filtering, Indexing, Searching and User Interface |
Web Robots (gatherers) are reviewed followed by |
Discussion in detail of 3 examples Lycos, FreeWAIS and Harvest -- the associated demonstrations also include Oracle Free text search |
We end with discussion of future technologies including natural language frontends, distributed queries, metadata, caching and artificial intelligence |