ArchitextSpider
MOMspider
Lycos_Spider
Robot
AltaVista Intranet
Scooter
InfoSeek Sidewinder
Harvest
Slurp
Gulliver
Arachnoidea
AnzwersCrawl
Crescent
Java
httpdown
Phantom
libwww-
NPACagent
ExtractorPro
MSIECrawler
NetCache
Wget
ia_archiver
GETWWW-ROBOT
NetAttache
Teleport
WebZIP
LinkSweeper
Autonomy
AvantGo
KIT-Fireball
EmailSiphon
Agentware
Fspider
vspider
BackRub
Netscape-Proxy
ExtractorPro
Googlebot
EchO
Net Vampire
w3mir
WebSurfer
Mercator
Internet Search Engine
HTTPClient
Ultraseek
Enhanced NCSA Mosaic
bottom-feeder