findlinks
discobot
Googlebot
Slurp
YandexBot
Spider
ScholarUniverse
Baiduspider
Exabot
Robot
MetaGer-Bot
YandexImages
Gigabot
SiteBot
bingbot
Ezooms
Jeeves/Teoma
msnbot
DotBot
changedetection.com/bot.html
FAST Enterprise Crawler 6
psbot
http://ws.daum.net/aboutWebSearch.html
NerdByNature.Bot
Sogou web spider
ssearch_bot
Purebot
http://www.icjobs.de
scoutjet
Netcraft Web Server Survey
TurnitinBot
ia_archiver
MJ12bot
Domnutch-Bot
Eurobot
GarlikCrawler
CMS Crawler
MSIECrawler
NaverBot
80legs
AhrefsBot
SISTRIX Crawler
NetcraftSurveyAgent
Search17Bot
Semager
YandexFavicons
heritrix
suggybot
Netluchs
Ocelli
PHPCrawl
SolomonoBot
Sosospider
Xerka WebBot
YahooCacheSystem
Xenu Link Sleuth
cmsworldmap
suchen.de
amaredo.com/de/suche.html
ibot
w3af.sourceforge.net
yacybot