|
Last change
on this file since 100 was
78,
checked in by sherbold, 13 years ago
|
- updated robot filter
- extended parsing to handle clients that did not submit agent informations
|
-
Property svn:mime-type set to
text/plain
|
|
File size:
185 bytes
|
| Line | |
|---|
| 1 | findlinks
|
|---|
| 2 | discobot
|
|---|
| 3 | Googlebot
|
|---|
| 4 | Slurp
|
|---|
| 5 | YandexBot
|
|---|
| 6 | Spider
|
|---|
| 7 | ScholarUniverse
|
|---|
| 8 | Baiduspider
|
|---|
| 9 | Exabot
|
|---|
| 10 | Robot
|
|---|
| 11 | MetaGer-Bot
|
|---|
| 12 | YandexImages
|
|---|
| 13 | Gigabot
|
|---|
| 14 | SiteBot
|
|---|
| 15 | bingbot
|
|---|
| 16 | Ezooms
|
|---|
| 17 | Jeeves/Teoma
|
|---|
| 18 | msnbot |
|---|
Note: See
TracBrowser
for help on using the repository browser.
