Robots |
1 | 119 | 22.20 | Yahoo! Slurp |
2 | 108 | 20.15 | compatible Mozilla/5.0 |
3 | 63 | 11.75 | Googlebot/2.1 |
4 | 47 | 8.77 | Speedy Spider (http://www.entireweb.com/... |
5 | 37 | 6.90 | ScoutJet |
6 | 34 | 6.34 | Baiduspider+(+http://www.baidu.com/searc... |
7 | 32 | 5.97 | Baiduspider+(+http://www.baidu.jp/spider... |
8 | 32 | 5.97 | Ask Jeeves/Teoma |
9 | 18 | 3.36 | Exabot/3.0 |
10 | 15 | 2.80 | msnbot/2.0b (+http://search.msn.com/msnb... |
11 | 4 | 0.75 | Tagoobot/3.0 |
12 | 4 | 0.75 | SheenBot/SheenBot-1.0.0 (Sheen web crawl... |
13 | 4 | 0.75 | DotBot/1.1 |
14 | 4 | 0.75 | Fedora/1.0.7 |
15 | 4 | 0.75 | MJ12bot/v1.2.5 |
16 | 2 | 0.37 | compatible Mozilla/4.0 |
17 | 2 | 0.37 | MSIE 6.0 |
18 | 2 | 0.37 | PHPCrawl |
19 | 2 | 0.37 | Exabot/3.0 (BiggerBetter) |
20 | 2 | 0.37 | taptubot *** please read http://www.tapt... |
21 | 1 | 0.19 | SheenBot/SheenBot-1.0.1 (Sheen web crawl... |