Robots |
1 | 114 | 32.66 | compatible Mozilla/5.0 |
2 | 57 | 16.33 | Googlebot/2.1 |
3 | 30 | 8.60 | msnbot/2.0b (+http://search.msn.com/msnb... |
4 | 30 | 8.60 | Baiduspider+(+http://www.baidu.jp/spider... |
5 | 23 | 6.59 | Ask Jeeves/Teoma |
6 | 22 | 6.30 | Yahoo! Slurp |
7 | 13 | 3.72 | Baiduspider+(+http://www.baidu.com/searc... |
8 | 9 | 2.58 | spbot/2.0.2 |
9 | 7 | 2.01 | Sosospider+(+http://help.soso.com/webspi... |
10 | 5 | 1.43 | ScoutJet |
11 | 4 | 1.15 | msnbot/2.0b (+http://search.msn.com/msnb... |
12 | 4 | 1.15 | SheenBot/SheenBot-1.0.4 (Sheen web crawl... |
13 | 4 | 1.15 | DotBot/1.1 |
14 | 4 | 1.15 | Exabot/3.0 |
15 | 4 | 1.15 | MJ12bot/v1.3.2 |
16 | 4 | 1.15 | Fedora/1.0.7 |
17 | 4 | 1.15 | aiHitBot/1.0-DS |
18 | 3 | 0.86 | SBIder/Nutch-1.0-dev (http://www.sitesel... |
19 | 2 | 0.57 | betaBot |
20 | 2 | 0.57 | Search17Bot/1.1 |
21 | 2 | 0.57 | MLBot (www.metadatalabs.com/mlbot) |
22 | 2 | 0.57 | taptubot *** please read http://www.tapt... |