Robots |
1 | 470 | 26.08 | MJ12bot/v1.4.5 |
2 | 212 | 11.76 | Googlebot/2.1 |
3 | 188 | 10.43 | linkdexbot/2.0 |
4 | 163 | 9.05 | compatible Mozilla/5.0 |
5 | 148 | 8.21 | bingbot/2.0 |
6 | 102 | 5.66 | GigablastOpenSource/1.0 |
7 | 82 | 4.55 | YandexBot/3.0 |
8 | 66 | 3.66 | Linux x86_64 |
9 | 38 | 2.11 | Sogou web spider/4.0(+http://www.sogou.c... |
10 | 33 | 1.83 | Twitterbot/1.0 |
11 | 31 | 1.72 | Findxbot/1.0 |
12 | 27 | 1.50 | Yahoo! Slurp |
13 | 20 | 1.11 | linkdexbot/2.2 |
14 | 20 | 1.11 | MSIE 9.0 |
15 | 17 | 0.94 | panscient.com |
16 | 17 | 0.94 | bingbot/3.0-alpha |
17 | 14 | 0.78 | ia_archiver |
18 | 14 | 0.78 | SeznamBot/3.2 |
19 | 12 | 0.67 | Yeti/1.1 |
20 | 12 | 0.67 | EasouSpider |
21 | 10 | 0.55 | DomainAppender /1.0 |
22 | 9 | 0.50 | Python-urllib/2.7 |
23 | 9 | 0.50 | Wada.vn Vietnamese Search |
24 | 8 | 0.44 | Exabot/3.0 |
25 | 6 | 0.33 | - |
26 | 5 | 0.28 | meanpathbot/1.0 |
27 | 4 | 0.22 | LinqiaRSSBot/1.0 (eng@linqia.com) |
28 | 4 | 0.22 | CB/Nutch-1.7 |
29 | 4 | 0.22 | SpiderMan/1.0 |
30 | 4 | 0.22 | coccoc/1.0 |
31 | 3 | 0.17 | Python-urllib/2.6 |
32 | 3 | 0.17 | Firefox/2.0.0.6 |
33 | 3 | 0.17 | AddThis.com robot tech.support@clearspri... |
34 | 2 | 0.11 | aiHitBot/2.9 |
35 | 2 | 0.11 | BLEXBot/1.0 |
36 | 2 | 0.11 | spbot/4.4.2 |
37 | 2 | 0.11 | proximic |
38 | 2 | 0.11 | WBSearchBot/1.1 |
39 | 2 | 0.11 | MojeekBot/0.6 |
40 | 2 | 0.11 | izsearch.com |
41 | 2 | 0.11 | iZSearch.com |
42 | 2 | 0.11 | archive.org_bot |
43 | 2 | 0.11 | SemrushBot/0.98~bl |
44 | 2 | 0.11 | SearchmetricsBot |
45 | 2 | 0.11 | ShowyouBot (http://showyou.com/crawler) |
46 | 2 | 0.11 | SiteExplorer/1.0b |
47 | 2 | 0.11 | LocalBot |
48 | 1 | 0.06 | heritrix/2.0.2 +http://www.adsafemedia.c... |
49 | 1 | 0.06 | betaBot |
50 | 1 | 0.06 | crawler4j (http://code.google.com/p/craw... |
51 | 1 | 0.06 | Blekkobot |
52 | 1 | 0.06 | PagesInventory (robot http://www.pagesin... |
53 | 1 | 0.06 | Python-urllib/1.17 |
54 | 1 | 0.06 | iCrawl/Nutch-2.4-SNAPSHOT |
55 | 1 | 0.06 | MaxPointCrawler/Nutch-1.1 (maxpoint.craw... |
56 | 1 | 0.06 | Lipperhey SEO Service |
57 | 1 | 0.06 | GrapeshotCrawler/2.0 |
58 | 1 | 0.06 | MSIE 5.01 |
59 | 1 | 0.06 | Aboundex/0.3 (http://www.aboundex.com/cr... |
60 | 1 | 0.06 | fliptop |
61 | 1 | 0.06 | Fetchbot (https://github.com/PuerkitoBio... |
62 | 1 | 0.06 | AdvBot/2.0 |
63 | 1 | 0.06 | NetSeer crawler/2.0 |