User Agent | Number of hits | Data Transferred (Kb) |
Python-urllib/2.7 | 6,820 | 210,565 |
facebookexternalhit/1.1 ( http://www.facebook.com/externalhit_uatext.php) | 854 | 33,278 |
CCBot/2.0 (http://commoncrawl.org/faq/) | 357 | 47,713 |
Go-http-client/1.1 | 316 | 2,608 |
Barkrowler experimental crawler - 0.4.7 | 193 | 88 |
Microsoft Office/14.0 (Windows NT 6.2; Microsoft Outlook 14.0.7188; Pro) | 164 | 83 |
python-requests/2.18.3 | 142 | 687 |
Apple-iPhone7C2 | 142 | 6,042 |
COMODO DCV | 118 | 62 |
Dispatch/0.11.3 | 111 | 9,290 |
Barkrowler 0.1.6 | 60 | 28 |
Microsoft Office/14.0 (Windows NT 6.2; Microsoft Outlook 14.0.7184; Pro) | 52 | 26 |
BUbiNG ( http://law.di.unimi.it/BUbiNG.html) | 34 | 16 |
PayPal IPN ( https://www.paypal.com/ipn ) | 32 | 10 |
YahooCacheSystem; YahooWebServiceClient | 30 | 472 |
elefent/1.2 (web crawler; crawler.elefent.net; webmaster at elefent dot net) | 27 | 11 |
UniversalFeedParser/3.3 http://feedparser.org/ | 21 | 13 |
Windows-Media-Player/11.0.5721.5145 | 17 | 49 |
facebookexternalhit/1.1 | 13 | 573 |
Mail/2104 CFNetwork/720.5.7 Darwin/14.5.0 (x86_64) | 12 | 81 |
Twitterbot/1.0 | 12 | 115 |
SafeDNSBot (https://www.safedns.com/searchbot) | 12 | 404 |
icevikatam/1.0 | 11 | 1,254 |
Qwantify/1.0 | 10 | 43 |
python-requests/2.9.1 | 7 | 3 |
Apache-HttpClient/UNAVAILABLE (java 1.4) | 7 | 943 |
rogerbot/1.1 (http://moz.com/help/guides/search-overview/crawl-diagnostics#more-help, rogerbot-crawler pr4-crawler-15@moz.com) | 7 | 104 |
AngleSharp/0.9.9 | 6 | 40 |
Ruby | 6 | 155 |
SEMrushBot | 6 | 77 |
VZ Messages/2 CFNetwork/811.5.4 Darwin/16.7.0 | 5 | 62 |
Nuzzel | 5 | 39 |
GuzzleHttp/6.2.1 curl/7.40.0 PHP/5.5.38 | 4 | 201 |
WhatsApp/2.17.323 A | 4 | 96 |
Photon/1.0 | 4 | 57 |
Wotbox/2.01 ( http://www.wotbox.com/bot/) | 4 | 2 |
Jersey/2.25.1 (Apache HttpClient 4.5) | 3 | 20 |
Python-urllib/2.6 | 3 | 1 |
Traackr.com | 3 | 101 |
Python/3.6 aiohttp/2.2.5 | 3 | 20 |
Others | 41 | 816 |
Total | 9,678 | 316,248 |