User Agent | Number of hits | Data Transferred (Kb) |
rogerbot/1.2 (https://moz.com/help/guides/moz-procedures/what-is-rogerbot, rogerbot-crawler aardwolf-production-crawler-09@moz.com) | 20,030 | 361,569 |
rogerbot/1.2 (https://moz.com/help/guides/moz-procedures/what-is-rogerbot, rogerbot-crawler aardwolf-production-crawler-27@moz.com) | 20,030 | 361,568 |
rogerbot/1.2 (https://moz.com/help/guides/moz-procedures/what-is-rogerbot, rogerbot-crawler aardwolf-production-crawler-35@moz.com) | 20,030 | 361,555 |
rogerbot/1.2 (https://moz.com/help/guides/moz-procedures/what-is-rogerbot, rogerbot-crawler aardwolf-production-crawler-53@moz.com) | 20,028 | 361,526 |
ltx71 - (http://ltx71.com/) | 1,257 | 6,808 |
YahooMailProxy; https://help.yahoo.com/kb/yahoo-mail-proxy-SLN28749.html | 695 | 25,930 |
Photon/1.0 | 458 | 10,110 |
rogerbot/1.1 (http://moz.com/help/pro/what-is-rogerbot-, rogerbot-crawler vanguard@moz.com) | 417 | 11,770 |
Microsoft Office/16.0 (Microsoft Outlook 16.0.11425; Pro) | 301 | 11,121 |
facebookexternalhit/1.1 ( http://www.facebook.com/externalhit_uatext.php) | 281 | 10,232 |
bidswitchbot/1.0 | 204 | 107 |
CCBot/2.0 (https://commoncrawl.org/faq/) | 181 | 3,000 |
Microsoft Office/16.0 (Windows NT 10.0; Microsoft Outlook 16.0.11601; Pro) | 162 | 82 |
Jersey/2.25.1 (HttpUrlConnection 1.8.0_141) | 114 | 46 |
Dispatch/0.11.3 | 96 | 9,153 |
lua-resty-http/0.10 (Lua) ngx_lua/10000 | 82 | 2,692 |
Gigabot | 74 | 1,822 |
Outlook-iOS/709.2144270.prod.iphone (3.23.0) | 65 | 2,575 |
python-requests/2.21.0 | 61 | 541 |
MixnodeCache/1.8( https://cache.mixnode.com/) | 52 | 106 |
The Knowledge AI | 49 | 24 |
lua-resty-http/0.07 (Lua) ngx_lua/10000 | 46 | 536 |
Go-http-client/1.1 | 40 | 387 |
PayPal IPN ( https://www.paypal.com/ipn ) | 38 | 12 |
Outlook-iOS/709.2121154.prod.iphone (3.22.1) | 36 | 1,135 |
Twitterbot/1.0 | 30 | 452 |
Jersey/2.25.1 (Apache HttpClient 4.5) | 29 | 182 |
HubSpot Connect 2.0 (http://dev.hubspot.com/) - contentfilemanagerapiweb-web | 28 | 1,032 |
rogerbot/1.2 (https://moz.com/help/guides/moz-procedures/what-is-rogerbot, rogerbot-crawler aardwolf-production-api-01@moz.com) | 24 | 163 |
IAS crawler (ias_crawler; http://integralads.com/site-indexing-policy/) | 22 | 205 |
cortex/1.0 | 20 | 446 |
SuperPagesUrlVerifyBot/1.0 | 16 | 311 |
Dispatch/0.13.2 | 15 | 6 |
TeamSoft WinInet Component | 14 | 516 |
Magic Browser | 10 | 484 |
Microsoft Office/14.0 (Windows NT 6.2; Microsoft Outlook 14.0.7232; Pro) | 10 | 5 |
SEMrushBot | 10 | 195 |
SafeDNSBot (https://www.safedns.com/searchbot) | 10 | 198 |
Wappalyzer | 8 | 315 |
Python-urllib/2.7 | 8 | 485 |
Others | 98 | 2,051 |
Total | 85,179 | 1,551,453 |