|
Робот |
Хиты |
| 1 |
Yandex Robot |
1 709 455 |
| 2 |
AhrefsBot |
816 434 |
| 3 |
Bing Robot |
664 662 |
| 4 |
Googlebot |
563 344 |
| 5 |
DotBot |
537 884 |
| 6 |
SemrushBot |
343 683 |
| 7 |
MJ12bot |
321 200 |
| 8 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; +http://go.mail.ru/help/robots) |
140 828 |
| 9 |
Mozilla/5.0 (compatible; Barkrowler/0.9; +https://babbar.tech/crawler) |
107 190 |
| 10 |
WebMeUp Crawler |
97 411 |
| 11 |
Mozilla/5.0 (compatible; MegaIndex.ru/2.0; +http://megaindex.com/crawler) |
67 081 |
| 12 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Img/2.0; +http://go.mail.ru/help/robots) |
50 009 |
| 13 |
Ezooms Robot |
19 413 |
| 14 |
Bing Preview Robot |
18 056 |
| 15 |
Mozilla/5.0 (compatible; Mail.RU_Bot/2.0; +http://go.mail.ru/help/robots) |
14 065 |
| 16 |
Alexa Robot |
13 123 |
| 17 |
meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler) |
12 475 |
| 18 |
Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; Bytespider; spider-feedback@bytedance.com) |
12 112 |
| 19 |
netEstate NE Crawler (+http://www.website-datenbank.de/) |
10 186 |
| 20 |
Baidu Spider |
8 705 |
| 21 |
FaceBook Crawler |
8 516 |
| 22 |
WebLog Expert |
6 069 |
| 23 |
MauiBot (crawler.feedback+wc@gmail.com) |
5 497 |
| 24 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; +https://help.mail.ru/webmaster/indexing/robots) |
5 153 |
| 25 |
Mozilla/5.0 (compatible; 007ac9 Crawler; http://crawler.007ac9.net/) |
4 109 |
| 26 |
Google Preview Robot |
3 587 |
| 27 |
Yahoo! Slurp |
3 213 |
| 28 |
Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/27.0.1453.116 Safari/537.36 HubSpot Webcrawler - web-crawlers@hubspot.com |
3 161 |
| 29 |
Friendly_Crawler/Nutch-1.20-SNAPSHOT |
3 022 |
| 30 |
Mozilla/5.0 (compatible; SEOkicks; +https://www.seokicks.de/robot.html) |
2 841 |
| 31 |
DomainCrawler/3.0 (info@domaincrawler.com; http://www.domaincrawler.com/xn--b1amfsx.xn--p1ai) |
2 523 |
| 32 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Img/2.0; +https://help.mail.ru/webmaster/indexing/robots) |
2 357 |
| 33 |
DomainCrawler/3.0 (info@domaincrawler.com; http://www.domaincrawler.com/aviacity.net) |
2 242 |
| 34 |
Mozilla/5.0 (compatible; Adsbot/3.1; +https://seostar.co/robot/) |
2 215 |
| 35 |
FriendlyCrawler/Nutch-1.20-SNAPSHOT |
1 905 |
| 36 |
Turnitin Robot |
1 666 |
| 37 |
pimeyes.com crawler |
1 596 |
| 38 |
Archive.org Robot |
1 450 |
| 39 |
Mozilla/5.0 (compatible; SEOkicks-Robot; +http://www.seokicks.de/robot.html) |
1 402 |
| 40 |
Mozilla/5.0 (compatible; LinkpadBot/2.4; +https://linkpad.org/robot/) |
1 393 |
| 41 |
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/605.1.16 (KHTML, like Gecko; compatible; Friendly_Crawler/2.0) Chrome/120.0.6099.217 Safari/605.1.15/Nutch-1.20-SNAPSHOT |
1 267 |
| 42 |
BUbiNG Crawler |
1 250 |
| 43 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Favicons/2.0; +https://help.mail.ru/webmaster/indexing/robots) |
1 171 |
| 44 |
Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; Bytespider; https://zhanzhang.toutiao.com/) |
1 130 |
| 45 |
Mozilla/5.0 (compatible; SiteExplorer/1.1b; +http://siteexplorer.info/Backlink-Checker-Spider/) |
1 087 |
| 46 |
'Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/65.0.3325.181 Mobile Safari/537.36'Bytespider;https://zhanzhang.toutiao.com/ |
816 |
| 47 |
Mozilla/5.0 (compatible; Nigma.ru/3.0; crawler@nigma.ru) |
807 |
| 48 |
Mozilla/5.0 (compatible; LinkpadBot/2.3; +http://linkpad.org/robot/) |
784 |
| 49 |
Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Robots/2.0; +https://help.mail.ru/webmaster/indexing/robots) |
721 |
| 50 |
Powermarks |
658 |
|
Итого |
5 600 924 |
|
Всего |
5 613 163 |
