|
Search Engines -
20802349 Hits
|
|
blexbot |
23.08%
|
4801200 |
|
mj12bot |
18.49%
|
3845582 |
|
ahrefsbot |
16.98%
|
3532655 |
|
other |
11.76%
|
2446720 |
|
semrushbot |
8.31%
|
1728822 |
|
petalbot |
4.73%
|
983798 |
|
googlebot |
3.36%
|
698874 |
|
megaindex |
3.03%
|
629348 |
|
dotbot |
1.9%
|
395886 |
|
bingbot |
1.49%
|
309176 |
|
seekport crawler |
0.71%
|
147972 |
|
barkrowler |
0.67%
|
139530 |
|
dataforseobot |
0.66%
|
137973 |
|
empty ua |
0.54%
|
111678 |
|
magpie-crawler |
0.52%
|
107954 |
|
serpstatbot |
0.5%
|
103429 |
|
zoominfobot |
0.48%
|
99289 |
|
yandexbot |
0.44%
|
92451 |
|
adsbot |
0.38%
|
78071 |
|
chrome |
0.25%
|
51461 |
|
sogou web spider |
0.21%
|
44633 |
|
mauibot |
0.15%
|
32077 |
|
ccbot |
0.12%
|
25635 |
|
python-requests |
0.12%
|
24474 |
|
indeedbot 1 |
0.11%
|
23312 |
|
zgrab |
0.11%
|
22749 |
|
python |
0.08%
|
17625 |
|
daum |
0.08%
|
17102 |
|
go-http-client |
0.07%
|
15505 |
|
applebot |
0.05%
|
9915 |
|
semrushbot-ba |
0.04%
|
8952 |
|
robot |
0.04%
|
8746 |
|
curl |
0.04%
|
8358 |
|
ioncrawl |
0.04%
|
8356 |
|
seznambot |
0.04%
|
7922 |
|
searches across the global ipv4 space multiple times per day to identify custome |
0.03%
|
7049 |
|
baiduspider |
0.03%
|
6972 |
|
netsystemsresearch studies the availability of various services across the inter |
0.03%
|
6080 |
|
dataprovider |
0.03%
|
5214 |
|
nicecrawler |
0.02%
|
3735 |
|
netestate ne crawler |
0.02%
|
3641 |
|
aspiegelbot |
0.02%
|
3356 |
|
nimbostratus-bot |
0.02%
|
3143 |
|
alphabot |
0.01%
|
2743 |
|
360spider |
0.01%
|
2476 |
|
domaincrawler |
0.01%
|
2323 |
|
bdcbot |
0.01%
|
2305 |
|
google |
0.01%
|
2280 |
|
netcraftsurveyagent |
0.01%
|
1999 |
|
libwww-perl |
0.01%
|
1752 |
|
grequests |
0.01%
|
1640 |
|
facebookexternalhit |
0.01%
|
1367 |
|
java |
0.01%
|
1091 |
|
bananabot |
0%
|
1001 |
|
archive.org_bot |
0%
|
967 |
|
duckduckgo-favicons-bot |
0%
|
934 |
|
turnitinbot |
0%
|
897 |
|
nutch |
0%
|
893 |
|
qwantify |
0%
|
819 |
|
69.0.3497.81 yisouspider |
0%
|
797 |
|
semantic-visions.com crawler |
0%
|
699 |
|
wget |
0%
|
648 |
|
httpclient |
0%
|
617 |
|
unknown |
0%
|
574 |
|
domainstatsbot |
0%
|
559 |
|
bytespider |
0%
|
530 |
|
firefox |
0%
|
526 |
|
palemoon |
0%
|
521 |
|
rc-crawler |
0%
|
516 |
|
cloud mapping experiment. contact research |
0%
|
499 |
|
neevabot |
0%
|
478 |
|
scrapy |
0%
|
455 |
|
thinkbot |
0%
|
447 |
|
researchscan |
0%
|
431 |
|
obot |
0%
|
430 |
|
catexplorador |
0%
|
423 |
|
edge |
0%
|
406 |
|
mail.ru_bot |
0%
|
394 |
|
domainsbot |
0%
|
393 |
|
webprosbot |
0%
|
379 |
|
internet-structure-research-project-bot |
0%
|
365 |
|
winhttp.winhttprequest |
0%
|
333 |
|
yisouspider |
0%
|
326 |
|
mbcrawler |
0%
|
313 |
|
14e5239e yisouspider |
0%
|
299 |
|
evc-batch |
0%
|
294 |
|
checkmarknetwork |
0%
|
290 |
|
testbot |
0%
|
270 |
|
wordpress |
0%
|
254 |
|
_please_add_disallow_to_the_robots |
0%
|
253 |
|
msie |
0%
|
250 |
|
mixrankbot |
0%
|
244 |
|
uptimebot |
0%
|
231 |
|
velenpublicwebcrawler |
0%
|
225 |
|
nihilscio - educational search engine - |
0%
|
216 |
|
linkpadbot |
0%
|
212 |
|
borneobot |
0%
|
200 |
|
tombapublicwebcrawler |
0%
|
197 |
|
w3c css validator |
0%
|
184 |
|
seamonkey |
0%
|
167 |
|
ev-crawler |
0%
|
164 |
|
safari |
0%
|
161 |
|
mojeekbot |
0%
|
154 |
|
node-fetch |
0%
|
135 |
|
bingpreview |
0%
|
120 |
|
hubspot crawler |
0%
|
112 |
|
tkbot |
0%
|
112 |
|
aihitbot |
0%
|
108 |
|
lightspeedsystemscrawler mozilla |
0%
|
108 |
|
vuhuvbot |
0%
|
105 |
|
ysearch |
0%
|
103 |
|
linkwalker |
0%
|
100 |
|
searchatlas.com seo crawler |
0%
|
99 |
|
garlikcrawler |
0%
|
97 |
|
pinterestbot |
0%
|
95 |
|
validator.nu |
0%
|
95 |
|
wappalyzer |
0%
|
85 |
|
msnbot |
0%
|
79 |
|
yunsecuritybot |
0%
|
79 |
|
waterfall robot |
0%
|
76 |
|
20100101 firefox superpagesbot2 |
0%
|
73 |
|
df bot 1 |
0%
|
72 |
|
nmap scripting engine |
0%
|
70 |
|
jobboersebot |
0%
|
64 |
|
yacybot |
0%
|
62 |
|
zuuk crawler |
0%
|
61 |
|
wire |
0%
|
59 |
|
site data collection robot 1 |
0%
|
55 |
|
intelx.io_bot |
0%
|
54 |
|
ltx71 |
0%
|
52 |
|
b2b bot |
0%
|
51 |
|
google-site-verification |
0%
|
46 |
|
centurybot9 |
0%
|
43 |
|
ruby |
0%
|
43 |
|
screaming frog seo spider |
0%
|
42 |
|
opera |
0%
|
41 |
|
duckduckbot-https |
0%
|
40 |
|
safednsbot |
0%
|
35 |
|
t3versionsbot |
0%
|
34 |
|
clarabot |
0%
|
33 |
|
user_agent: rc-crawler |
0%
|
31 |
|
wbsrch |
0%
|
29 |
|
experibot-v3 https |
0%
|
28 |
|
extlinksbot |
0%
|
27 |
|
5.0 for legitimate research purposes only |
0%
|
26 |
|
cookiebot |
0%
|
26 |
|
twitterbot |
0%
|
26 |
|
whatsapp |
0%
|
26 |
|
experibot-v3 http |
0%
|
23 |
|
heritrix |
0%
|
23 |
|
linkdexbot |
0%
|
22 |
|
rogerbot |
0%
|
22 |
|
seobilitybot |
0%
|
22 |
|
zaldomosearchbot |
0%
|
22 |
|
e.ventures investment crawler |
0%
|
21 |
|
spbot |
0%
|
21 |
|
url_server_crawler |
0%
|
21 |
|
findlinks |
0%
|
20 |
|
httrack |
0%
|
20 |
|
bpimagewalker |
0%
|
18 |
|
web-crawlers |
0%
|
17 |
|
lynx |
0%
|
16 |
|
outclicksbot |
0%
|
16 |
|
yatsh crawler |
0%
|
16 |
|
exabot |
0%
|
14 |
|
fatboykimcombot |
0%
|
14 |
|
redditbot |
0%
|
14 |
|
niuebot |
0%
|
12 |
|
boardreader favicon fetcher |
0%
|
11 |
|
cliqzbot |
0%
|
11 |
|
hatenablog-bot |
0%
|
11 |
|
internet research project |
0%
|
11 |
|
mrgbot |
0%
|
11 |
|
robots |
0%
|
11 |
|
zombiebot |
0%
|
11 |
|
msnbot-media |
0%
|
10 |
|
netpeakcheckerbot |
0%
|
10 |
|
fast-webcrawler |
0%
|
9 |
|
istellabot |
0%
|
9 |
|
krzana-rss-bot |
0%
|
9 |
|
tineye-bot |
0%
|
9 |
|
who.is bot |
0%
|
9 |
|
zaldamosearchbot |
0%
|
9 |
|
discobot |
0%
|
8 |
|
keybot translation-search-machine |
0%
|
8 |
|
w3c-checklink |
0%
|
8 |
|
backlink-checker-spider |
0%
|
7 |
|
bing |
0%
|
7 |
|
coccoc |
0%
|
7 |
|
gluten free crawler |
0%
|
7 |
|
orbbot |
0%
|
7 |
|
pagething.com crawler |
0%
|
7 |
|
qwantbot |
0%
|
7 |
|
smtbot |
0%
|
7 |
|
speedy spider |
0%
|
7 |
|
web crawler |
0%
|
7 |
|
adidxbot |
0%
|
6 |
|
arquivo-web-crawler |
0%
|
6 |
|
dmca.com page protection crawling service |
0%
|
6 |
|
entferbot |
0%
|
6 |
|
googlebot-image |
0%
|
6 |
|
pimeyes.com crawler |
0%
|
6 |
|
pinterest |
0%
|
6 |
|
sjuupbot |
0%
|
6 |
|
1.0 crawler |
0%
|
5 |
|
appengine-google |
0%
|
5 |
|
crawl your own stuff with http |
0%
|
5 |
|
googlebot-mobile |
0%
|
5 |
|
http_request2 |
0%
|
5 |
|
linespider |
0%
|
5 |
|
multizilla |
0%
|
5 |
|
nsrbot |
0%
|
5 |
|
piplbot |
0%
|
5 |
|
waterfox |
0%
|
5 |
|
wotbox |
0%
|
5 |
|
adsbot-google |
0%
|
4 |
|
archiveteam archivebot |
0%
|
4 |
|
cakephp |
0%
|
4 |
|
caliperbot |
0%
|
4 |
|
ezooms |
0%
|
4 |
|
feedfetcher-google |
0%
|
4 |
|
fuelbot |
0%
|
4 |
|
googlebot-news |
0%
|
4 |
|
iceweasel |
0%
|
4 |
|
k-meleon |
0%
|
4 |
|
lawinsiderbot |
0%
|
4 |
|
like feedfetcher-google |
0%
|
4 |
|
mindupbot |
0%
|
4 |
|
mozilla |
0%
|
4 |
|
snoopy |
0%
|
4 |
|
537.36 hubspot webcrawler - web-crawlers |
0%
|
3 |
|
avant |
0%
|
3 |
|
bdfetch |
0%
|
3 |
|
bidswitchbot |
0%
|
3 |
|
binlar |
0%
|
3 |
|
bradstreetbot |
0%
|
3 |
|
camino |
0%
|
3 |
|
cipacrawler |
0%
|
3 |
|
crawler |
0%
|
3 |
|
discordbot |
0%
|
3 |
|
embedly |
0%
|
3 |
|
genieo |
0%
|
3 |
|
grapeshotcrawler |
0%
|
3 |
|
ias crawler |
0%
|
3 |
|
icc-crawler |
0%
|
3 |
|
info bot 1 |
0%
|
3 |
|
k7mlwcbot |
0%
|
3 |
|
linguee bot |
0%
|
3 |
|
linkarchiver twitter bot |
0%
|
3 |
|
lipperhey-kaus-australis |
0%
|
3 |
|
maxthon |
0%
|
3 |
|
metauri |
0%
|
3 |
|
msiecrawler |
0%
|
3 |
|
orangebot |
0%
|
3 |
|
pingbot |
0%
|
3 |
|
pleskbot |
0%
|
3 |
|
semanticbot |
0%
|
3 |
|
serendeputybot |
0%
|
3 |
|
slackbot-linkexpanding 1 |
0%
|
3 |
|
spiderman crawler |
0%
|
3 |
|
telegrambot |
0%
|
3 |
|
tobbot |
0%
|
3 |
|
trendictionbot0 |
0%
|
3 |
|
tweetmemebot |
0%
|
3 |
|
uptimerobot |
0%
|
3 |
|
w3c_validator |
0%
|
3 |
|
wordupinfosearch |
0%
|
3 |
|
wotbot |
0%
|
3 |
|
yahoobot |
0%
|
3 |
|
007ac9 crawler |
0%
|
2 |
|
3w24bot |
0%
|
2 |
|
a6-indexer |
0%
|
2 |
|
aboundex |
0%
|
2 |
|
acapbot |
0%
|
2 |
|
addsearchbot |
0%
|
2 |
|
admantx platform semantic analyzer - admantx inc |
0%
|
2 |
|
adstxtcrawler |
0%
|
2 |
|
amibot - http |
0%
|
2 |
|
analyzer |
0%
|
2 |
|
anderspinkbot |
0%
|
2 |
|
autoxbot |
0%
|
2 |
|
backlinkcrawler |
0%
|
2 |
|
baidu-yunguance-perfbot |
0%
|
2 |
|
bnf.fr_bot |
0%
|
2 |
|
bomborabot |
0%
|
2 |
|
cheshire |
0%
|
2 |
|
dnyzbot |
0%
|
2 |
|
dragonbot |
0%
|
2 |
|
dubbotbot |
0%
|
2 |
|
dy research stat 1 |
0%
|
2 |
|
dy robot 1 |
0%
|
2 |
|
echobot |
0%
|
2 |
|
exabot pyexalead |
0%
|
2 |
|
gaisbot |
0%
|
2 |
|
ia_archiver |
0%
|
2 |
|
ibrowse |
0%
|
2 |
|
integromedb |
0%
|
2 |
|
kemvibot |
0%
|
2 |
|
kosmiobot |
0%
|
2 |
|
landau-media-spider |
0%
|
2 |
|
librabot |
0%
|
2 |
|
like googlebot |
0%
|
2 |
|
linkedinbot |
0%
|
2 |
|
memorybot |
0%
|
2 |
|
mlbot |
0%
|
2 |
|
msnbot-udiscovery |
0%
|
2 |
|
neeva-bot |
0%
|
2 |
|
neticle crawler v1 |
0%
|
2 |
|
ntentbot |
0%
|
2 |
|
paperlibot |
0%
|
2 |
|
pear http_request class |
0%
|
2 |
|
rankactivelinkbot |
0%
|
2 |
|
ridderbot |
0%
|
2 |
|
scoutjet |
0%
|
2 |
|
sedo_parking_robot |
0%
|
2 |
|
semanticscholarbot |
0%
|
2 |
|
sentibot www.sentibot |
0%
|
2 |
|
shiira |
0%
|
2 |
|
simplecrawler |
0%
|
2 |
|
sogou pic spider |
0%
|
2 |
|
taboolabot |
0%
|
2 |
|
tech_crawling |
0%
|
2 |
|
toutiaospider |
0%
|
2 |
|
vebidoobot |
0%
|
2 |
|
virusdie crawler |
0%
|
2 |
|
wesee:search |
0%
|
2 |
|
www.exif-search |
0%
|
2 |
|
yahoo |
0%
|
2 |
|
yahoo! slurp |
0%
|
2 |
|
yandeximages |
0%
|
2 |
|
yandexmobilebot |
0%
|
2 |
|
yandexsearchshop |
0%
|
2 |
|
zend_http_client |
0%
|
2 |
|
0752babcebde.bingsearchlib |
0%
|
1 |
|
1.4 feed-fetcher |
0%
|
1 |
|
1.5.0.11 360spider |
0%
|
1 |
|
142005646cd7.bingsearchlib |
0%
|
1 |
|
2.0.0.6 - james bot - webcrawler http |
0%
|
1 |
|
209.221.138.130.c752sa3k9oeb2eg2ehpgc8fnhkeyyyyyn.domsearch |
0%
|
1 |
|
209.221.138.131.c752sa3k9oeb2eg2ehpgc8fnhkeyyyyyn.domsearch |
0%
|
1 |
|
209.221.138.132.c752sa3k9oeb2eg2ehpgc8fnhkeyyyyyn.domsearch |
0%
|
1 |
|
209.221.138.134.c752sa3k9oeb2eg2ehpgc8fnhkeyyyyyn.domsearch |
0%
|
1 |
|
209.221.138.135.c752sa3k9oeb2eg2ehpgc8fnhkeyyyyyn.domsearch |
0%
|
1 |
|
209.221.138.136.c752sa3k9oeb2eg2ehpgc8fnhkeyyyyyn.domsearch |
0%
|
1 |
|
209.221.138.137.c752sa3k9oeb2eg2ehpgc8fnhkeyyyyyn.domsearch |
0%
|
1 |
|
209.221.138.140.c752sa3k9oeb2eg2ehpgc8fnhkeyyyyyn.domsearch |
0%
|
1 |
|
209.221.138.143.c752sa3k9oeb2eg2ehpgc8fnhkeyyyyyn.domsearch |
0%
|
1 |
|
209.221.138.144.c752sa3k9oeb2eg2ehpgc8fnhkeyyyyyn.domsearch |
0%
|
1 |
|
394a825d43b6.bingsearchlib |
0%
|
1 |
|
488439c03e53.bingsearchlib |
0%
|
1 |
|
6aef61fb33da.bingsearchlib |
0%
|
1 |
|
76fc81d6232d.bingsearchlib |
0%
|
1 |
|
adsbot-google-mobile |
0%
|
1 |
|
adsbot-google-mobile-apps |
0%
|
1 |
|
amazonbot |
0%
|
1 |
|
araturka |
0%
|
1 |
|
atom feed robot |
0%
|
1 |
|
awariosmartbot |
0%
|
1 |
|
awesomecrawler |
0%
|
1 |
|
baidu-yunguance-bot |
0%
|
1 |
|
baiduspider-render |
0%
|
1 |
|
behloolbot |
0%
|
1 |
|
blogbeatbot |
0%
|
1 |
|
blp_bbot |
0%
|
1 |
|
bot |
0%
|
1 |
|
bubing |
0%
|
1 |
|
bublupbot |
0%
|
1 |
|
built with stormcrawler archetype 1 |
0%
|
1 |
|
burf.co search engine |
0%
|
1 |
|
buzzbot |
0%
|
1 |
|
clark-crawler2 |
0%
|
1 |
|
contxbot |
0%
|
1 |
|
crunchbot |
0%
|
1 |
|
curebot |
0%
|
1 |
|
cutbot |
0%
|
1 |
|
cxensebot |
0%
|
1 |
|
daumoa |
0%
|
1 |
|
dcrawl |
0%
|
1 |
|
deadlinkchecker |
0%
|
1 |
|
demandbasepublisheranalyzer |
0%
|
1 |
|
digincore bot |
0%
|
1 |
|
dragonfly |
0%
|
1 |
|
duckduckbot |
0%
|
1 |
|
everyonesocialbot |
0%
|
1 |
|
eyeotabot |
0%
|
1 |
|
fast enterprise crawler 6 used by schibsted |
0%
|
1 |
|
femtosearchbot |
0%
|
1 |
|
flaxcrawler |
0%
|
1 |
|
freewebmonitoring |
0%
|
1 |
|
g2reader-bot |
0%
|
1 |
|
googlebot-video |
0%
|
1 |
|
healthcheckbot |
0%
|
1 |
|
httpunit |
0%
|
1 |
|
huaweisymantecspider |
0%
|
1 |
|
icbot |
0%
|
1 |
|
iframely |
0%
|
1 |
|
imagefetcher |
0%
|
1 |
|
imrbot |
0%
|
1 |
|
indy |
0%
|
1 |
|
infoobot |
0%
|
1 |
|
iskanie |
0%
|
1 |
|
it2media-domain-crawler |
0%
|
1 |
|
jooblebot |
0%
|
1 |
|
jpg-newsbot |
0%
|
1 |
|
jugendschutzprogramm-crawler |
0%
|
1 |
|
laserlikebot |
0%
|
1 |
|
letsearchbot |
0%
|
1 |
|
linkapediabot |
0%
|
1 |
|
lipperhey link explorer |
0%
|
1 |
|
lipperhey seo service |
0%
|
1 |
|
lipperhey site explorer |
0%
|
1 |
|
livelapbot |
0%
|
1 |
|
mediatoolkitbot |
0%
|
1 |
|
metajobbot |
0%
|
1 |
|
naver blog rssbot |
0%
|
1 |
|
nerdybot |
0%
|
1 |
|
netscape |
0%
|
1 |
|
netvibes |
0%
|
1 |
|
ninja bot |
0%
|
1 |
|
ninjbot |
0%
|
1 |
|
nixstatsbot |
0%
|
1 |
|
omniweb |
0%
|
1 |
|
online-webceo-bot |
0%
|
1 |
|
openhosebot |
0%
|
1 |
|
our-crawler |
0%
|
1 |
|
pcore-http |
0%
|
1 |
|
privacyawarebot |
0%
|
1 |
|
psbot-image |
0%
|
1 |
|
psbot-page |
0%
|
1 |
|
researchbot 0 |
0%
|
1 |
|
s spider |
0%
|
1 |
|
scspider 0 |
0%
|
1 |
|
seekbot |
0%
|
1 |
|
seoanalyzer |
0%
|
1 |
|
sitecheck-sitecrawl by siteimprove |
0%
|
1 |
|
sitecheckerbot |
0%
|
1 |
|
sitecheckerbotcrawler |
0%
|
1 |
|
sitesucker |
0%
|
1 |
|
skypeuripreview |
0%
|
1 |
|
slackbot 1 |
0%
|
1 |
|
sogou news spider |
0%
|
1 |
|
speedy spider for speedyads |
0%
|
1 |
|
spider |
0%
|
1 |
|
startmebot |
0%
|
1 |
|
storygizebot |
0%
|
1 |
|
streamline3bot |
0%
|
1 |
|
sukibot_heritrix |
0%
|
1 |
|
superfeedr bot |
0%
|
1 |
|
thither.direct bot |
0%
|
1 |
|
ucbrowser |
0%
|
1 |
|
vkrobot |
0%
|
1 |
|
vsusearchspider |
0%
|
1 |
|
wgetbot |
0%
|
1 |
|
whoiswebsitebot |
0%
|
1 |
|
woobot |
0%
|
1 |
|
woriobot support |
0%
|
1 |
|
www-mechanize |
0%
|
1 |
|
www.accelobot |
0%
|
1 |
|
xenu |
0%
|
1 |
|
yandexaccessibilitybot |
0%
|
1 |
|
yandexmetrika |
0%
|
1 |
|
yandexmobilescreenshotbot |
0%
|
1 |
|
yandexscreenshotbot |
0%
|
1 |
|
yats crawler |
0%
|
1 |
|
yeti |
0%
|
1 |
|
yoozbot-2 |
0%
|
1 |
|
zenback bot |
0%
|
1 |
![[x]](/themes/dragonfly_modded/images/minus.png "Show/hide content")
REGISTER Log On/Off
QandA