Check my connection

AI & bot directory · SEO crawler

DotBot: what it is, how to verify it and how to block it

DotBot is run by Moz. Crawls the web for the Moz Link Index behind Link Explorer and the Moz API.

Key facts

Key facts
Operator
Moz
Category
SEO crawler
robots.txt name
dotbot
Follows robots.txt
OK: Yes
Can it be verified?
Couldn't check: No, user agent only
Official documentation
Registry checked
Nov 11, 2026

User agent

Its name in robots.txt is dotbot.

Moz doesn't publish a full user-agent string; look for dotbot in the user agent.

Can you verify DotBot?

No Moz publishes no IP addresses or reverse-DNS names for DotBot, so any visitor can claim to be it. Treat its user agent as a claim.

Check an address from your logs

Does DotBot follow robots.txt?

Yes Moz says DotBot follows robots.txt.

“we always respect the standard Robots Exclusion Protocol (aka robots.txt)”

Moz says DotBot also honours Crawl-delay, which slows it down without blocking it.

How to block or allow DotBot

To ask it to stay away from the whole site, add this to robots.txt:

User-agent: dotbot
Disallow: /

To keep it out of one folder only:

User-agent: dotbot
Disallow: /private/

To allow it while asking every other bot to stay away:

User-agent: dotbot
Allow: /

User-agent: *
Disallow: /

robots.txt is a request, not a lock. To enforce a block, add a firewall or CDN rule that matches dotbot in the user agent. That stops the real DotBot; a bot that lies about its user agent can still get through.

To build one robots.txt for several bots at once, use the robots.txt generator.

How often does DotBot visit?

Moz doesn't publish how often DotBot visits a site, and iplover doesn't see your traffic. Your own access log is the only reliable count: paste it into the log checker, which counts each crawler's visits and flags fakes, in your browser.

Official documentation

moz.com/help/moz-procedures/crawlers/dotbot

Registry checked Nov 11, 2026. The address lists are downloaded every 6 hours.