AI & bot directory · SEO crawler
DotBot: what it is, how to verify it and how to block it
DotBot is run by Moz. Crawls the web for the Moz Link Index behind Link Explorer and the Moz API.
Key facts
| Operator | Moz |
|---|---|
| Category | SEO crawler |
| robots.txt name | dotbot |
| Follows robots.txt | OK: Yes |
| Can it be verified? | Couldn't check: No, user agent only |
| Official documentation | |
| Registry checked | Nov 11, 2026 |
User agent
Its name in robots.txt is dotbot.
Moz doesn't publish a full user-agent string; look for dotbot in the user agent.
Can you verify DotBot?
No Moz publishes no IP addresses or reverse-DNS names for DotBot, so any visitor can claim to be it. Treat its user agent as a claim.
Does DotBot follow robots.txt?
Yes Moz says DotBot follows robots.txt.
“we always respect the standard Robots Exclusion Protocol (aka robots.txt)”
Moz says DotBot also honours Crawl-delay, which slows it down without blocking it.
How to block or allow DotBot
To ask it to stay away from the whole site, add this to robots.txt:
User-agent: dotbot
Disallow: /
To keep it out of one folder only:
User-agent: dotbot
Disallow: /private/
To allow it while asking every other bot to stay away:
User-agent: dotbot
Allow: /
User-agent: *
Disallow: /
robots.txt is a request, not a lock. To enforce a block, add a firewall or CDN rule that matches dotbot in the user agent. That stops the real DotBot; a bot that lies about its user agent can still get through.
To build one robots.txt for several bots at once, use the robots.txt generator.
How often does DotBot visit?
Moz doesn't publish how often DotBot visits a site, and iplover doesn't see your traffic. Your own access log is the only reliable count: paste it into the log checker, which counts each crawler's visits and flags fakes, in your browser.
Official documentation
Registry checked Nov 11, 2026. The address lists are downloaded every 6 hours.