AI & bot directory · SEO crawler
AhrefsBot: what it is, how to verify it and how to block it
AhrefsBot is run by Ahrefs. Crawls the web for Ahrefs' link and SEO database. AhrefsSiteAudit audits sites at their owners' request.
Key facts
| Operator | Ahrefs |
|---|---|
| Category | SEO crawler |
| robots.txt name | AhrefsBot, AhrefsSiteAudit |
| Follows robots.txt | OK: Yes |
| Can it be verified? | OK: Yes, by IP ranges and reverse DNS |
| Official documentation | |
| Registry checked | Nov 11, 2026 |
User agent
Its names in robots.txt are AhrefsBot, AhrefsSiteAudit.
Ahrefs documents this user-agent string:
Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/)Mozilla/5.0 (compatible; AhrefsSiteAudit/6.1; +http://ahrefs.com/robot/site-audit)
Can you verify AhrefsBot?
Yes Ahrefs publishes the IP addresses AhrefsBot uses. We download that list every 6 hours: our copy is from Nov 15, 2026 and has 81 entries; Ahrefs doesn't date it.
Its addresses also have reverse-DNS names under ahrefs.com, ahrefs.net; a name only counts if it points back to the same address.
Does AhrefsBot follow robots.txt?
Yes Ahrefs says AhrefsBot follows robots.txt.
“Both bots strictly respect robots.txt on both disallow and allow rules, as well as crawl-delay directives.”
Ahrefs says AhrefsBot also honours Crawl-delay, which slows it down without blocking it.
How to block or allow AhrefsBot
To ask it to stay away from the whole site, add this to robots.txt:
User-agent: AhrefsBot
User-agent: AhrefsSiteAudit
Disallow: /
To keep it out of one folder only:
User-agent: AhrefsBot
User-agent: AhrefsSiteAudit
Disallow: /private/
To allow it while asking every other bot to stay away:
User-agent: AhrefsBot
User-agent: AhrefsSiteAudit
Allow: /
User-agent: *
Disallow: /
robots.txt is a request, not a lock. To enforce a block, add a firewall or CDN rule. Because Ahrefs publishes AhrefsBot's addresses, a rule can match them exactly, so a fake AhrefsBot can't slip through as the real one.
To build one robots.txt for several bots at once, use the robots.txt generator.
How often does AhrefsBot visit?
Ahrefs doesn't publish how often AhrefsBot visits a site, and iplover doesn't see your traffic. Your own access log is the only reliable count: paste it into the log checker, which counts each crawler's visits and flags fakes, in your browser.
Official documentation
Registry checked Nov 11, 2026. The address lists are downloaded every 6 hours.