AI & bot directory · Search engine
DuckDuckBot: what it is, how to verify it and how to block it
DuckDuckBot is run by DuckDuckGo. Crawls the web to improve DuckDuckGo's search results.
Key facts
| Operator | DuckDuckGo |
|---|---|
| Category | Search engine |
| robots.txt name | DuckDuckBot |
| Follows robots.txt | OK: Yes |
| Can it be verified? | OK: Yes, by IP ranges |
| Official documentation | |
| Registry checked | Nov 11, 2026 |
User agent
Its name in robots.txt is DuckDuckBot.
DuckDuckGo documents this user-agent string:
DuckDuckBot/1.1; (+http://duckduckgo.com/duckduckbot.html)
Can you verify DuckDuckBot?
Yes DuckDuckGo publishes the IP addresses DuckDuckBot uses. We download that list every 6 hours: our copy is from Nov 15, 2026 and has 486 entries; DuckDuckGo dated it Sep 1, 2026.
Does DuckDuckBot follow robots.txt?
Yes DuckDuckGo says DuckDuckBot follows robots.txt.
“DuckDuckBot respects https://robotstxt.org/”
How to block or allow DuckDuckBot
To ask it to stay away from the whole site, add this to robots.txt:
User-agent: DuckDuckBot
Disallow: /
To keep it out of one folder only:
User-agent: DuckDuckBot
Disallow: /private/
To allow it while asking every other bot to stay away:
User-agent: DuckDuckBot
Allow: /
User-agent: *
Disallow: /
robots.txt is a request, not a lock. To enforce a block, add a firewall or CDN rule. Because DuckDuckGo publishes DuckDuckBot's addresses, a rule can match them exactly, so a fake DuckDuckBot can't slip through as the real one.
To build one robots.txt for several bots at once, use the robots.txt generator.
How often does DuckDuckBot visit?
DuckDuckGo doesn't publish how often DuckDuckBot visits a site, and iplover doesn't see your traffic. Your own access log is the only reliable count: paste it into the log checker, which counts each crawler's visits and flags fakes, in your browser.
Official documentation
Registry checked Nov 11, 2026. The address lists are downloaded every 6 hours.