Crawler

EvidentBot

Last updated 1 November 2026

EvidentBot is the web crawler run by Evident (Scale Labs LLC, doing business as Evident). Evident measures how businesses are perceived in search, by AI assistants and by people. EvidentBot reads the public pages and files those measurements need.

User agent contains: EvidentBot/1.0
robots.txt token: EvidentBot
Pace: At most 4 requests at a time per site
Contact: hello@evident.so

How to recognize it

EvidentBot identifies itself with this user agent:

EvidentBot/1.0 (+https://evident.so/bot)

Research runs, in which Evident compares ways of collecting pages, add a short label after the link. Those runs follow the same rules. Every EvidentBot user agent contains EvidentBot/1.0 and a link to this page, so matching on EvidentBot finds them all.

robots.txt

EvidentBot follows robots.txt as defined in RFC 9309. Its product token is EvidentBot. It obeys the group that names EvidentBot, or the * group when no group does. To keep EvidentBot off your whole site, add:

User-agent: EvidentBot
Disallow: /

If your robots.txt already names EvidentBot, also delete the Allow lines in those groups. EvidentBot combines every group that names it and follows the longest matching rule, so a line such as Allow: /public/ would keep that path open.

If robots.txt returns a 4xx status, such as 404, EvidentBot treats the site as having no restrictions.
If robots.txt returns a 5xx status or does not answer, EvidentBot treats the whole site as disallowed and fetches nothing from it.
EvidentBot checks every URL against robots.txt before fetching it, including each step of a redirect.

Blocks and challenges

EvidentBot never tries to get around bot detection. When a site blocks it or shows a challenge, such as a CAPTCHA, EvidentBot records the block and does not retry.

Pace

EvidentBot sends at most 4 requests at a time to any one site.

Opt out or contact us

To stop EvidentBot, add the robots.txt rule above. To ask a question, report abuse or ask us to stop crawling your site, email hello@evident.so. Please include your domain and, if you have them, the time and IP address of the requests.

If a request claims to be EvidentBot and you are not sure it came from us, write to the same address.