isaeo
Start free
Crawler information

IsaeoBot

IsaeoBot is the crawler behind isaeo's SEO and answer-engine audits. If you found it in your server logs, this page explains exactly what it is, what it requests, and how to control or block it.

How to identify it

User-Agent IsaeoBot/1.0 (+https://www.isaeo.com/bot)
Product token IsaeoBot — use this in robots.txt
Requests HTML pages, plus /robots.txt and /llms.txt. We don't request images, scripts, stylesheets or media.
Rate One page at a time, at least 0.3s apart. If your robots.txt sets a Crawl-delay, we use that instead (up to 10s).
Volume Up to 50 pages per audit. We don't crawl continuously and we don't return on a schedule unless a customer re-runs an audit.

Why it visited your site

One of two reasons. Either you or your agency asked us to audit your site — that's the normal case, and the crawl was started by a logged-in customer. Or an isaeo customer ran a competitor comparison that included your domain, to see how their own site's SEO measures up against yours.

In both cases we only read what a search engine reads: your public HTML. We don't submit forms, we don't attempt to log in, we don't execute your JavaScript, and we don't collect personal data from your pages.

How to block or slow it down

We obey robots.txt on every crawl of a site our customer doesn't own, and we fail closed: if we can't read your robots.txt, we don't crawl at all.

Block it entirely

User-agent: IsaeoBot
Disallow: /

Block part of your site

User-agent: IsaeoBot
Disallow: /private/
Disallow: /admin/

Slow it down

User-agent: IsaeoBot
Crawl-delay: 10

Changes take effect on our next visit — we read robots.txt fresh at the start of every crawl, never from a cache.

One caveat worth knowing: naming IsaeoBot in its own group means your User-agent: * rules stop applying to us, which is correct per RFC 9309 but catches people out. If you want both, repeat the directives you care about inside our group.

Still seeing something wrong?

If IsaeoBot ignored your robots.txt, requested more than you'd expect, or you want your domain excluded from competitor comparisons entirely, contact us with your domain and a few log lines. We'll investigate and confirm back.

Anything claiming to be IsaeoBot from an unexpected source may be spoofing our User-Agent — send us the logs and we'll help you tell the difference.