Our crawler
AnswergistBot
AnswergistBot/1.0 (+https://answergist.com/bot) · Wilphia LLC · hello@answergist.com
Answergist measures how AI answer engines describe a product. If you run a site and this user agent appeared in your logs, here is exactly what it did and why.
What it fetches
One file: /robots.txt. Once a week at most. Nothing else, ever — it follows no links, requests no other path, and reads no page content.
Whose sites
Only domains whose owner has both subscribed to Answergist and verified that they control the domain. We read the file to tell that customer which AI crawlers their own robots.txt allows — because a CDN setting or a dashboard toggle can change that without them touching their site or noticing it happened.
Stopping it
There is no crawl to block, and we would rather say so than offer you a switch that does nothing. A robots.txt rule would not apply here in any case: under RFC 9309, fetching /robots.txt is not itself governed by the rules inside it. If you would prefer we did not request the file at all, email hello@answergist.com and we will stop for your domain.
What it is not
It never claims to be another crawler. Answergist does not send GPTBot, ClaudeBot, PerplexityBot, Googlebot or any other operator’s user agent — if you see one of those, it is not us. We identify ourselves precisely so you can tell the difference.