Crawler

AnswerTideBot

Honest user-agent: AnswerTideBot/1.0 (+https://answertide.com/bot). Operated by AnswerTide. Block this UA to opt out.

What we fetch

Public HTML (and PDF text layers) on a domain someone asked us to index — a customer, a trial, or a 7-day demo. We start from robots.txt and sitemaps. We honor robots.txt, including Crawl-delay up to 2 seconds. Above that we skip the site. We do not spoof a browser UA.

What we do not do

• Ignore robots.txt
• Bypass logins or fetch non-public pages
• Use crawled text as instructions to the model
• Invent URLs that were not in the index

Opt out / delete

Block AnswerTideBot in robots.txt. For a demo already built, use the delete control on the demo page or email privacy@answertide.com. Demos expire in 7 days.