AI crawlers
From imported access logs: which of Cheap Seats's pages AI crawlers fetched (for someone's question, for an assistant's search index, for training, or for a web search engine), and the visits people made from an assistant's answer, beside how often the latest runs cited and surfaced each page. Unverified: crawlers are told apart by user agent only, which anyone can send. Import logs with cheapseats crawl import <logfile>.
Since 2026-10-16 · logs from 2026-10-23 to 2026-10-23 · cheapseats.dev
By crawler
| Crawler or assistant | Class | Requests | Pages |
|---|---|---|---|
| ClaudeBot | training | 18 | 14 |
| Googlebot | engine | 21 | 14 |
| Bingbot | engine | 9 | 4 |
Pages
Crawled, never cited: AI crawlers read it, but no answer in the latest runs cited it. Cited, never crawled by search bots: answers cite it, but no assistant or AI search crawler fetched it in the window, so the citation may come from an index or a copy elsewhere.
| Page | Cited | Surfaced | Assistant | AI search | Training | Engine | AI referrals | Last fetched |
|---|---|---|---|---|---|---|---|---|
| cheapseats.dev/robots.txt crawled, never cited | 0 | 0 | 0 | 0 | 3 | 8 | 0 | 2026-10-23 |
| cheapseats.dev/sitemap.xml crawled, never cited | 0 | 0 | 0 | 0 | 3 | 2 | 0 | 2026-10-23 |
| cheapseats.dev/docs/read-only-copy crawled, never cited | 0 | 0 | 0 | 0 | 1 | 1 | 0 | 2026-10-23 |
| cheapseats.dev/blog/ai-visibility-tools-compared/index.md crawled, never cited | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 2026-10-23 |
| cheapseats.dev/blog/cheap-seats-vs-promptfoo/index.md crawled, never cited | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 2026-10-23 |
| cheapseats.dev/blog/free-open-source-ai-visibility-tracker/index.md crawled, never cited | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 2026-10-23 |
| cheapseats.dev/blog/why-we-built-cheap-seats/index.md crawled, never cited | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 2026-10-23 |
| cheapseats.dev/compare/otterly-ai/index.md crawled, never cited | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 2026-10-23 |
| cheapseats.dev/docs/cli-and-ci crawled, never cited | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 2026-10-23 |
| cheapseats.dev/docs/cli-and-ci/index.md crawled, never cited | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 2026-10-23 |
| cheapseats.dev/docs/read-only-copy/index.md crawled, never cited | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 2026-10-23 |
| cheapseats.dev/guides/benchmark-against-competitors/index.md crawled, never cited | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 2026-10-23 |
| cheapseats.dev/guides/mentioned-vs-recommended/index.md crawled, never cited | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 2026-10-23 |
| cheapseats.dev/guides/track-ai-citations/index.md crawled, never cited | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 2026-10-23 |