Site audit
What AI assistants' crawlers can read on Cheap Seats's sites, checked over plain HTTP the way a crawler that runs no JavaScript sees them: robots.txt rules and firewall blocks for each AI crawler, llms.txt, the sitemap, and each page's title, description, headings, structured data and text. Free: no model calls. Its errors and warnings go to the analyst with the next fix list.
Last audit 2026-10-23 00:34:25 · 0 errors · 0 warnings · 1 info
cheapseats.dev
https://cheapseats.dev/ · robots.txt 200 · llms.txt 200 · sitemap 39 pages, newest 2026-10-22
AI crawlers: robots.txt, and the home page fetched with each one's user agent
| Crawler | For | robots.txt | Home page |
|---|---|---|---|
| ChatGPT-User OpenAI | assistant | allowed | 200 |
| Claude-User Anthropic | assistant | allowed | 200 |
| Perplexity-User Perplexity | assistant | allowed | 200 |
| OAI-SearchBot OpenAI | search | allowed | 200 |
| Claude-SearchBot Anthropic | search | allowed | 200 |
| PerplexityBot Perplexity | search | allowed | 200 |
| GPTBot OpenAI | training | allowed | – |
| ClaudeBot Anthropic | training | allowed | – |
| anthropic-ai Anthropic | training | allowed | – |
| Google-Extended Google | training | allowed | – |
| Applebot-Extended Apple | training | allowed | – |
| CCBot Common Crawl | training | allowed | – |
| Meta-ExternalAgent Meta | training | allowed | – |
| Bytespider ByteDance | training | allowed | – |
| Googlebot Google | engine | allowed | – |
| Bingbot Microsoft | engine | allowed | – |
11 pages checked
| Page | Status | Title | Description | H1 | JSON-LD | Text |
|---|---|---|---|---|---|---|
| https://cheapseats.dev/ | 200 | Cheap Seats: open-source, self-hosted AI visibility tracker | 153 | 1 | Offer SoftwareApplication | 4315 |
| https://cheapseats.dev/compare/profound/ | 200 | Cheap Seats vs Profound · Cheap Seats | 156 | 1 | Article SoftwareApplication WebSite | 4966 |
| https://cheapseats.dev/guides/track-ai-citations/ | 200 | Track which pages AI assistants cite · Cheap Seats | 162 | 1 | SoftwareApplication TechArticle WebSite | 8603 |
| https://cheapseats.dev/compare/ | 200 | Compare · Cheap Seats, the open-source AI visibility tracker | 158 | 1 | CollectionPage SoftwareApplication WebSite | 3088 |
| https://cheapseats.dev/compare/otterly-ai/ | 200 | Cheap Seats vs Otterly.AI · Cheap Seats | 158 | 1 | Article SoftwareApplication WebSite | 4692 |
| https://cheapseats.dev/docs/reading-results/ | 200 | Reading results · Cheap Seats | 144 | 1 | SoftwareApplication TechArticle WebSite | 14083 |
| https://cheapseats.dev/docs/noise-and-confidence/ | 200 | How big a change Cheap Seats can detect · Cheap Seats | 159 | 1 | SoftwareApplication TechArticle WebSite | 10051 |
| https://cheapseats.dev/docs/self-hosting/ | 200 | Self-hosted AI visibility tracker: Docker and Kubernetes | 162 | 1 | SoftwareApplication TechArticle WebSite | 7529 |
| https://cheapseats.dev/docs/deploying/ | 200 | Deploying · Cheap Seats | 126 | 1 | SoftwareApplication TechArticle WebSite | 10624 |
| https://cheapseats.dev/docs/reference/ | 200 | CLI, API and MCP · Cheap Seats | 130 | 1 | SoftwareApplication TechArticle WebSite | 13795 |
| https://cheapseats.dev/blog/why-ai-visibility-scores-differ/ | 200 | Why AI visibility scores differ between tools · Cheap Seats | 157 | 1 | BlogPosting Person SoftwareApplication WebSite | 6640 |
cheapseats.dev/docs
https://cheapseats.dev/docs · robots.txt 200
AI crawlers: robots.txt, and the home page fetched with each one's user agent
| Crawler | For | robots.txt | Home page |
|---|---|---|---|
| ChatGPT-User OpenAI | assistant | allowed | 200 |
| Claude-User Anthropic | assistant | allowed | 200 |
| Perplexity-User Perplexity | assistant | allowed | 200 |
| OAI-SearchBot OpenAI | search | allowed | 200 |
| Claude-SearchBot Anthropic | search | allowed | 200 |
| PerplexityBot Perplexity | search | allowed | 200 |
| GPTBot OpenAI | training | allowed | – |
| ClaudeBot Anthropic | training | allowed | – |
| anthropic-ai Anthropic | training | allowed | – |
| Google-Extended Google | training | allowed | – |
| Applebot-Extended Apple | training | allowed | – |
| CCBot Common Crawl | training | allowed | – |
| Meta-ExternalAgent Meta | training | allowed | – |
| Bytespider ByteDance | training | allowed | – |
| Googlebot Google | engine | allowed | – |
| Bingbot Microsoft | engine | allowed | – |
1 pages checked
| Page | Status | Title | Description | H1 | JSON-LD | Text |
|---|---|---|---|---|---|---|
| https://cheapseats.dev/docs | 200 | Docs · Cheap Seats, the open-source AI visibility tracker | 141 | 1 | CollectionPage SoftwareApplication WebSite | 3913 |
cheapseats.dev/blog
https://cheapseats.dev/blog · robots.txt 200
AI crawlers: robots.txt, and the home page fetched with each one's user agent
| Crawler | For | robots.txt | Home page |
|---|---|---|---|
| ChatGPT-User OpenAI | assistant | allowed | 200 |
| Claude-User Anthropic | assistant | allowed | 200 |
| Perplexity-User Perplexity | assistant | allowed | 200 |
| OAI-SearchBot OpenAI | search | allowed | 200 |
| Claude-SearchBot Anthropic | search | allowed | 200 |
| PerplexityBot Perplexity | search | allowed | 200 |
| GPTBot OpenAI | training | allowed | – |
| ClaudeBot Anthropic | training | allowed | – |
| anthropic-ai Anthropic | training | allowed | – |
| Google-Extended Google | training | allowed | – |
| Applebot-Extended Apple | training | allowed | – |
| CCBot Common Crawl | training | allowed | – |
| Meta-ExternalAgent Meta | training | allowed | – |
| Bytespider ByteDance | training | allowed | – |
| Googlebot Google | engine | allowed | – |
| Bingbot Microsoft | engine | allowed | – |
1 pages checked
| Page | Status | Title | Description | H1 | JSON-LD | Text |
|---|---|---|---|---|---|---|
| https://cheapseats.dev/blog | 200 | Blog · Cheap Seats, the open-source AI visibility tracker | 134 | 1 | CollectionPage SoftwareApplication WebSite | 5535 |
github.com/cheapseatsdev/cheapseats
https://github.com/cheapseatsdev/cheapseats · robots.txt 200
AI crawlers: robots.txt, and the home page fetched with each one's user agent
| Crawler | For | robots.txt | Home page |
|---|---|---|---|
| ChatGPT-User OpenAI | assistant | allowed | 200 |
| Claude-User Anthropic | assistant | allowed | 200 |
| Perplexity-User Perplexity | assistant | allowed | 200 |
| OAI-SearchBot OpenAI | search | allowed (named) | 200 |
| Claude-SearchBot Anthropic | search | allowed | 200 |
| PerplexityBot Perplexity | search | allowed (named) | 200 |
| GPTBot OpenAI | training | allowed (named) | – |
| ClaudeBot Anthropic | training | allowed (named) | – |
| anthropic-ai Anthropic | training | allowed (named) | – |
| Google-Extended Google | training | allowed | – |
| Applebot-Extended Apple | training | allowed | – |
| CCBot Common Crawl | training | allowed | – |
| Meta-ExternalAgent Meta | training | allowed | – |
| Bytespider ByteDance | training | blocked (named) | – |
| Googlebot Google | engine | allowed | – |
| Bingbot Microsoft | engine | allowed (named) | – |
info robots.blocks-training robots.txt (User-agent: Bytespider) blocks Bytespider, ByteDance's training crawler, from /cheapseatsdev/cheapseats/. That's a choice: it keeps pages out of future models' training data, not out of search answers.
https://github.com/robots.txt
Fix: Nothing to do unless you want future models to learn from these pages.
1 pages checked
| Page | Status | Title | Description | H1 | JSON-LD | Text |
|---|---|---|---|---|---|---|
| https://github.com/cheapseatsdev/cheapseats | 200 | 0 | 0 | 0 |
Pages the answers cite
The third-party pages a run's answers cited (then surfaced) most, fetched as Cheap Seats where their robots.txt allows, to see whether they name Cheap Seats and which competitors. One that names competitors but not Cheap Seats is an outreach target. Free; each page is fetched at most once a day.
This run hasn't been checked yet.