A read-only copy of Cheap Seats measuring itself, updated hourly. Run your own.

What the assistants searched

Open-source and self-hosted AI visibility 2026-10-22 04:31 pooled with the set's finished runs before it that were asked and graded the same way: 2 runs · search track only, from the stored answers · this run alone · JSON

68/68answers searched
141searches
137distinct queries
27%from prompt
34%prompt kept

Top queries

Queries counted together whatever their case, quotes or spacing. Cheap Seats's sites: searches whose results included a page on one of them. Competitors: named in a result's title, or its site. Named Cheap Seats: of the graded answers that ran the query, those that named Cheap Seats.

QueryPromptsAnswersCheap Seats's sitesCompetitors in resultsNamed Cheap Seats
AI search visibility tracking tools ChatGPT Claude brand mentions 202612 1620/20/2
LLM brand monitoring developer tools recommendations Profound Peec AI Otterly comparison +Otterly.AI +Peec AI +Profound12 1620/2Otterly.AI ×2 Peec AI ×2 Profound ×2 0/2
open source self-hosted AI search visibility tracker LLM brand mentions GEO620/2Elmo ×1 Limelit Open ×1 0/2
open source self-hosted AI visibility tracker LLM brand mentions Docker GitHub520/20/2
AI brand monitoring ChatGPT Claude scheduled prompts weekly tracking answers Peec Profound Otterly | Promptfoo scheduled evaluations OpenAI Anthropic GitHub actions +Otterly.AI +Peec AI +Profound1410/1Otterly.AI ×1 Peec AI ×1 Profound ×1 0/1
AI search visibility API generative engine optimization open source command line 2026910/11/1
AI search visibility API Profound Peec Otterly API access 2026 +Otterly.AI +Peec AI +Profound1110/1Otterly.AI ×1 Peec AI ×1 Profound ×1 0/1
AI search visibility platform API access raw LLM answers prompt-level data export1010/10/1
AI search visibility platform raw response data export BigQuery API 20261310/10/1
AI search visibility platform SaaS "bring your own key" ChatGPT Claude brand tracking pricing 2026710/1Profound ×1 0/1
AI search visibility tools compare brand mentions ChatGPT Perplexity Gemini Claude prompts 20261710/10/1
AI search visibility tracker self hosted Kubernetes open source Otterly Peec alternative | GitHub AI search visibility tracker self hosted docker GEO +Otterly.AI +Peec AI610/1Elmo ×1 Otterly.AI ×1 Peec AI ×1 Profound ×1 0/1
AI search visibility tracker self hosted Kubernetes open source Peec Otterly alternatives | GitHub AI search visibility tracker self hosted docker GEO +Otterly.AI +Peec AI610/1Elmo ×1 Otterly.AI ×1 Peec AI ×1 Profound ×1 0/1
AI visibility brand tracking CLI tool LLM answers GitHub Actions910/11/1
"AI visibility" "git" "questions" | "AI visibility" "pull requests" | "AI visibility" "Git-native"1010/10/1
"AI visibility" "git" tool -site:reddit.com -code -review -coding | "GEO" "tracking" "prompts" "git" tool | "AI visibility" "versioned" "CLI"1010/10/1
AI visibility LLM brand mentions CLI tool CI pipeline GEO open source1110/10/1
AI visibility MCP server Claude Code Peec Profound Otterly Scrunch | AI visibility MCP server Claude Code tools +Otterly.AI +Peec AI +Profound1210/1Otterly.AI ×1 Peec AI ×1 Profound ×1 0/1
AI visibility monitoring CLI CI pipeline API Profound Peec Otterly | AI visibility CLI command line GEO monitoring GitHub actions +Otterly.AI +Peec AI +Profound910/1Otterly.AI ×1 Peec AI ×1 Profound ×1 Semrush AI Toolkit ×1 0/1
AI visibility monitoring CLI CI pipeline GEO command line Otterly Profound API | AI visibility CLI github actions promptfoo search brand visibility +Otterly.AI +Profound1110/1Otterly.AI ×1 0/1
"AI visibility" "prompts as code" | "AI visibility" "GitHub" "YAML" | "AI visibility" "questions" "code review"1010/10/1
AI visibility raw responses citations export API Peec Otterly Profound Scrunch | AI visibility platform every answer citation raw data export AthenaHQ +Otterly.AI +Peec AI +Profound1310/1Otterly.AI ×1 Peec AI ×1 Profound ×1 0/1
AI visibility raw responses citations export API Profound Peec Otterly Scrunch | AI visibility platform raw answers citations export API AthenaHQ +Otterly.AI +Peec AI +Profound1010/1Otterly.AI ×1 Peec AI ×1 0/1
AI visibility tool bring your own API key OpenAI Anthropic LLM brand monitoring810/10/1
AI visibility tool export raw LLM responses citations API (Profound, Peec AI, Scrunch, Otterly) +Otterly.AI +Peec AI +Profound1310/1Dageno AI ×1 Otterly.AI ×1 Peec AI ×1 Profound ×1 0/1
AI visibility tool raw responses export API citations Profound Peec AI Scrunch 2026 +Peec AI +Profound1010/1Peec AI ×1 Profound ×1 0/1
AI visibility tracking ChatGPT Claude brand recommendations Profound Peec Otterly Claude supported engines | site.anthropic.com Claude web search citations | site.openai.com ChatGPT search recommendations sources +Otterly.AI +Peec AI +Profound1210/1Ahrefs Brand Radar ×1 Otterly.AI ×1 Peec AI ×1 Profound ×1 0/1
AI visibility tracking "own API keys" "Anthropic" | AI visibility "BYOK" "OpenAI" "Anthropic"810/1Peec AI ×1 Profound ×1 0/1
AI visibility tracking "own" "OpenAI" "Anthropic" "API keys" | AI visibility tools BYOK OpenAI Anthropic710/1Peec AI ×1 Profound ×1 0/1
AI visibility tracking prompts git repository pull request monitoring | AI visibility prompts as code git tracking questions1010/10/1
AI visibility tracking "prompts" "git" "review" tool | AI visibility "queries" "version control" | AI visibility "questions.yml" OR "prompts.yaml"1010/10/1
AI visibility tracking prompts stored in git repository YAML config code review LLM brand monitoring1010/1Ahrefs Brand Radar ×1 0/1
AI visibility tracking tool bring your own API key OpenAI Anthropic710/10/1
AI visibility tracking tool docker self-hosted ChatGPT Perplexity brand monitoring github610/10/1
AI visibility tracking tool MCP server (Profound, Peec AI, Scrunch, Otterly) brand mentions ChatGPT +Otterly.AI +Peec AI +Profound1210/1Otterly.AI ×1 Peec AI ×1 Profound ×1 0/1
AI visibility tracking tool Profound Peec AI pricing ChatGPT Claude monitoring | site.platform.openai.com docs web search responses API | site.platform.claude.com docs web search tool API +Peec AI +Profound410/1Ahrefs Brand Radar ×1 Otterly.AI ×1 Peec AI ×1 Profound ×1 0/1
AI visibility tracking tool use your own ChatGPT Claude subscription instead of API brand mentions710/10/1
AI visibility tracking tools ChatGPT Claude brand mentions prompts 20261410/10/1
AI visibility tracking tools compare brand mentions ChatGPT Perplexity Gemini Claude 20261310/10/1
AI visibility tracking tools pricing 2026 Profound Peec AI Otterly Scrunch +Otterly.AI +Peec AI +Profound410/1AI Peekaboo ×1 Otterly.AI ×1 Peec AI ×1 Profound ×1 0/1
AI visibility tracking tools pricing 2026 Profound Peec AI Otterly Semrush AI toolkit +Otterly.AI +Peec AI +Profound +Semrush AI Toolkit410/1Otterly.AI ×1 Peec AI ×1 Profound ×1 0/1
AI visibility tracking tools Profound Peec AI Otterly brand mentions LLM 2026 +Otterly.AI +Peec AI +Profound1510/10/1
Anthropic Claude API pricing web search $10 per 1000 searches spend limits workspace910/10/1
API responses vs ChatGPT UI answers differ brand visibility tracking web search scraping410/10/1
API vs ChatGPT interface responses differ AI visibility tracking accuracy scraping front-end410/1Otterly.AI ×1 0/1
"bring your own key" AI search visibility tracker pricing810/10/1
ChatGPT API responses differ from ChatGPT app web search answers brand visibility710/1Semrush AI Toolkit ×1 0/1
CiteTrack AI bring your own API key OpenAI Anthropic810/10/1
Claude Console workspace spend limit; OpenAI project budget hard limit 2026910/10/1
coding assistant brand visibility monitoring library API recommendations Profound Scrunch Otterly | Promptfoo coding agent evaluation sandbox claude code codex library recommendations | Scrunch AI monitoring ChatGPT Gemini Perplexity supported engines +Otterly.AI +Profound1510/1Otterly.AI ×1 Peec AI ×1 Profound ×1 0/1

Showing the 50 run by the most answers; 87 more in the JSON.

Names the assistants added

Searches that named a product the prompt hadn't: the assistant added it to the search.

NameSearchesAnswersPromptsFor example
Peec AI332211“AI visibility tracking tools pricing 2026 Profound Peec AI Otterly Semrush AI toolkit”; “site.scrunchai.com AI visibility monitoring pricing | site:peec.ai pricing AI visibility | site:developers.openai.com web search API user location | site:platform.claude.com web search tool API”; “site:peec.ai pricing prompts models daily tracking | site:tryprofound.com answer engine insights visibility citations | site:platform.claude.com/docs web search tool citations pricing”
Otterly.AI272412“open source alternative Profound Peec AI AI visibility tracking GitHub | GitHub open source GEO monitoring AI search visibility Otterly Profound”; “self hosted open source AI answer visibility monitoring GEO LLM brand monitoring | GitHub self hosted AI search visibility tracker Otterly alternative”; “AI visibility tracking tools pricing 2026 Profound Peec AI Otterly Semrush AI toolkit”
Profound27219“AI visibility tracking tools pricing 2026 Profound Peec AI Otterly Semrush AI toolkit”; “site:peec.ai pricing prompts models daily tracking | site:tryprofound.com answer engine insights visibility citations | site:platform.claude.com/docs web search tool citations pricing”; “AI visibility monitoring CLI CI pipeline API Profound Peec Otterly | AI visibility CLI command line GEO monitoring GitHub actions”
Elmo333“Elmo AI visibility github elmohq open source license | Canonry github AI visibility license”; “Elmo AI visibility github self host kubernetes | AI visibility tracker kubernetes helm self hosted”; “Elmo open source AI visibility self-hosted docker compose github”
Semrush AI Toolkit111“AI visibility tracking tools pricing 2026 Profound Peec AI Otterly Semrush AI toolkit”

How the prompts were rewritten

Words compared without stopwords, plurals folded. From prompt is the share of a search's words that were in its prompt; prompt kept, the share of the prompt's words still in the search.

Added

The vocabulary the assistants search with.

WordSearchesPrompts
brand5317
tracking4717
source4415
open4113
search3914
github3713
llm3616
geo3413
20262914
api297
monitoring2615
mentions2514
tool2512
visibility249
chatgpt2314
pricing237
responses227
web167
prompts166
engine1411
perplexity1410
tracker127
export123
claude108
optimization108

Dropped

Prompt words the searches left out.

WordSearchesPrompts
ai4315
tools409
run355
visibility319
checks295
answer255
recommend225
whether204
ask194
developer-tools154
open-source154
behind152
dashboard152
give152
score152
questions144
track143
tracker143
anthropic133
openai133
cap132
day132
much132
what's123
change122

Add as prompt

Queries whose results named competitors and never reached Cheap Seats's sites. To measure one as a prompt of its own, paste its entry into the set's file in the config repo and reword it as the question a buyer would ask; prompt ids are permanent, so pick one you'll keep.

“LLM brand monitoring developer tools recommendations Profound Peec AI Otterly comparison” — 2 answers · Otterly.AI, Peec AI, Profound

Append to prompt-sets/self-hosted-ai-visibility.toml:

[[prompts]]
id = "llm-brand-monitoring-developer-tools"
text = "LLM brand monitoring developer tools recommendations Profound Peec AI Otterly comparison"
“open source self-hosted AI search visibility tracker LLM brand mentions GEO” — 2 answers · Elmo, Limelit Open

Append to prompt-sets/self-hosted-ai-visibility.toml:

[[prompts]]
id = "open-source-self-hosted-ai"
text = "open source self-hosted AI search visibility tracker LLM brand mentions GEO"
“AI brand monitoring ChatGPT Claude scheduled prompts weekly tracking answers Peec Profound Otterly” — 1 answers · Otterly.AI, Peec AI, Profound

Append to prompt-sets/self-hosted-ai-visibility.toml:

[[prompts]]
id = "ai-brand-monitoring-chatgpt-claude"
text = "AI brand monitoring ChatGPT Claude scheduled prompts weekly tracking answers Peec Profound Otterly"
“Promptfoo scheduled evaluations OpenAI Anthropic GitHub actions” — 1 answers · Otterly.AI, Peec AI, Profound

Append to prompt-sets/self-hosted-ai-visibility.toml:

[[prompts]]
id = "promptfoo-scheduled-evaluations-openai-anthropic"
text = "Promptfoo scheduled evaluations OpenAI Anthropic GitHub actions"
“AI search visibility API Profound Peec Otterly API access 2026” — 1 answers · Otterly.AI, Peec AI, Profound

Append to prompt-sets/self-hosted-ai-visibility.toml:

[[prompts]]
id = "ai-search-visibility-api-profound"
text = "AI search visibility API Profound Peec Otterly API access 2026"
“AI search visibility tracker self hosted Kubernetes open source Otterly Peec alternative” — 1 answers · Elmo, Otterly.AI, Peec AI, Profound

Append to prompt-sets/self-hosted-ai-visibility.toml:

[[prompts]]
id = "ai-search-visibility-tracker-self"
text = "AI search visibility tracker self hosted Kubernetes open source Otterly Peec alternative"
“GitHub AI search visibility tracker self hosted docker GEO” — 1 answers · Elmo, Otterly.AI, Peec AI, Profound

Append to prompt-sets/self-hosted-ai-visibility.toml:

[[prompts]]
id = "github-ai-search-visibility-tracker"
text = "GitHub AI search visibility tracker self hosted docker GEO"
“AI search visibility tracker self hosted Kubernetes open source Peec Otterly alternatives” — 1 answers · Elmo, Otterly.AI, Peec AI, Profound

Append to prompt-sets/self-hosted-ai-visibility.toml:

[[prompts]]
id = "ai-search-visibility-tracker-self-2"
text = "AI search visibility tracker self hosted Kubernetes open source Peec Otterly alternatives"
“AI visibility MCP server Claude Code Peec Profound Otterly Scrunch” — 1 answers · Otterly.AI, Peec AI, Profound

Append to prompt-sets/self-hosted-ai-visibility.toml:

[[prompts]]
id = "ai-visibility-mcp-server-claude"
text = "AI visibility MCP server Claude Code Peec Profound Otterly Scrunch"
“AI visibility MCP server Claude Code tools” — 1 answers · Otterly.AI, Peec AI, Profound

Append to prompt-sets/self-hosted-ai-visibility.toml:

[[prompts]]
id = "ai-visibility-mcp-server-claude-2"
text = "AI visibility MCP server Claude Code tools"

Prompt by prompt

#PromptSearchedSearches per answerDistinctFrom promptPrompt kept
1Are there open-source tools for measuring AI search visibility?4/41.2529%57%
2Is there an open-source alternative to Profound or Peec AI?4/41.5627%60%
3We want to track AI answer visibility without sending our data to another SaaS vendor. What are our options?4/41.5615%18%
4Should we build our own AI visibility tracker on the OpenAI and Anthropic APIs, or buy a tool?4/42.2915%22%
5Is there a self-hosted AI visibility tracker I can run in Docker?4/42.2842%54%
6Can we run an AI search visibility tracker on our own Kubernetes cluster?4/41.8629%51%
7Which AI visibility tools let us use our own OpenAI and Anthropic API keys?4/42.51052%60%
7Can I check what ChatGPT and Claude recommend in my category using my existing subscriptions instead of paying for API calls?2/22.0423%25%
8How much does it cost in API fees to run our own AI visibility checks every day, and how do we cap it?4/43.2138%9%
9Can I run AI visibility checks from the command line or in a CI pipeline?4/41.5631%50%
10We want every raw AI answer and citation behind an AI visibility score, not just a dashboard. Which tools give us that?4/43.81529%31%
10Is there an AI visibility tool that keeps the tracked questions in a git repository, so changes go through code review?2/24.0848%38%
11What's a good open-source way for a developer-tools startup to check whether AI assistants recommend it over alternatives?4/41.8710%10%
12How can a developer-tools company find out whether ChatGPT and Claude recommend it when developers ask which tool to use?4/42.0619%19%
12Is there an AI visibility tool with an MCP server, so I can ask about our results from Claude Code?2/22.0458%64%
13Can I test the same buyer questions against several AI models and compare the answers?4/41.5621%22%
14How can I automatically ask ChatGPT and Claude the same set of questions every week and track how their answers about my category change?2/22.0411%14%
14Which AI visibility tools are open source under a permissive license like MIT, so we can modify them?2/21.5347%57%
15How do we find out whether coding assistants recommend our library or API when developers ask how to do something?2/21.5325%33%
16How do engineering-led companies measure whether LLMs recommend their product, without a marketing tool?2/21.5316%17%
17What's the cheapest way to track our brand in AI answers ourselves instead of paying for a SaaS subscription?2/22.5513%15%
1. Are there open-source tools for measuring AI search visibility? — 5 queries

Added: brand ×5 geo ×4 github ×4 llm ×4 open ×4 source ×4 tracker ×4 tracking ×3

Dropped: measuring ×5 open-source ×4 tools ×2 ai ×1 search ×1

2. Is there an open-source alternative to Profound or Peec AI? — 6 queries

Added: github ×5 open ×5 source ×5 visibility ×5 geo ×4 search ×3 tracking ×3 monitoring ×2

Dropped: open-source ×5 alternative ×2 peec ×2 profound ×2 ai ×1

3. We want to track AI answer visibility without sending our data to another SaaS vendor. What are our options? — 6 queries

Added: brand ×6 open ×6 source ×6 geo ×4 github ×4 llm ×4 search ×3 tracking ×3

Dropped: another ×6 data ×6 options ×6 saas ×6 sending ×6 track ×6 vendor ×6 without ×6

4. Should we build our own AI visibility tracker on the OpenAI and Anthropic APIs, or buy a tool? — 9 queries

Added: tracking ×8 api ×6 pricing ×6 search ×4 web ×4 chatgpt ×3 monitoring ×3 responses ×3

Dropped: anthropic ×9 apis ×9 build ×9 buy ×9 openai ×9 tracker ×9 tool ×4 ai ×3

5. Is there a self-hosted AI visibility tracker I can run in Docker? — 8 queries

Added: open ×7 source ×7 brand ×6 github ×4 llm ×4 geo ×3 chatgpt ×2 engine ×2

Dropped: run ×9 ai ×4 self-hosted ×4 tracker ×4 docker ×2 visibility ×2

6. Can we run an AI search visibility tracker on our own Kubernetes cluster? — 6 queries

Added: github ×5 open ×5 source ×5 brand ×4 docker ×4 geo ×4 hosted ×3 self ×3

Dropped: cluster ×7 run ×7 kubernetes ×4 search ×3 ai ×1 tracker ×1 visibility ×1

7. Which AI visibility tools let us use our own OpenAI and Anthropic API keys? — 10 queries

Added: brand ×5 bring ×5 tracking ×5 byok ×4 geo ×3 llm ×3 chatgpt ×2 claude ×2

Dropped: let ×10 tools ×6 anthropic ×4 openai ×4 ai ×3 visibility ×3 api ×2

7. Can I check what ChatGPT and Claude recommend in my category using my existing subscriptions instead of paying for API calls? — 4 queries

Added: automated ×2 brand ×2 site.anthropic.com ×2 site.openai.com ×2 visibility ×2 access ×1 ai ×1 answers ×1

Dropped: calls ×4 category ×4 check ×4 existing ×4 paying ×4 recommend ×4 instead ×3 claude ×2

8. How much does it cost in API fees to run our own AI visibility checks every day, and how do we cap it? — 13 queries

Added: pricing ×10 search ×9 web ×8 2026 ×7 per ×6 1000 ×5 gemini ×4 google ×4

Dropped: ai ×13 cap ×13 checks ×13 day ×13 much ×13 run ×13 visibility ×13 cost ×12

9. Can I run AI visibility checks from the command line or in a CI pipeline? — 6 queries

Added: api ×4 cli ×4 actions ×3 brand ×3 geo ×3 github ×3 search ×3 2026 ×2

Dropped: checks ×6 run ×6 ci ×3 command ×3 line ×3 pipeline ×3

10. We want every raw AI answer and citation behind an AI visibility score, not just a dashboard. Which tools give us that? — 15 queries

Added: api ×14 export ×11 responses ×10 scrunch ×6 endpoint ×5 docs ×4 platform ×4 response ×4

Dropped: behind ×15 dashboard ×15 give ×15 score ×15 tools ×13 answer ×9 visibility ×9 ai ×5

10. Is there an AI visibility tool that keeps the tracked questions in a git repository, so changes go through code review? — 8 queries

Added: prompts ×7 tracking ×4 geo ×2 git-native ×2 github ×2 monitoring ×2 pull ×2 reddit.com ×2

Dropped: changes ×8 go ×8 keeps ×8 through ×8 tracked ×8 repository ×5 tool ×5 questions ×4

11. What's a good open-source way for a developer-tools startup to check whether AI assistants recommend it over alternatives? — 7 queries

Added: open ×6 source ×6 brand ×4 geo ×4 github ×4 llm ×4 tool ×4 tracking ×4

Dropped: assistants ×7 developer-tools ×7 over ×7 startup ×7 what's ×7 whether ×7 alternatives ×6 check ×6

12. How can a developer-tools company find out whether ChatGPT and Claude recommend it when developers ask which tool to use? — 6 queries

Added: tracking ×6 brand ×5 visibility ×4 ai ×3 monitoring ×3 recommendations ×3 search ×3 site.peec.ai ×3

Dropped: ask ×8 company ×8 developer-tools ×8 find ×8 out ×8 recommend ×8 whether ×8 developers ×6

12. Is there an AI visibility tool with an MCP server, so I can ask about our results from Claude Code? — 4 queries

Added: scrunch ×2 2026 ×1 brand ×1 chatgpt ×1 docs ×1 geo ×1 mentions ×1 search ×1

Dropped: ask ×4 results ×4 tool ×2 claude ×1 code ×1 visibility ×1

13. Can I test the same buyer questions against several AI models and compare the answers? — 6 queries

Added: 2026 ×3 prompts ×3 brand ×2 chat ×2 chatgpt ×2 claude ×2 evaluation ×2 gemini ×2

Dropped: against ×6 buyer ×6 questions ×6 several ×6 test ×6 answers ×5 ai ×4 models ×3

14. How can I automatically ask ChatGPT and Claude the same set of questions every week and track how their answers about my category change? — 4 queries

Added: tracking ×3 ai ×2 anthropic ×2 brand ×2 openai ×2 pricing ×2 prompts ×2 weekly ×2

Dropped: ask ×4 automatically ×4 category ×4 change ×4 questions ×4 set ×4 track ×4 week ×4

14. Which AI visibility tools are open source under a permissive license like MIT, so we can modify them? — 3 queries

Added: brand ×2 geo ×2 github ×2 monitoring ×2 tracker ×2 apache ×1 chatgpt ×1 engine ×1

Dropped: modify ×3 permissive ×3 under ×3 ai ×1 license ×1 mit ×1 tools ×1

15. How do we find out whether coding assistants recommend our library or API when developers ask how to do something? — 3 queries

Added: visibility ×3 2026 ×2 ai ×2 brand ×2 tools ×2 agent ×1 chatgpt ×1 claude ×1

Dropped: ask ×3 find ×3 out ×3 something ×3 developers ×2 recommend ×2 whether ×2 api ×1

16. How do engineering-led companies measure whether LLMs recommend their product, without a marketing tool? — 3 queries

Added: api ×2 open ×2 source ×2 2026 ×1 ai ×1 brand ×1 citations ×1 diy ×1

Dropped: companies ×3 engineering-led ×3 marketing ×3 tool ×3 whether ×3 without ×3 measure ×2 product ×2

17. What's the cheapest way to track our brand in AI answers ourselves instead of paying for a SaaS subscription? — 5 queries

Added: api ×3 chatgpt ×3 free ×2 llm ×2 mentions ×2 pricing ×2 responses ×2 script ×2

Dropped: cheapest ×5 instead ×5 ourselves ×5 paying ×5 saas ×5 subscription ×5 what's ×5 answers ×4