A read-only copy of Cheap Seats measuring itself, updated hourly. Run your own.

What the assistants searched

Open-source and self-hosted AI visibility 2026-10-23 16:40 pooled with the set's finished runs before it that were asked and graded the same way: 1 run · search track only, from the stored answers · this run alone · JSON

30/30answers searched
62searches
62distinct queries
23%from prompt
32%prompt kept

Top queries

Queries counted together whatever their case, quotes or spacing. Cheap Seats's sites: searches whose results included a page on one of them. Competitors: named in a result's title, or its site. Named Cheap Seats: of the graded answers that ran the query, those that named Cheap Seats.

QueryPromptsAnswersCheap Seats's sitesCompetitors in resultsNamed Cheap Seats
'$10.00 / 1k'1510/10/1
AI search visibility API generative engine optimization tracking API open source 2026910/10/1
AI search visibility platform raw response data export CSV API 20261010/1Semrush AI Toolkit ×1 0/1
AI search visibility platform SaaS "own API keys" OpenAI Anthropic pricing brand mentions710/10/1
AI search visibility tools LLM brand mention tracking Profound Peec AI Otterly comparison 2026 +Otterly.AI +Peec AI +Profound1410/1Otterly.AI ×1 0/1
AI search visibility tracker self hosted Kubernetes open source monitoring | Otterly Peec AI self hosted Kubernetes +Otterly.AI +Peec AI610/1Elmo ×1 Otterly.AI ×1 Peec AI ×1 Profound ×1 0/1
"AI visibility" "BYOK" tools | "AI visibility" "own API keys" "Anthropic" -site:reddit.com710/1Elmo ×1 Peec AI ×1 Profound ×1 0/1
AI visibility LLM brand mentions CLI tool CI pipeline GitHub Action910/10/1
AI visibility monitoring "bring your own" "Anthropic" "OpenAI" | GEO tracking "own API keys" OpenAI Anthropic710/1Limelit Open ×1 Peec AI ×1 Profound ×1 0/1
AI visibility monitoring CLI CI pipeline API promptfoo Otterly Peec | AI search visibility CLI github actions Profound API +Otterly.AI +Peec AI +Profound910/1Otterly.AI ×1 Peec AI ×1 Profound ×1 0/1
AI visibility monitoring raw responses citations export API Peec AI Profound Otterly Scrunch | AI visibility tool every answer citations raw responses API export AthenaHQ +Otterly.AI +Peec AI +Profound1010/1Otterly.AI ×1 Peec AI ×1 Profound ×1 0/1
AI visibility tool bring your own API key OpenAI Anthropic LLM brand tracking710/10/1
AI visibility tool export raw LLM responses citations API (Profound, Peec AI, Scrunch, Otterly) +Otterly.AI +Peec AI +Profound1010/1Dageno AI ×1 Otterly.AI ×1 Peec AI ×1 Profound ×1 0/1
AI visibility tools track brand prompts across ChatGPT Perplexity Gemini Claude 20261210/1Frase ×1 0/1
AI visibility tracking tools 2026 pricing Profound Peec AI Otterly Semrush AI toolkit +Otterly.AI +Peec AI +Profound +Semrush AI Toolkit410/1Otterly.AI ×1 Peec AI ×1 Profound ×1 0/1
AI visibility tracking tools ChatGPT Claude brand mentions prompts 2026 Profound Peec AI Otterly +Otterly.AI +Peec AI +Profound1310/10/1
Anthropic Claude API pricing web search $10 per 1,000 searches Gemini grounding with Google Search pricing Perplexity Sonar API pricing810/10/1
API responses differ from ChatGPT UI answers AI visibility tracking accuracy scraping vs API410/1Otterly.AI ×1 0/1
best generative engine optimization monitoring tools comparison pricing 20261310/1Frase ×1 Profound ×1 0/1
canonry AEO github self-hosted ChatGPT Claude Gemini Perplexity citations1110/10/1
coding assistant brand visibility monitoring library API recommendations Profound Scrunch Peec | Promptfoo coding agent evaluation Claude Code Codex library recommendations +Peec AI +Profound1410/1Otterly.AI ×1 Peec AI ×1 Profound ×1 0/1
compare same prompt multiple LLMs side by side tool1210/10/1
DIY track brand mentions ChatGPT Perplexity Gemini API script cost 20261510/10/1
docs.tryprofound.com API raw responses export answers citations +Profound1010/10/1
GEO AEO brand monitoring "BYOK" OR "bring your own key" ChatGPT Claude visibility710/10/1
github open source generative engine optimization monitoring ChatGPT Perplexity brand visibility tool 2026310/10/1
'gpt-4.1-mini'810/10/1
lettertrace github docker compose self-host510/10/1
oneglanse github docker self-host GEO tracker510/10/1
open source AI search visibility tracker GEO LLM brand mentions GitHub110/10/1
open source AI search visibility tracker GitHub GEO monitoring | open source LLM brand visibility tracking tools GitHub110/1Ahrefs Brand Radar ×1 Peec AI ×1 Profound ×1 0/1
open source AI search visibility tracking tool alternative to Profound Peec AI GitHub210/1Elmo ×1 Peec AI ×1 Profound ×1 0/1
open source AI visibility monitoring GEO tracker competitors GitHub | GitHub open source llm brand recommendation monitoring Peec Otterly alternative +Otterly.AI +Peec AI1110/1Otterly.AI ×1 Peec AI ×1 Profound ×1 0/1
open source alternative Profound Peec AI AI search visibility tracking github210/1Elmo ×1 Peec AI ×1 Profound ×1 0/1
open source GEO generative engine optimization tracking tool self-hosted ChatGPT Perplexity brand monitoring510/10/1
open source LLM brand visibility tracker GitHub AI search mentions1510/10/1
open source LLM recommendation benchmark developer tools "which tool does ChatGPT recommend" CLI1110/10/1
open source self hosted AI search visibility tracking GEO monitoring Otterly alternative | self hosted AI visibility monitoring open source AI engines prompts brand tracking +Otterly.AI310/1Ahrefs Brand Radar ×1 Elmo ×1 Limelit Open ×1 Otterly.AI ×1 Peec AI ×1 Profound ×1 0/1
open source self-hosted AI search visibility tracker GEO LLM brand mentions310/1Elmo ×1 Limelit Open ×1 0/1
open source self-hosted AI search visibility tracker LLM brand mentions GitHub610/1Elmo ×1 Limelit Open ×1 0/1
open source self-hosted AI visibility tracker LLM brand mentions Docker GitHub510/10/1
open source tool track brand mentions in LLM answers AI visibility GEO github1110/10/1
open-source generative engine optimization tool track brand in ChatGPT Perplexity 2026110/10/1
open-source GEO generative engine optimization brand mention tracker ChatGPT Perplexity self-hosted210/10/1
OpenAI API pricing per million tokens web search tool call price 2026810/10/1
OpenAI API pricing web search tool cost GPT-5 mini | Gemini API pricing Google Search grounding free tier | AI brand monitoring open source self hosted Otterly alternative +Otterly.AI1510/1Elmo ×1 Otterly.AI ×1 Peec AI ×1 Profound ×1 0/1
Peec AI API docs chats endpoint raw response sources +Peec AI1010/1Peec AI ×1 0/1
Profound API docs answers endpoint response text citations +Profound1010/10/1
Profound prompt tracking ChatGPT Claude daily monitoring | Peec AI Claude ChatGPT tracking prompts | Otterly AI supported AI engines Claude ChatGPT | OpenAI API responses different ChatGPT Claude API web search +Otterly.AI +Peec AI +Profound1310/1Otterly.AI ×1 Peec AI ×1 Profound ×1 0/1
Scrunch AI API responses export raw citations1010/10/1

Showing the 50 run by the most answers; 12 more in the JSON.

Names the assistants added

Searches that named a product the prompt hadn't: the assistant added it to the search.

NameSearchesAnswersPromptsFor example
Peec AI15117“AI visibility tracking tools 2026 pricing Profound Peec AI Otterly Semrush AI toolkit”; “site.platform.openai.com docs web search API citations search ChatGPT | site.docs.anthropic.com web search tool API citations | AI visibility tracking Peec AI Otterly pricing Profound platforms”; “AI search visibility tracker self hosted Kubernetes open source monitoring | Otterly Peec AI self hosted Kubernetes”
Otterly.AI14129“open source self hosted AI search visibility tracking GEO monitoring Otterly alternative | self hosted AI visibility monitoring open source AI engines prompts brand tracking”; “AI visibility tracking tools 2026 pricing Profound Peec AI Otterly Semrush AI toolkit”; “site.platform.openai.com docs web search API citations search ChatGPT | site.docs.anthropic.com web search tool API citations | AI visibility tracking Peec AI Otterly pricing Profound platforms”
Profound1295“AI visibility tracking tools 2026 pricing Profound Peec AI Otterly Semrush AI toolkit”; “site.platform.openai.com docs web search API citations search ChatGPT | site.docs.anthropic.com web search tool API citations | AI visibility tracking Peec AI Otterly pricing Profound platforms”; “AI visibility monitoring CLI CI pipeline API promptfoo Otterly Peec | AI search visibility CLI github actions Profound API”
Elmo111“site.citemetrix.com "OpenAI" "Anthropic" | site.elmohq.com "Anthropic" "keys"”
Semrush AI Toolkit111“AI visibility tracking tools 2026 pricing Profound Peec AI Otterly Semrush AI toolkit”

How the prompts were rewritten

Words compared without stopwords, plurals folded. From prompt is the share of a search's words that were in its prompt; prompt kept, the share of the prompt's words still in the search.

Added

The vocabulary the assistants search with.

WordSearchesPrompts
brand2211
source209
open188
search1610
tracking1610
api165
llm1511
monitoring1511
tool1511
github158
chatgpt1411
mentions1311
20261210
geo127
visibility116
responses113
perplexity99
engine97
optimization87
pricing85
generative77
gemini75
prompts73
export72
claude65

Dropped

Prompt words the searches left out.

WordSearchesPrompts
ai2311
answer205
run164
visibility155
tools134
checks123
track103
behind91
dashboard91
give91
score91
open-source83
ask82
what's82
questions72
saas72
whether72
tracker63
recommend62
let61
assistants52
openai52
api43
alternative42
anthropic42

Add as prompt

Queries whose results named competitors and never reached Cheap Seats's sites. To measure one as a prompt of its own, paste its entry into the set's file in the config repo and reword it as the question a buyer would ask; prompt ids are permanent, so pick one you'll keep.

“AI search visibility platform raw response data export CSV API 2026” — 1 answers · Semrush AI Toolkit

Append to prompt-sets/self-hosted-ai-visibility.toml:

[[prompts]]
id = "ai-search-visibility-platform-raw"
text = "AI search visibility platform raw response data export CSV API 2026"
“AI search visibility tools LLM brand mention tracking Profound Peec AI Otterly comparison 2026” — 1 answers · Otterly.AI

Append to prompt-sets/self-hosted-ai-visibility.toml:

[[prompts]]
id = "ai-search-visibility-tools-llm"
text = "AI search visibility tools LLM brand mention tracking Profound Peec AI Otterly comparison 2026"
“AI search visibility tracker self hosted Kubernetes open source monitoring” — 1 answers · Elmo, Otterly.AI, Peec AI, Profound

Append to prompt-sets/self-hosted-ai-visibility.toml:

[[prompts]]
id = "ai-search-visibility-tracker-self"
text = "AI search visibility tracker self hosted Kubernetes open source monitoring"
“Otterly Peec AI self hosted Kubernetes” — 1 answers · Elmo, Otterly.AI, Peec AI, Profound

Append to prompt-sets/self-hosted-ai-visibility.toml:

[[prompts]]
id = "otterly-peec-ai-self-hosted"
text = "Otterly Peec AI self hosted Kubernetes"
“AI visibility monitoring CLI CI pipeline API promptfoo Otterly Peec” — 1 answers · Otterly.AI, Peec AI, Profound

Append to prompt-sets/self-hosted-ai-visibility.toml:

[[prompts]]
id = "ai-visibility-monitoring-cli-ci"
text = "AI visibility monitoring CLI CI pipeline API promptfoo Otterly Peec"
“AI search visibility CLI github actions Profound API” — 1 answers · Otterly.AI, Peec AI, Profound

Append to prompt-sets/self-hosted-ai-visibility.toml:

[[prompts]]
id = "ai-search-visibility-cli-github"
text = "AI search visibility CLI github actions Profound API"
“AI visibility monitoring raw responses citations export API Peec AI Profound Otterly Scrunch” — 1 answers · Otterly.AI, Peec AI, Profound

Append to prompt-sets/self-hosted-ai-visibility.toml:

[[prompts]]
id = "ai-visibility-monitoring-raw-responses"
text = "AI visibility monitoring raw responses citations export API Peec AI Profound Otterly Scrunch"
“AI visibility tool every answer citations raw responses API export AthenaHQ” — 1 answers · Otterly.AI, Peec AI, Profound

Append to prompt-sets/self-hosted-ai-visibility.toml:

[[prompts]]
id = "ai-visibility-tool-answer-citations"
text = "AI visibility tool every answer citations raw responses API export AthenaHQ"
“AI visibility tool export raw LLM responses citations API (Profound, Peec AI, Scrunch, Otterly)” — 1 answers · Dageno AI, Otterly.AI, Peec AI, Profound

Append to prompt-sets/self-hosted-ai-visibility.toml:

[[prompts]]
id = "ai-visibility-tool-export-raw"
text = "AI visibility tool export raw LLM responses citations API (Profound, Peec AI, Scrunch, Otterly)"
“AI visibility tools track brand prompts across ChatGPT Perplexity Gemini Claude 2026” — 1 answers · Frase

Append to prompt-sets/self-hosted-ai-visibility.toml:

[[prompts]]
id = "ai-visibility-tools-track-brand"
text = "AI visibility tools track brand prompts across ChatGPT Perplexity Gemini Claude 2026"

Prompt by prompt

#PromptSearchedSearches per answerDistinctFrom promptPrompt kept
1Are there open-source tools for measuring AI search visibility?2/21.5326%50%
2Is there an open-source alternative to Profound or Peec AI?2/21.5328%60%
3We want to track AI answer visibility without sending our data to another SaaS vendor. What are our options?2/21.5313%15%
4Should we build our own AI visibility tracker on the OpenAI and Anthropic APIs, or buy a tool?2/21.5321%30%
5Is there a self-hosted AI visibility tracker I can run in Docker?2/22.5529%43%
6Can we run an AI search visibility tracker on our own Kubernetes cluster?2/21.5329%48%
7Which AI visibility tools let us use our own OpenAI and Anthropic API keys?2/23.0653%62%
8How much does it cost in API fees to run our own AI visibility checks every day, and how do we cap it?2/22.045%8%
9Can I run AI visibility checks from the command line or in a CI pipeline?2/22.0426%38%
10We want every raw AI answer and citation behind an AI visibility score, not just a dashboard. Which tools give us that?2/24.5928%29%
11What's a good open-source way for a developer-tools startup to check whether AI assistants recommend it over alternatives?2/22.048%9%
12Can I test the same buyer questions against several AI models and compare the answers?2/21.5314%15%
13How can I automatically ask ChatGPT and Claude the same set of questions every week and track how their answers about my category change?2/22.047%9%
14How do we find out whether coding assistants recommend our library or API when developers ask how to do something?2/22.0427%36%
15What's the cheapest way to track our brand in AI answers ourselves instead of paying for a SaaS subscription?2/22.0412%14%
1. Are there open-source tools for measuring AI search visibility? — 3 queries

Added: brand ×3 geo ×2 github ×2 llm ×2 open ×2 source ×2 tracker ×2 2026 ×1

Dropped: measuring ×3 open-source ×2 ai ×1 search ×1 tools ×1 visibility ×1

2. Is there an open-source alternative to Profound or Peec AI? — 3 queries

Added: github ×2 open ×2 search ×2 source ×2 tracking ×2 visibility ×2 brand ×1 chatgpt ×1

Dropped: open-source ×2 ai ×1 alternative ×1 peec ×1 profound ×1

3. We want to track AI answer visibility without sending our data to another SaaS vendor. What are our options? — 3 queries

Added: brand ×3 open ×3 source ×3 geo ×2 monitoring ×2 search ×2 2026 ×1 alternative ×1

Dropped: another ×3 answer ×3 data ×3 options ×3 saas ×3 sending ×3 track ×3 vendor ×3

4. Should we build our own AI visibility tracker on the OpenAI and Anthropic APIs, or buy a tool? — 3 queries

Added: tracking ×3 api ×2 chatgpt ×2 pricing ×2 2026 ×1 accuracy ×1 answers ×1 citations ×1

Dropped: anthropic ×3 apis ×3 build ×3 buy ×3 openai ×3 tracker ×3 tool ×1

5. Is there a self-hosted AI visibility tracker I can run in Docker? — 5 queries

Added: brand ×3 github ×3 open ×3 source ×3 chatgpt ×2 geo ×2 self-host ×2 compose ×1

Dropped: run ×5 ai ×3 self-hosted ×3 visibility ×3 tracker ×2 docker ×1

6. Can we run an AI search visibility tracker on our own Kubernetes cluster? — 3 queries

Added: brand ×2 open ×2 self-hosted ×2 source ×2 chatgpt ×1 docker ×1 engine ×1 generative ×1

Dropped: cluster ×3 run ×3 kubernetes ×2 ai ×1 search ×1 tracker ×1

7. Which AI visibility tools let us use our own OpenAI and Anthropic API keys? — 6 queries

Added: brand ×3 bring ×3 byok ×2 geo ×2 monitoring ×2 tracking ×2 aeo ×1 chatgpt ×1

Dropped: let ×6 tools ×4 ai ×2 api ×2 openai ×2 anthropic ×1 visibility ×1

8. How much does it cost in API fees to run our own AI visibility checks every day, and how do we cap it? — 4 queries

Added: pricing ×3 search ×3 web ×3 gemini ×2 google ×2 grounding ×2 per ×2 sonar ×2

Dropped: ai ×4 cap ×4 checks ×4 cost ×4 day ×4 fees ×4 much ×4 run ×4

9. Can I run AI visibility checks from the command line or in a CI pipeline? — 4 queries

Added: api ×3 cli ×2 github ×2 llm ×2 mentions ×2 optimization ×2 search ×2 2026 ×1

Dropped: checks ×4 command ×4 line ×4 run ×4 ci ×2 pipeline ×2

10. We want every raw AI answer and citation behind an AI visibility score, not just a dashboard. Which tools give us that? — 9 queries

Added: api ×8 export ×6 responses ×5 response ×3 scrunch ×3 chats ×2 csv ×2 data ×2

Dropped: behind ×9 dashboard ×9 give ×9 score ×9 tools ×7 answer ×6 visibility ×6 ai ×4

11. What's a good open-source way for a developer-tools startup to check whether AI assistants recommend it over alternatives? — 4 queries

Added: github ×3 llm ×3 open ×3 source ×3 brand ×2 chatgpt ×2 geo ×2 recommendation ×2

Dropped: assistants ×4 check ×4 developer-tools ×4 open-source ×4 over ×4 startup ×4 what's ×4 whether ×4

12. Can I test the same buyer questions against several AI models and compare the answers? — 3 queries

Added: multiple ×2 prompts ×2 side ×2 2026 ×1 across ×1 brand ×1 chat ×1 chatgpt ×1

Dropped: against ×3 answers ×3 buyer ×3 questions ×3 several ×3 test ×3 ai ×2 models ×2

13. How can I automatically ask ChatGPT and Claude the same set of questions every week and track how their answers about my category change? — 4 queries

Added: 2026 ×2 daily ×2 monitoring ×2 openai ×2 prompts ×2 responses ×2 tools ×2 tracking ×2

Dropped: answers ×4 ask ×4 automatically ×4 category ×4 change ×4 questions ×4 set ×4 track ×4

14. How do we find out whether coding assistants recommend our library or API when developers ask how to do something? — 4 queries

Added: visibility ×4 2026 ×2 ai ×2 brand ×2 claude ×2 monitoring ×2 recommendations ×2 tools ×2

Dropped: ask ×4 find ×4 out ×4 something ×4 recommend ×3 whether ×3 developers ×2 api ×1

15. What's the cheapest way to track our brand in AI answers ourselves instead of paying for a SaaS subscription? — 4 queries

Added: api ×2 cost ×2 gemini ×2 mentions ×2 open ×2 search ×2 source ×2 10.00 ×1

Dropped: answers ×4 cheapest ×4 instead ×4 ourselves ×4 paying ×4 saas ×4 subscription ×4 what's ×4