Open-source and self-hosted AI visibility

plg self-hosted-ai-visibility · vdc10f641d03d7b50

Buyers who want to build rather than buy, or must keep their data in-house: developer-tools companies, technical founders, privacy-conscious and cost-conscious teams looking for open-source or self-hosted ways to track AI visibility. Competing for it: building it yourself on the model APIs, and SaaS trackers (Profound, Peec AI, Otterly.AI, Gauge). Cheap Seats' claim: MIT-licensed, one Docker container or a Helm chart, prompts kept in a git repo you own, your own API keys or Claude and ChatGPT subscriptions, a daily spend cap, and a CLI and MCP server alongside the web UI.

Prompts

Each prompt day by day (search track, recall): how many answers named Cheap Seats. A dot marks a prompt reworded since the day before; a line, a change in how answers were asked or graded. Named and recommended pool each prompt's answers over the last 14 days asked the same way, with a 95% interval (Wilson).

Pool over7 days 14 days 28 days

#	Prompt	Named 14d	Recommended 14d	10-23	10-22	10-21
1	Are there open-source tools for measuring AI search visibility? open-source-tools-measuring-ai	0% (0–66)	0% (0–66)	0/2	1/2	0/2
2	Is there an open-source alternative to Profound or Peec AI? open-source-alternative-profound-peec	0% (0–66)	0% (0–66)	0/2	0/2	0/2
3	We want to track AI answer visibility without sending our data to another SaaS vendor. What are our options? want-track-ai-answer-visibility	0% (0–66)	0% (0–66)	0/2	0/2	0/2
4	Should we build our own AI visibility tracker on the OpenAI and Anthropic APIs, or buy a tool? build-own-ai-visibility-tracker	0% (0–66)	0% (0–66)	0/2	0/2	0/2
5	Is there a self-hosted AI visibility tracker I can run in Docker? self-hosted-ai-visibility-docker	0% (0–66)	0% (0–66)	0/2	0/2	0/2
6	Can we run an AI search visibility tracker on our own Kubernetes cluster? ai-visibility-tracker-kubernetes	0% (0–66)	0% (0–66)	0/2	0/2	0/2
7	Which AI visibility tools let us use our own OpenAI and Anthropic API keys? ai-visibility-bring-own-api-keys	0% (0–66)	0% (0–66)	0/2	0/2	0/2
8	How much does it cost in API fees to run our own AI visibility checks every day, and how do we cap it? cost-run-own-ai-visibility-checks	0% (0–66)	0% (0–66)	0/2	0/2	0/2
9	Can I run AI visibility checks from the command line or in a CI pipeline? ai-visibility-cli-ci	0% (0–66)	0% (0–66)	0/2	1/2	0/2
10	We want every raw AI answer and citation behind an AI visibility score, not just a dashboard. Which tools give us that? raw-answers-citations-behind-score	0% (0–66)	0% (0–66)	0/2	0/2	0/2
11	What's a good open-source way for a developer-tools startup to check whether AI assistants recommend it over alternatives? devtools-startup-open-source-ai-visibility	0% (0–66)	0% (0–66)	0/2	0/2	0/2
12	Can I test the same buyer questions against several AI models and compare the answers? test-same-buyer-questions-against	0% (0–66)	0% (0–66)	0/2	0/2	0/2
13	How can I automatically ask ChatGPT and Claude the same set of questions every week and track how their answers about my category change? automate-weekly-ai-answer-checks	0% (0–66)	0% (0–66)	0/2	0/2
14	How do we find out whether coding assistants recommend our library or API when developers ask how to do something? coding-assistants-recommend-our-library	0% (0–66)	0% (0–66)	0/2	0/2
15	What's the cheapest way to track our brand in AI answers ourselves instead of paying for a SaaS subscription? cheapest-in-house-ai-visibility-tracking	0% (0–66)	0% (0–66)	0/2	0/2
	How can a developer-tools company find out whether ChatGPT and Claude recommend it when developers ask which tool to use? developer-tool-ai-recommends-it no longer asked	0% (0–49)	0% (0–49)		0/2	0/2
	How do engineering-led companies measure whether LLMs recommend their product, without a marketing tool? engineering-team-measure-llm-recommendations no longer asked	0% (0–66)	0% (0–66)		0/2
	Can I check what ChatGPT and Claude recommend in my category using my existing subscriptions instead of paying for API calls? ai-visibility-chatgpt-claude-subscription no longer asked	0% (0–66)	0% (0–66)			0/2
	Is there an AI visibility tool that keeps the tracked questions in a git repository, so changes go through code review? tracked-prompts-git-code-review no longer asked	0% (0–66)	0% (0–66)			0/2
	Is there an AI visibility tool with an MCP server, so I can ask about our results from Claude Code? ai-visibility-mcp-server-claude-code no longer asked	0% (0–66)	0% (0–66)			0/2
	Which AI visibility tools are open source under a permissive license like MIT, so we can modify them? permissive-license-ai-visibility-tool no longer asked	0% (0–66)	0% (0–66)			0/2

Competitors the grader folds onto

Answers that name one of these by an alias are counted under its name.

Profound also tryprofound, Profound AI
Peec AI also Peec, peec.ai
Otterly.AI also Otterly, OtterlyAI
Gauge also withgauge, withgauge.com
Dageno AI also Dageno, dageno.ai
AI Peekaboo also Peekaboo, aipeekaboo
Semrush AI Toolkit also Semrush
Ahrefs Brand Radar also Ahrefs
Frase also frase.io, Frase.io
Bad Popcorn also badpopcorn, badpopcorn.ai
Elmo also elmohq, elmohq.com, elmohq/elmo
Limelit Open also Limelit, limelit.co, limelit-co/open, limelitgeo/open

What the assistants searched, over the latest runs

Re-grade stored answers with today's grader, brand and competitors: see what it would cost first

Review the prompts: which ones are flat, noisy, off target or duplicates, and what no prompt asks (free; monthly is enough)

Runs

Run	Status	Named search	Recommended	Rank	Jev agrees	Trigger	Created
Open-source and self-hosted AI visibility 2026-10-23 16:40	done	0%	0%	–	100% (0 differ)	mcp	2026-10-23 16:40:15
Open-source and self-hosted AI visibility 2026-10-22 04:31	done	6%	0%	below 20	–	mcp	2026-10-22 04:31:02
Open-source and self-hosted AI visibility 2026-10-21 20:17	done	0%	0%	–	–	schedule	2026-10-21 20:17:23