AI evaluation apps
70 AI evaluation apps in one list: the established products, and every new one as it launches.
Updated
- Apps
- 70
- New
- +6
- Established
- 0
- Dead
- 3
New AI evaluation apps per month
15 apps launched in the last 12 months, by month.
70 AI evaluation apps in one list: the established products, and every new one as it launches.
Updated
15 apps launched in the last 12 months, by month.
“ai evaluation tool” is searched 390 times a month on Google worldwide. These are the 2 searches around it, in the US.
| Search | Per month, US | Cost per click |
|---|---|---|
| naic ai systems evaluation tool | 40 | $20.59 |
| naic ai evaluation tool | 30 | - |
Cost per click is what advertisers bid for one visit from that search. Figures from Oct 2026.
The apps we added to this market most recently.
| # | App | Added |
|---|---|---|
| 1 |  QAgent Automate AI agent quality testing. Score correctness, detect hallucinations against ground truth, verify policy adherence, and benchmark RAG before bad responses reach real customers. | |
| 2 |  NovaSynth by Noveum Simulate realistic callers at scale with custom personas, scenarios, interruptions, noise, accents, and network conditions. NovaSynth runs those calls against your voice agent, scores audio and transcripts across 30+ dimensions, and surfaces the failures and fixes that matter to your team. | |
| 3 | UN UnifyBench Compare language models with an experimental Overall ranking built from sourced benchmark comparisons and a fixed reference panel. Customize optional capability weights; missing performance stays unkn | |
| 4 | RE Revalvo Revalvo is a local-first workbench for prompt engineering and LLM evaluation. Run the same prompt against every model in parallel, score responses with 40 built-in evaluators, version prompts like code, and batch-test on datasets — before anything hits production. No account, no hosted database: your API keys stay in your browser. | |
| 5 |  Agnost AI Agnost AI analyzes conversations between users and your production AI agents and discovers: silent failures, agent behavior drift, hallucinations, user frustration, hidden feature requests, and churn signals. It groups them into recurring patterns, shows the exact users and conversations behind each insight, and turns them into evals and fixes. | |
| 6 |  AIO.GEO Protocol AI Search Readiness: measure structure, ship dry-run fix packs, rescore, seal with HMAC receipts. SEO tests if humans can find you on Google. AIO.GEO tests if AI agents can do business with you. | |
| 7 |  Prefactor We evaluate every step your agents take, live. Errors get caught as they happen. Not in a Slack thread at 1am on a Tuesday | |
| 8 |  100 Questions AI See whether AI includes your brand in answers across top providers | |
| 9 |  Tribunal of Ideas Watch dozens of AIs prosecute, defend, and judge your idea live | |
| 10 |  AgenticRank Tech Assessment for Agentic | |
| 11 |  BandCheck Writing — Task 1 and Task 2 essays graded across the four official IELTS criteria: Task Achievement, Coherence & Cohesion, Lexical Resource, and Grammatical Range & Accuracy. | |
| 12 |  IdeaRoast Find your startup idea's fatal flaw. |
Grouped by what each app says it does. 50 of 70 apps fit a group so far.
| Type | Apps | Share | Examples |
|---|---|---|---|
| Agent and model evaluation | 22 | 44.0% | AgenticRank, Agnost AI, aipwn |
| Hiring and skills assessment | 9 | 18.0% | Codei AI, Conversa, Cyberforce Headquarters |
| Idea and product validation | 8 | 16.0% | IdeaProof, IdeaRoast, Judgemyjpeg |
What we could detect on their websites.
| Framework | Apps | Share |
|---|---|---|
| Next.js | 32 | 82.1% |
Of 39 apps whose framework we could detect.
| Host | Apps | Share |
|---|---|---|
| Vercel | 26 | 96.3% |
Of 27 apps whose host we could detect.
How many of the 70 apps show a price, and how many sell to large companies.
| Measure | Apps | Share of 70 |
|---|---|---|
| Publish a pricing page | 22 | 31.4% |
AI evaluation platforms help teams test and compare AI systems so they behave reliably before and after launch. You bring prompts, datasets, and scenarios. The platform runs controlled experiments and reports what works, what fails, and why.
4 more types of AI evaluation apps with Starter.See plans
How many AI evaluation apps sell to large companies, and how they charge with Starter.See plans
The rest of the guide to AI evaluation apps with Starter.See plans
4 more answers about AI evaluation apps with Starter.See plans