Evaluation379 of 27,544 tools

Filed under Evaluation by what their own homepage shows, ranked by who uses them among those still maintained.

A tag is one of thirty-odd words from a closed list, chosen by the same reader from the same page as the line — never a keyword the vendor supplied.

Describe what you need

beta

A sentence or two about the job. We read it into the catalogue's own words, then ask about every tool that fits them.

Ranked by use

Price

What it doesAnalytics59 Agents37 Monitoring29 Security19 Compliance13 Chat assistant10

Figure and bar: visits/mo, estimate · year: online since

#1
Arena AI LLM operations
Ranks large language models on a public leaderboard built from crowdsourced blind side-by-side comparisons of their answers.
78.3k
Active
2023
#2
Arize LLM operations
Observes agent behavior, evaluates performance with evals, and suggests improvements through automated debugging.
27.2k
Active
From $50/mo
#3
neuroflash Marketing MCP · sign-in
Simulates target-audience reactions with digital twins built from survey data, and generates brand-voice copy and images for marketing teams.
18.9k
Active
From ≈ $47/mo
2018
#4
micro1 LLM operations
Supplies expert human training data, evaluations and reinforcement learning environments for labs training frontier AI models and agents.
15.4k
Active
Contact sales
#5
Braintrust LLM operations
Observability platform that traces agent execution, evaluates outputs, and discovers production patterns to improve quality.
13.7k
Active
From $249/mo
2022
#6
Hume EVI 2 Voice
Generates expressive speech from text and runs real-time voice conversations through APIs that detect and reproduce emotional tone.
11.4k
Active
From $3/mo
#7
Psychologie et Sérénité Health MCP · open
Offers online psychological self-tests, a personalised GPT chat assistant and CBT coaching sessions with a psychotherapist in Nantes.
9.8k
Active
From ≈ $101 per use
#8
Galileo LLM operations
Captures groundtruth data, builds and auto-tunes evaluations, and distills them into production guardrails for AI agents and RAG systems.
9.8k
Active
#9
Sentient Developer tools
Develops open-source tools for AI agents to reason, learn, and improve through benchmarking and evaluation.
9.5k
Active
Open source
#10
Alva Labs HR
Evaluates job candidates using structured assessments, psychometric tests, and interview tools to standardize hiring decisions.
3.9k
Active
Pay per use
2017
#11
Humanloop LLM operations
Humanloop has joined Anthropic and is sunsetting its platform.
3.6k
Maintained
#12
Cekura Voice
Tests, monitors, and improves voice and chat AI agents with benchmarking and production observability.
2.6k
Active
From $0.25 per use
2024
#13
Future AGI Agents MCP · sign-in
Runs simulated conversations against AI agents, scores their outputs for factuality and safety, and traces live calls to flag regressions.
2.4k
Active
#14
Qu Review Agents MCP · sign-in
Adds a three-reviewer panel inside ChatGPT that flags inaccuracies and gaps in an AI answer before you rely on it.
2.2k
Active
From $10/mo
#15
Patronus LLM operations
Generates simulated digital environments and benchmarks for training and evaluating AI agents.
1.7k
Active
Contact sales
#16
Userbrain Lifestyle MCP · sign-in
Records real people using a website, app or prototype while they think aloud, then summarises patterns and clips from the sessions with AI.
1.5k
Active
From $49/mo
2015
#17
Vioscale AI Developer tools MCP · sign-in
Ranks software tools by independent adoption metrics and sourced facts, weighted to your selection criteria.
1.4k
Active
Free
#18
ProveIt Hiring Innovations Inc.HR
Sends code review and system design assessments to engineering candidates, scores submissions against role-specific rubrics.
997
Active
#19
Secret Chat AI Productivity
Compares answers from multiple AI models side-by-side and highlights where they disagree.
869
Active
From $5 once
#20
EarningsWatcher Finance MCP · sign-in
Compares implied and realized option moves around earnings releases and backtests volatility trade structures against past earnings events.
648
Active
#21
Articos Marketing MCP · sign-in
Conducts synthetic user interviews to validate messaging, positioning, and product decisions in 30 minutes.
640
Active
From $79/mo
#22
Minds Marketing MCP · sign-in
Generates synthetic audiences from a brief and runs simulated surveys and A/B concept tests against them.
596
Active
2024
#23
Prefactor Agents
Evaluates and monitors AI agent runs in production, catching failures and enforcing policies at runtime.
550
Active
From $49/mo
2024
#24
Vect Security
Verifies factual claims in documents by checking against trusted sources and reports accuracy.
517
From $14.99/mo
#25
LangWatch LLM operations
Tests and evaluates AI agents through simulation, tracing, and scoring before production deployment.
452
Active
From ≈ $32/user/mo
#26
Rams MCP · open
Scores every UI change against 348 design rules and returns fix patches for coding agents to apply.
314
Active
From $33/mo
#27
Sourcey Developer tools MCP · open
Tests how AI agents can use vendors' software and publishes graded readiness reports and startup credit listings.
302
Active
#28
Conversational AI Fluency Assessment Productivity
Assesses professionals' ability to work effectively with AI through conversational evaluation across five skill dimensions.
248
Active
From $10 per use
2026
#29
OpenMark Analytics MCP · open
Benchmark and compare AI models on custom tasks with deterministic scoring.
234
Active
From $29/mo
#30
Empromptu AI
Builds production-ready AI features for regulated industries with accuracy monitoring and automatic model improvement.
164
Active
From $75/mo
2024
#31
Prelim HR MCP · sign-in
Runs short chat-based screening interviews on applicants' phones and scores their written answers against criteria for recruiters.
158
Active
From $49/mo
#32
Ecomhint Commerce MCP · sign-in
Audits ecommerce store pages from a shopper's path to checkout and ranks the fixes by priority.
132
Active
From $19 once
#33
SearchQ Knowledge
Routes questions to optimal AI models, fact-checks answers across multiple models, and synthesizes verified responses with configurable privacy levels.
130
Active
Free plan
#34
MCPJam Developer tools MCP · sign-in
Tests and debugs MCP servers across 16 AI clients locally and in CI/CD pipelines.
112
Active
From $24/mo
#35
Pengu.inc Security MCP · open
Autonomously red-teams AI agents and systems, discovering exploits and validating patches in isolated environments.
105
Active
From $99/mo
#36
Interview Signal HR
Listens to the recruiter's own call audio, scores candidate answers with checked quotes, and drafts the client candidate report.
100
Active
From $39/user/mo
#37
Explore Science Marketing MCP · sign-in
Reviews unpublished manuscripts for methodology gaps, checks references against their sources, and ranks target journals by fit.
100
Active
From $100/mo
2023
#38
Okareo Developer tools MCP · sign-in
Simulates real users to test voice and text agents, exposing edge cases before production.
91
Active
From $199/mo
#39
ScaleDojo Developer tools
Scores engineers' practice system designs, schemas, API specs and ML code in a browser sandbox.
84
Active
Free plan
#40
SCIRISK
Convenes independent expert panels to assess scientific evidence and deliver peer-reviewed findings on regulatory questions.
83
Active
2014
#41
GenAI List Agents MCP · sign-in
Compares which AI models run on which hardware with measured performance and context window data.
79
Active
#42
AgendaForge Knowledge MCP · open
Plans conference programmes, taking call-for-papers submissions through peer review scoring to a published multi-track agenda with clash checks.
78
Active
From $2,000 once
2026
#43
VeriCite Legal MCP · sign-in
Checks legal quotations against stored opinion text, reviews later treatment of cases, and assesses whether cited passages support a stated point.
77
#44
Scorecard LLM operations MCP · sign-in
Tests and evaluates AI agents against thousands of realistic scenarios to provide rapid feedback on performance.
76
Active
From $299/mo
2024
#45
AI Powered EB1A Eligibility Check Legal
Assesses EB1A visa eligibility by analyzing professional achievements against USCIS criteria.
65
Active
2024
#46
Black Swan Causal Labs Knowledge MCP · sign-in
Browser tools that draw causal diagrams, map study timing, and structure risk-of-bias assessments for real-world evidence studies.
61
Active
#47
FetchSandbox MCP Developer tools MCP · open
Runs deterministic tests for coding agents by verifying API integrations fail before fixes and pass after.
55
Active
From $200/mo
#48
Rival Agents
Compare outputs from hundreds of AI models side by side to evaluate performance.
52
Active

379Every tool here, by name

How we read a tool

No votes, no reviews, no vendor claims. Every week a crawler reads each tool's own site and a few public registries, and the words on the card are bands over what it read.

Use: visits to the site (estimated), installs from npm and PyPI, presence in Chrome's usage report.
Activity: the newest release on GitHub, npm or PyPI; the newest dated page on the site; open roles on a public jobs board.
Price: the vendor's own pricing page, read with the date. A figure is printed only when it is on that page.
The line and the use cases are written by us from the homepage, one tool at a time, and refused when they repeat the vendor's marketing.

How AI assistants read each site — the reading vendors ask us about — is on each tool's own visibility page.

How we read every tool → · By INITE Atlas Desk