agentery
$ agentery.com/api/mcpsubmit agent
← Back to search

Market around llm_evaluation_agent

An MCP-based agent for evaluating LLMs, AI agents, and prompts through natural-language configuration, synthetic dataset generation, multi-judge scoring, document-grounded tests, and PDF reporting.

Visit startups.aws.com ↗Pricing page ↗

Explore the market

Prices and medians update for the tier you select.

Compare at
Llm Evaluation Agent · Pro
No Pro plan
—
Pro-MCP server median
$16
across 2 priced MCP servers
vs Pro MCP servers
No comparison
Llm Evaluation Agent doesn't sell Pro
ⓘ Comparisons are same provider type (MCP server) and same buyer tier (Pro). Never across tiers.
Market density
19th pctile
3 competing vendors
Comparable listings · 30d
Flat
limited data · 0 priced comparables
Agents · Pro median
$50/mo
1 priced · $50–$50 mid 50%
MCP servers · Pro median
$16/mo
2 priced · $11.5–$20.5 mid 50%
Platforms · Pro median
$32/mo
6 priced · $29–$38 mid 50%

Agents cost 3.1× MCP servers at the Pro tier.

Price spectrum · Pro plans · 8 of 11 providers priced · log scale · $7 → $50/mo
Agents MCP servers Platforms◻ shaded = middle 50% · line = median (all types)Llm Evaluation Agent has no comparable Pro price — not plotted

Products in this market

Ranked by how closely each one matches Llm Evaluation Agent's job. Prices show each provider's Pro state; entry prices are labelled as such. Unpriced products still belong to the market.

MMCP servers20Ranked by relevance
llm_evaluation_agentthis listing
● MCP · relevance 100%
no public price
mentor_mcp_server
● MCP · relevance 77%
no public price
cucumberstudio_mcp
● MCP · relevance 75%
no public price
retriEVAL
● MCP · relevance 74%
no public price
ia-qa.com/mcp llm and RAG testing - Dev/QA toolbox
● MCP · relevance 74%
no public price
evalgate_mcp
● MCP · relevance 73%
no public price
mcp_prompts
● MCP · relevance 73%
no public price
Prompt Injection Scanner MCP - LLM Security Testing
● MCP · relevance 73%
$25/mo Pro
+56% vs Pro median
mcp_latex_server
● MCP · relevance 70%
no public price
DC
dcl_trust_oracle
● MCP · relevance 70%
no public price
ultimate_mcp_server
● MCP · relevance 70%
no public price
CouchLoop EQ
● MCP · relevance 70%
no public price
priorlabs_ai
● MCP · relevance 69%
no public price
getabrain
● MCP · relevance 69%
no public price
documentize_mcp
● MCP · relevance 69%
$7/mo Pro
-56% vs Pro median
Model Council
● MCP · relevance 69%
no public price
mirror_mcp
● MCP · relevance 69%
no public price
toolroute - Intelligent Automated LLM Routing
● MCP · relevance 68%
no public price
NU
numguard
● MCP · relevance 68%
no Pro plan
entry $10/mo
RAIL Score MCP Server
● MCP · relevance 68%
no public price
FFrameworks11Ranked by relevance
deepeval
● FRAMEWORK · relevance 83%
no public price
openjudge
● FRAMEWORK · relevance 80%
no public price
langwatch
● FRAMEWORK · relevance 76%
no Pro plan
entry $34/mo
Understudy
● FRAMEWORK · relevance 71%
no public price
Guardrails AI
● FRAMEWORK · relevance 70%
no public price
skillopt
● FRAMEWORK · relevance 69%
no public price
deep_research_ai_agent
● FRAMEWORK · relevance 69%
no public price
matrices
● FRAMEWORK · relevance 69%
no public price
EV
EvoAgentX
● FRAMEWORK · relevance 69%
no public price
niceeval
● FRAMEWORK · relevance 68%
no public price
openai_agents
● FRAMEWORK · relevance 68%
no public price
PPlatforms9Ranked by relevance
vasari
● PLATFORM · relevance 80%
no public price
comet_opik
● PLATFORM · relevance 78%
no public price
parea_ai
● PLATFORM · relevance 77%
no Pro plan
entry $150/mo
Orq.ai
● PLATFORM · relevance 74%
$35/mo Pro
+9% vs Pro median
promptlayer
● PLATFORM · relevance 70%
$49/mo Pro
+53% vs Pro median
agentsproof
● PLATFORM · relevance 69%
$24.17/mo Pro
-24% vs Pro median
agenta
● PLATFORM · relevance 69%
$29/mo Pro
-9% vs Pro median
langsmith
● PLATFORM · relevance 68%
$39/mo Pro
+22% vs Pro median
Agentic Evaluation Platform
● PLATFORM · relevance 68%
no public price
OOther6Ranked by relevance
contextspy
● OTHER · relevance 72%
no public price
skillgrade
● OTHER · relevance 71%
no public price
ARIS (Auto-Research-In-Sleep)
● OTHER · relevance 71%
no public price
agent_context_org_guides
● OTHER · relevance 69%
no public price
Anthropic
● OTHER · relevance 68%
no public price
github_harvardlillawskillshub_
● OTHER · relevance 68%
no public price
AAgents4Ranked by relevance
TinyCodeAgent
● AGENT · relevance 70%
$50/mo Pro
feedback_aide
● AGENT · relevance 69%
no public price
agent_opfor
● AGENT · relevance 68%
no public price
ctgt
● AGENT · relevance 68%
no public price

Market = the products most similar to this one by capability; prices are median / quartiles over its priced members, separated by provider type and buyer tier.