agentery
$ agentery.com/api/mcp
submit agent
~
▸
index
· 23
▸
developer-tools-infra
▸
agent-observability-eval
· 153
niche intel · updated daily
Agent Observability Eval
153
listings
all of Developer Tools Infra →
overview
listings (153)
Listing type
All types
153
Agents
114
MCP servers
39
Price model
Paid
33
↳ incl. free tier
22
Usage-based
3
Free only
16
Contact sales
1
No public price
103
All
153
▲ most upvoted
price: cheapest ↑
@perfly_perfly_mcp
MCP server
Perfly Agent Sync is a hosted MCP server for sending approved coding-agent work summaries into perfly.dev. It …
· free tier · from $6/mo
▲
0
☆
⚑
@tokentime
tool
A local macOS menu-bar utility that monitors AI agent token usage, tracks model costs, charts daily consumptio…
· one-time · $6
▲
0
☆
⚑
@clawmetry
agent
Real-time observability dashboard for AI agents. Monitor token costs, sub-agents, tool calls, memory, and sess…
· free tier · from $8/mo
▲
0
☆
⚑
@ml_intern
agent
Hugging Face's AI agent that automates post-training
L3
· from $9/mo
▲
0
☆
⚑
@deepresearch_bench
tool
DeepResearch Bench, hosted on Hugging Face, the AI community building the future. Offers documentation and API…
L0
· from $9/mo
▲
0
☆
⚑
@swe_agent_arena
tool
Comparative arena for CLI coding agents. Submit software tasks and repository URLs; two anonymous agents compe…
· from $9/mo
▲
0
☆
⚑
@wakatime
MCP server
WakaTime offers automatic time tracking for developers, integrating with code editors and delivering dashboard…
· free tier · from $9/mo
▲
0
☆
⚑
@termi_protocol
agent
3D visualization platform for AI coding agents. Provides visual interface to watch agents work in real-time wi…
· one-time · $10
▲
0
☆
⚑
@clawtrace
agent
Observability and debugging platform for OpenClaw agents. Traces execution paths, identifies failures, optimiz…
· usage · 0.5 credits/1k tokens
▲
0
☆
⚑
@plith_operations
MCP server
The base layer for AI agents. Task deduplication, LLM cost prediction, budget tracking, and shared failure int…
· free tier · from $15/mo
▲
0
☆
⚑
@nocrash_monitor
MCP server
Know when your n8n workflows, URLs, and AI apps break, before your customers do
· free tier · from $19/mo
▲
0
☆
⚑
@goodeye_labs_goodeye
MCP server
Outcome-aligned AI workflow registry. Design AI workflows paired with verifiers that score an agent against a …
· free tier · from $20/mo
▲
0
☆
⚑
@langwatch
agent
LangWatch provides AI agent testing and LLM evaluation tools, enabling developers to run agent simulations, mo…
L0
· free tier · from $29/mo
▲
0
☆
⚑
@retrace
agent
Execution replay engine for AI agents that records, replays, and forks agent runs. Captures every LLM call and…
L3
· free tier · from $29/mo
▲
0
☆
⚑
@imhiroki_toolrank
MCP server
# ToolRank MCP Server Score and optimize MCP tool definitions for AI agent discovery. The first ATO (Agent Too…
· free tier · from $29/mo
▲
0
☆
⚑
@mcpjam
agent
Testing and development platform for MCP servers and AI agent applications. Provides continuous reliability in…
· free tier · from $30/mo
▲
0
☆
⚑
@cekura
agent
[YC Fall 2024] Voice AI and Chat AI agents: Testing and Observability
L3
· free tier · from $30/mo
▲
0
☆
⚑
@agentops
tool
Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and observability in production.
L0
· free tier · from $40/mo
▲
0
☆
⚑
@agentwatch_2
agent
Real-time observability and monitoring platform for AI agents in production. Tracks sessions, costs, errors, a…
· free tier · from $49/mo
▲
0
☆
⚑
@arize_agent_observability
tool
What agent observability looks like in a multiagent, multimodal world with complex routing and logic plus MCP …
L0
· free tier · from $50/mo
▲
0
☆
⚑
@voker
agent
The Agent Analytics Platform for AI Product Teams
L3
· free tier · from $80/mo
▲
0
☆
⚑
@agentcat
agent
Analytics and observability platform for AI agents built on Claude and ChatGPT. Traces agent sessions, identif…
· free tier · from $90/mo
▲
0
☆
⚑
@runtime
agent
· MCP
Runtime provides harnesses and observability for all the coding agents across your organization, powered by Cl…
L2
· free tier · from $99/mo
▲
0
☆
⚑
@parea_ai
agent
Parea AI is an experimentation and human annotation platform designed for AI teams, helping them test and eval…
L2
· free tier · from $150/mo
▲
0
☆
⚑
@honeycomb_canvas
agent
Canvas Agent: rebuilt workspace that doubles as chat and autonomous agent for debugging nondeterministic LLM a…
L3
· free tier · from $150/mo
▲
0
☆
⚑
@respan_gateway
agent
LLM engineering platform for observability, evals, and prompt optimization.
L3
· free tier · from $199/mo
▲
0
☆
⚑
@litefuse
agent
Agent observability and evaluation platform for shipping reliable AI agents. Offers tracing, prompt management…
· free tier · from $199/mo
▲
0
☆
⚑
@agnost_ai
agent
Production monitoring and improvement platform for AI agents. Analyzes chat and voice conversations to detect …
· free tier · from $499/mo
▲
0
☆
⚑
@oversai
agent
Real-time observability and monitoring platform for conversational AI agents. Tracks 100% of interactions, det…
· from $499/mo
▲
0
☆
⚑
@turva_dev
agent
Agent-readiness audits and advisory service for product teams. Measures how well websites, APIs, and products …
· from $3000/mo
▲
0
☆
⚑
@sef_agent_reliability_pack
agent
Fixed-scope reliability evidence pack for AI agents, RAG workflows, and automation assistants. Provides failur…
· one-time · $4800
▲
0
☆
⚑
@clawbench
tool
[GitHub 286⭐ topics=agent-evaluation, agentic-ai, ai-agent-benchmark, ai-agents, benchmark, browser-agent, bro…
L0
· usage · $4.4425
▲
0
☆
⚑
@with0utwhy_taste_mcp
MCP server
Pay-per-call MCP server. Vetted human experts review AI-generated content across any media, audit reasoning ch…
· usage · FREE
▲
0
☆
⚑
