Ranked by AgentRank — adoption proof, trust evidence, and protocol readiness
This tool leads the category but has not been claimed by its maker.
Claim this tool to see who is evaluating it| # | Tool | AgentRank | Trust | Verified / signal | Velocity | Protocols |
|---|---|---|---|---|---|---|
| Phoenix | 51 | 47 | ★ 12k | — | API, SDK | |
| Portkey | 51 | 47 | ★ 13k | — | API, SDK | |
| Opik | 51 | 47 | ★ 23k | — | API, SDK | |
| TensorZero | 51 | 47 | ★ 12k | — | API, SDK | |
| Giskard | 51 | 47 | ★ 5.9k | +69 ★/30d | API, SDK | |
| Guardrails AI | 51 | 47 | ★ 7.6k | +89 ★/30d | API, SDK | |
| Evidently | 51 | 47 | ★ 8k | +76 ★/30d | API, SDK | |
| Pydantic Logfire | 51 | 47 | ★ 4.5k | +30 ★/30d | API, SDK | |
| OpenLIT | 51 | 47 | ★ 2.9k | +80 ★/30d | API, SDK | |
| MLflow | 51 | 47 | ★ 29k | +416 ★/30d | API, SDK | |
| Helicone | 51 | 47 | ★ 6.3k | +67 ★/30d | API, SDK | |
| Ragas | 51 | 47 | ★ 16k | +305 ★/30d | API, SDK | |
| Inspect AI | 51 | 47 | ★ 3.2k | +244 ★/30d | API, SDK | |
| Langfuse | 51 | 47 | ★ 37k | — | API, SDK | |
| Promptfoo | 51 | 47 | ★ 27k | — | API, SDK | |
| Traceloop OpenLLMetry | 51 | 47 | ★ 7.5k | +46 ★/30d | API, SDK | |
| OpenPipe ART | 51 | 47 | ★ 11k | +59 ★/30d | API, SDK | |
| AgentOps | 50 | 47 | ★ 5.9k | — | API, SDK | |
| Kiln | 50 | 47 | ★ 5.3k | — | API, SDK | |
| LangWatch | 50 | 47 | ★ 5k | — | API, SDK |
Observability· langfuse.com
Open-source LLM engineering platform for tracing, evals, prompt management, and metrics so teams can debug and improve production AI applications.
Observability· mlflow.org
MLflow is an open-source AI engineering platform with GenAI evaluation, tracing, monitoring, and optimization workflows for agents, LLM apps, and models.
Observability· promptfoo.dev
Open-source testing, red-teaming, and evaluation framework for prompts, RAG, and agents.
Observability· comet.com
Open-source LLM observability and evaluation platform from Comet for tracing, prompt management, testing, and agent optimization.
Observability· evidentlyai.com
Open-source observability and evaluation framework for monitoring ML and LLM applications with tests and metrics.
Observability· guardrailsai.com
LLM validation and guardrail framework for checking structured outputs, policy compliance, and production AI failure modes before release.
Observability· giskard.ai
Open-source evaluation and testing library for LLM agents, RAG systems, and AI risk checks.
Observability· ragas.io
Evaluation framework for testing RAG and LLM applications with metrics, synthetic test data, and CI-friendly quality checks.
Observability· portkey.ai
AI gateway and observability layer for routing, guardrails, caching, logging, and spend control across LLM providers behind one API.
Observability· art.openpipe.ai
Agent Reinforcement Trainer for improving LLM agent reliability with GRPO-based reinforcement learning workflows.
Observability· arize.com
Open source AI observability and evaluation platform for tracing LLM applications, running evals, and debugging agent behavior with OpenTelemetry.
Observability· helicone.ai
Open-source AI gateway and LLM observability platform for logging, tracing, routing, evaluation, caching, and cost monitoring across model providers and agent stacks.
Observability· deepeval.com
Open-source evaluation framework for testing LLM apps, agents, RAG systems, and prompts with repeatable metrics, regression checks, and CI-friendly workflows.
Observability· inspect.aisi.org.uk
Framework for large language model evaluations, task definitions, solvers, scoring, and reproducible eval runs.
Observability· tensorzero.com
Open-source LLM application stack for observability, evaluations, prompt optimization, and controlled model gateway workflows.
Observability· openlit.io
OpenTelemetry-native AI engineering platform for LLM observability, evaluations, guardrails, and prompt operations.
Observability· agentops.ai
Developer platform for tracing, debugging, and deploying AI agents with SDK-based observability, session replay, and framework integrations.
Observability· traceloop.com
OpenTelemetry-based open-source instrumentation for tracing, monitoring, and debugging LLM applications across frameworks and providers.
Observability· logfire-us.pydantic.dev
Observability platform for production Python, LLM, and agent systems from the Pydantic team.
Observability· kiln.tech
Open-source AI engineering workbench for model evaluation, dataset curation, fine-tuning, and app reliability workflows.
Observability· langwatch.ai
The complete LLMOps platform for agent testing, evaluations, prompt management, and production observability across AI applications.
Observability· laminar.sh
Open-source observability, tracing, and evaluation platform built for AI agents.
Observability· trulens.org
Open-source evaluation and tracking toolkit for measuring LLM app quality, feedback functions, and RAG behavior.
Observability· futureagi.com
Open-source agent engineering platform that combines evaluations, observability, experiments, and guardrails so teams can ship and improve production AI agents faster.
Observability· mcpjam.com
Testing and debugging workbench for MCP servers, MCP apps, and ChatGPT apps.
Observability· github.com
Open-source Snyk scanner for AI agents, MCP servers, and agent skills that detects prompt injection, tool poisoning, toxic flows, and agent supply-chain risks.
Observability· arize-ai.github.io
OpenTelemetry semantic conventions and instrumentation packages for tracing LLM calls, agent steps, tool use, and retrieval workloads.
Observability· github.com
Local-first work-intelligence dashboard for coding agents that attributes tokens, estimated cost, tasks, and verified evidence from local session logs.
Observability· wandb.ai
LLM observability and evaluation toolkit for tracing, debugging, and improving production agents and AI applications.
Observability· auralogs.ai
Agent-focused observability platform that exposes structured production logs and AI analyses to Codex, Claude, Cursor, and other clients through read-only MCP.
Observability· scorable.ai
LLM and agent evaluation platform with reusable scorers, test datasets, and SDKs for measuring production AI behavior.
Observability· braintrustdata.com
AI observability and evals platform for tracing production systems, running experiments, and catching regressions.
Observability· boundflow.github.io
Open-source control plane for governed AI agent execution with lifecycle policies, approvals, durable runs, audit receipts, and observability.
Observability· anomalyarmor.ai
Data observability platform with hosted and local MCP access for alerts, freshness, schema drift, lineage, and quality checks.
Observability· github.com
Transparent MCP proxy and terminal inspector for observing tool calls, payloads, latency, and failures between clients and servers.
Observability· github.com
Local-first CLI that mines Claude Code, Cursor, and ChatGPT histories into searchable engineering insights without uploading conversations.
Head-to-head comparisons and adoption evidence for the products ranked above.