tokens&
For enterprises
Submit
Sign in
tokens&

Build better AI stacks, claim useful opportunities, and give AI infrastructure companies a source-labeled adoption readout they can trust.

For buildersFor enterprises

Product

  • Startup credits and perks
  • Agent Skills
  • Submit project, tool, product, or perk

Enterprise

  • Start free company workspace

Community

  • Community
  • Newsletter
  • Events
Xin

© 2026 tokensand, LLC. All rights reserved.

  • Terms
  • Privacy
  • Security
  • Data Processing
  • Status
  1. Home
  2. Best Tools
  3. Best AI Observability Tools

Best AI Observability Tools

Monitor and debug your AI applications with the best observability platforms.

Langfuse logo
Langfuse

Observability· langfuse.com

Freemium

Open-source LLM engineering platform for tracing, evals, prompt management, and metrics so teams can debug and improve production AI applications.

34,515

Frequently Asked Questions

What are the best ai observability tools?

tokens& tracks ai observability tools with product fit, docs, pricing, alternatives, open source status, public proof, and adoption evidence where available.

How do we rank ai observability tools?

Catalog ordering uses available stars, reviews, benchmarks, funding, featured status, saves, adoption-event counts, and product metadata. Those event counts do not establish verified adoption or retention. AgentRank is a separate ranking with its own published methodology. Sponsored suggestions, when present, are labeled.

For adoption evidence, see AgentRank rankings and the published methodology.

Open source
MLflow logo
MLflow

Observability· mlflow.org

Open source

MLflow is an open-source AI engineering platform with GenAI evaluation, tracing, monitoring, and optimization workflows for agents, LLM apps, and models.

26,852
Open source
Promptfoo logo
Promptfoo

Observability· promptfoo.dev

Open source

Open-source testing, red-teaming, and evaluation framework for prompts, RAG, and agents.

22,625
Open source
Opik logo
Opik

Observability· comet.com

Open source

Open-source LLM observability and evaluation platform from Comet for tracing, prompt management, testing, and agent optimization.

19,688
Open source
Portkey logo
Portkey

Observability· portkey.ai

Freemium

AI gateway and observability layer for routing, guardrails, caching, logging, and spend control across LLM providers behind one API.

12,975
Open source
Ragas logo
Ragas

Observability· ragas.io

Open source

Evaluation framework for testing RAG and LLM applications with metrics, synthetic test data, and CI-friendly quality checks.

14,555
Open source
DeepEval logo
DeepEval

Observability· deepeval.com

Open source

Open-source evaluation framework for testing LLM apps, agents, RAG systems, and prompts with repeatable metrics, regression checks, and CI-friendly workflows.

16,317
Open source
OpenPipe ART logo
OpenPipe ART

Observability· art.openpipe.ai

Open source

Agent Reinforcement Trainer for improving LLM agent reliability with GRPO-based reinforcement learning workflows.

10,353
Open source
Helicone logo
Helicone

Observability· helicone.ai

Freemium

Open-source AI gateway and LLM observability platform for logging, tracing, routing, evaluation, caching, and cost monitoring across model providers and agent stacks.

6,152
Open source
TensorZero logo
TensorZero

Observability· tensorzero.com

Open source

Open-source LLM application stack for observability, evaluations, prompt optimization, and controlled model gateway workflows.

11,673
Open source
Phoenix logo
Phoenix

Observability· arize.com

Open source

Open source AI observability and evaluation platform for tracing LLM applications, running evals, and debugging agent behavior with OpenTelemetry.

10,176
Open source
Evidently logo
Evidently

Observability· evidentlyai.com

Freemium

Open-source observability and evaluation framework for monitoring ML and LLM applications with tests and metrics.

7,650
Open source
Giskard logo
Giskard

Observability· giskard.ai

Freemium

Open-source evaluation and testing library for LLM agents, RAG systems, and AI risk checks.

5,476
Open source
AgentOps logo
AgentOps

Observability· agentops.ai

Freemium

Developer platform for tracing, debugging, and deploying AI agents with SDK-based observability, session replay, and framework integrations.

5,639
Open source
LangWatch logo
LangWatch

Observability· langwatch.ai

Freemium

The complete LLMOps platform for agent testing, evaluations, prompt management, and production observability across AI applications.

3,533
Open source
Kiln logo
Kiln

Observability· kiln.tech

Open source

Open-source AI engineering workbench for model evaluation, dataset curation, fine-tuning, and app reliability workflows.

4,937
Open source
TruLens logo
TruLens

Observability· trulens.org

Open source

Open-source evaluation and tracking toolkit for measuring LLM app quality, feedback functions, and RAG behavior.

3,400
Open source
Traceloop OpenLLMetry logo
Traceloop OpenLLMetry

Observability· traceloop.com

Open source

OpenTelemetry-based open-source instrumentation for tracing, monitoring, and debugging LLM applications across frameworks and providers.

7,240
Open source
Guardrails AI logo
Guardrails AI

Observability· guardrailsai.com

Freemium

LLM validation and guardrail framework for checking structured outputs, policy compliance, and production AI failure modes before release.

7,081
Open source
Pydantic Logfire logo
Pydantic Logfire

Observability· logfire-us.pydantic.dev

Freemium

Observability platform for production Python, LLM, and agent systems from the Pydantic team.

4,350
Open source
Laminar logo
Laminar

Observability· laminar.sh

Freemium

Open-source observability, tracing, and evaluation platform built for AI agents.

3,039
Open source
OpenLIT logo
OpenLIT

Observability· openlit.io

Freemium

OpenTelemetry-native AI engineering platform for LLM observability, evaluations, guardrails, and prompt operations.

2,562
Open source
MCPJam Inspector logo
MCPJam Inspector

Observability· mcpjam.com

Freemium

Testing and debugging workbench for MCP servers, MCP apps, and ChatGPT apps.

2,034
Open source
Future AGI logo
Future AGI

Observability· futureagi.com

Freemium

Open-source agent engineering platform that combines evaluations, observability, experiments, and guardrails so teams can ship and improve production AI agents faster.

1,192
Open source
Snyk Agent Scan logo
Snyk Agent Scan

Observability· github.com

Open source

Open-source Snyk scanner for AI agents, MCP servers, and agent skills that detects prompt injection, tool poisoning, toxic flows, and agent supply-chain risks.

2,764
Open source
OpenInference logo
OpenInference

Observability· arize-ai.github.io

Open source

OpenTelemetry semantic conventions and instrumentation packages for tracing LLM calls, agent steps, tool use, and retrieval workloads.

1,050
Open source
Inspect AI logo
Inspect AI

Observability· inspect.aisi.org.uk

Open source

Framework for large language model evaluations, task definitions, solvers, scoring, and reproducible eval runs.

2,296
Open source
AgentAcct logo
AgentAcct

Observability· github.com

Open source

Local-first work-intelligence dashboard for coding agents that attributes tokens, estimated cost, tasks, and verified evidence from local session logs.

424
Open source
Weights & Biases Weave logo
Weights & Biases Weave

Observability· wandb.ai

Open source

LLM observability and evaluation toolkit for tracing, debugging, and improving production agents and AI applications.

1,102
Open source
Scorable by Root Signals logo
Scorable by Root Signals

Observability· scorable.ai

Freemium

LLM and agent evaluation platform with reusable scorers, test datasets, and SDKs for measuring production AI behavior.

14
Open source
Braintrust logo
Braintrust

Observability· braintrustdata.com

Freemium

AI observability and evals platform for tracing production systems, running experiments, and catching regressions.

21
API available
BoundFlow logo
BoundFlow

Observability· boundflow.github.io

Open source

Open-source control plane for governed AI agent execution with lifecycle policies, approvals, durable runs, audit receipts, and observability.

5
Open source
mcpsnoop logo
mcpsnoop

Observability· github.com

Open source

Transparent MCP proxy and terminal inspector for observing tool calls, payloads, latency, and failures between clients and servers.

267
Open source
AnomalyArmor logo
AnomalyArmor

Observability· anomalyarmor.ai

Freemium

Data observability platform with hosted and local MCP access for alerts, freshness, schema drift, lineage, and quality checks.

1
Open source
Auralogs logo
Auralogs

Observability· auralogs.ai

Freemium

Agent-focused observability platform that exposes structured production logs and AI analyses to Codex, Claude, Cursor, and other clients through read-only MCP.

Open source
Alluvia logo
Alluvia

Observability· github.com

Open source

Local-first CLI that mines Claude Code, Cursor, and ChatGPT histories into searchable engineering insights without uploading conversations.

2
Open source