Best LLM Observability Tools in 2026
Facts read from the makers 29 Sept 2026 – 21 Oct 2026
W&B Weave leads this list of 26 (Club score 8.8, free plan). Opik is next (Club score 8.7, free plan), and Evidently AI is the next highest-placed with a free plan (Club score 8.7). When you monitor an LLM application, you may want to see how requests move through models, agents and retrieval, as well as how prompts and evaluations are managed. Compared on agent tracing, LLM tracing and retrieval tracing, the tools also differ in LLM evaluations, prompt management and token cost tracking. Deployment options and plan details can help narrow the choices. Evidently AI, W&B Weave and Opik are among the listed tools. Compare their stated capabilities with the signals you need to follow, and weigh free-plan availability and paid-from pricing against your requirements.
LLM Observability Tools: the Club's top 10
| Product | What it does | Club score | Start | Runs on | Facts checked |
|---|---|---|---|---|---|
| 1 W&B Weave | W&B Weave provides observability and continuous improvement tools for production AI agents. | 8.8 | Free plan | Windows · macOS · Linux · Web | 20 Oct 2026 |
| 2 Opik | Opik helps teams building applications or agents that call an LLM log agent actions and evaluate behavior across development, testing, and production. | 8.7 | Free plan | Windows · macOS · Linux · Web | 21 Oct 2026 |
| 3 Evidently AI | Evidently AI evaluates, tests, and monitors machine-learning models, LLMs, RAG applications, and AI agents. | 8.7 | Free plan | Windows · macOS · Linux · Web | 15 Oct 2026 |
| 4 LangSmith | LangSmith is a commercial platform for building, testing, deploying, monitoring, and improving AI agents. | 8.5 | Free plan | Windows · macOS · Linux · Web | 15 Oct 2026 |
| 5 Promptfoo | Promptfoo is a platform for building and evaluating AI applications. | 8.5 | Free plan | Windows · macOS · Linux · Web | 15 Oct 2026 |
| 6 OpenLIT | OpenLIT is an open-source platform for observing and managing LLM and agent work, built on OpenTelemetry. | 8.5 | Free plan | Windows · macOS · Linux · Web | 14 Oct 2026 |
| 7 LangWatch | LangWatch is an AI agent engineering platform for teams working to ship reliable agents to production. | 8.4 | Free plan | macOS · Linux · Web · API | 21 Oct 2026 |
| 8 Langfuse | Langfuse is an open-source platform for engineering teams that build AI agent applications. | 8.2 | Free plan | Linux · Web · API · Self-hosted | 15 Oct 2026 |
| 9 Lunary | Lunary is an AI platform for enterprise teams and developers building chatbots or other applications powered by large language models. | 8.0 | Free plan | Web · API · Self-hosted | 15 Oct 2026 |
| 10 AgentOps | AgentOps is a developer platform for building AI agents and LLM applications. | 8.0 | Free plan | Web · API · Self-hosted | 15 Oct 2026 |
Ranked by the Club score: how fast a newcomer can get going, from what each maker publishes.
- 1
8.8 Club scoreW&B Weave
W&B Weave provides observability and continuous improvement tools for production AI agents.
- Free plan
- Open source
- Windows · macOS · Linux · Web
- 2
8.7 Club scoreOpik
Opik helps teams building applications or agents that call an LLM log agent actions and evaluate behavior across development, testing, and production.
- Free plan
- Open source
- Windows · macOS · Linux · Web
- 3
8.7 Club scoreEvidently AI
Evidently AI evaluates, tests, and monitors machine-learning models, LLMs, RAG applications, and AI agents.
- Free plan
- Open source
- Windows · macOS · Linux · Web
- 4
8.5 Club scoreLangSmith
LangSmith is a commercial platform for building, testing, deploying, monitoring, and improving AI agents.
- Free plan
- Windows · macOS · Linux · Web
- 5
8.5 Club scorePromptfoo
Promptfoo is a platform for building and evaluating AI applications.
- Free plan
- Open source
- Windows · macOS · Linux · Web
- 6 8.5 Club score
OpenLIT
OpenLIT is an open-source platform for observing and managing LLM and agent work, built on OpenTelemetry.
- Free plan
- Open source
- Windows · macOS · Linux · Web
- 7
8.4 Club scoreLangWatch
LangWatch is an AI agent engineering platform for teams working to ship reliable agents to production.
- Free plan
- Open source
- macOS · Linux · Web · API
- 8
8.2 Club scoreLangfuse
Langfuse is an open-source platform for engineering teams that build AI agent applications.
- Free plan
- Open source
- Linux · Web · API · Self-hosted
- 9 8.0 Club score
Lunary
Lunary is an AI platform for enterprise teams and developers building chatbots or other applications powered by large language models.
- Free plan
- Open source
- Web · API · Self-hosted
- 10
8.0 Club scoreAgentOps
AgentOps is a developer platform for building AI agents and LLM applications.
- Free plan
- Open source
- Web · API · Self-hosted
- 11
8.0 Club scoreGiskard
Giskard provides tools for finding vulnerabilities in AI agents before they reach production.
- Free plan
- Open source
- Linux · Web · API · Self-hosted
- 12
7.8 Club scoreBraintrust
Braintrust is an active observability platform for teams that want to inspect AI agents in production and improve their quality.
- Free plan
- Web · API · Self-hosted
- 13
7.5 Club scoreGalileo
Galileo is an observability, evaluation, and guardrail platform for generative AI and agentic applications.
- Free plan
- Web · API · Self-hosted
- 14
7.5 Club scoreMaxim AI
Maxim AI is an evaluation and observability platform for teams building and operating AI agents.
- Free plan
- Web · API · Self-hosted
- 15 7.4 Club score
TruLens
TruLens is a free, open-source Python SDK for tracing and evaluating AI agents, RAG applications, MCP apps, and summarization systems.
- Free plan
- Open source
- API · Self-hosted
- 16
7.4 Club scoreHelicone
Helicone is a platform for routing, debugging and analyzing AI applications.
- Free plan
- Web · API · Self-hosted
- 17
7.4 Club scoreLaminar
Laminar is an open-source observability and debugging platform for AI agents built around OpenTelemetry.
- Free plan
- Web · API · Self-hosted
- 18 7.4 Club score
Respan (formerly Keywords AI)
Respan, formerly Keywords AI, is an AI gateway and observability platform for teams building and operating AI applications.
- Free plan
- Web · API · Self-hosted
- 19 7.3 Club score
Arize AX
Arize AX is a platform for improving AI agents by turning their production behavior into issues, investigations, evaluations and experiments.
- Free plan
- Web · API · Self-hosted
- 20
7.3 Club scoreFiddler AI
Fiddler AI provides observability and security for AI agents and predictive applications, covering development evaluation and production monitoring.
- Free plan
- Web · API · Self-hosted
- 21 7.2 Club score
Arize Phoenix
Arize Phoenix helps teams trace, evaluate, debug, and improve AI applications.
- Free plan
- Web · API · Self-hosted
- 22
7.2 Club scoreConfident AI
Confident AI is an AI Quality platform for evaluating development changes and monitoring applications in production.
- Free plan
- Web · API · Self-hosted
- 23
7.2 Club scoreHoneyHive
HoneyHive is an agent observability platform for teams that need to inspect, evaluate, and improve AI agents in production.
- Free plan
- Web · API · Self-hosted
- 24 7.2 Club score
OpenLLMetry
OpenLLMetry is a free, open-source project for monitoring and debugging LLM application execution.
- Free plan
- Web · API · Self-hosted
- 25 7.1 Club score
Parea AI
Parea AI is a platform for experiment tracking, observability, and human annotation for teams building LLM applications.
- Free plan
- Web · API · Self-hosted