Skip to the content
Know your tech before you buy it. Makers: get listed from $49/mo
Developer Tools

Best LLM Observability Tools in 2026

Facts read from the makers 29 Sept 2026 – 21 Oct 2026

W&B Weave leads this list of 26 (Club score 8.8, free plan). Opik is next (Club score 8.7, free plan), and Evidently AI is the next highest-placed with a free plan (Club score 8.7). When you monitor an LLM application, you may want to see how requests move through models, agents and retrieval, as well as how prompts and evaluations are managed. Compared on agent tracing, LLM tracing and retrieval tracing, the tools also differ in LLM evaluations, prompt management and token cost tracking. Deployment options and plan details can help narrow the choices. Evidently AI, W&B Weave and Opik are among the listed tools. Compare their stated capabilities with the signals you need to follow, and weigh free-plan availability and paid-from pricing against your requirements.

LLM Observability Tools: the Club's top 10

ProductWhat it doesClub scoreStartRuns onFacts checked
1 W&B WeaveW&B Weave provides observability and continuous improvement tools for production AI agents.8.8Free planWindows · macOS · Linux · Web20 Oct 2026
2 OpikOpik helps teams building applications or agents that call an LLM log agent actions and evaluate behavior across development, testing, and production.8.7Free planWindows · macOS · Linux · Web21 Oct 2026
3 Evidently AIEvidently AI evaluates, tests, and monitors machine-learning models, LLMs, RAG applications, and AI agents.8.7Free planWindows · macOS · Linux · Web15 Oct 2026
4 LangSmithLangSmith is a commercial platform for building, testing, deploying, monitoring, and improving AI agents.8.5Free planWindows · macOS · Linux · Web15 Oct 2026
5 PromptfooPromptfoo is a platform for building and evaluating AI applications.8.5Free planWindows · macOS · Linux · Web15 Oct 2026
6 OpenLITOpenLIT is an open-source platform for observing and managing LLM and agent work, built on OpenTelemetry.8.5Free planWindows · macOS · Linux · Web14 Oct 2026
7 LangWatchLangWatch is an AI agent engineering platform for teams working to ship reliable agents to production.8.4Free planmacOS · Linux · Web · API21 Oct 2026
8 LangfuseLangfuse is an open-source platform for engineering teams that build AI agent applications.8.2Free planLinux · Web · API · Self-hosted15 Oct 2026
9 LunaryLunary is an AI platform for enterprise teams and developers building chatbots or other applications powered by large language models.8.0Free planWeb · API · Self-hosted15 Oct 2026
10 AgentOpsAgentOps is a developer platform for building AI agents and LLM applications.8.0Free planWeb · API · Self-hosted15 Oct 2026

26 productsOrdered 19 Nov 2026 How the Club ranks

Ranked by the Club score: how fast a newcomer can get going, from what each maker publishes.

  1. 1

    W&B Weave

    W&B Weave provides observability and continuous improvement tools for production AI agents.

    • Free plan
    • Open source
    • Windows · macOS · Linux · Web
    8.8 Club score
  2. 2

    Opik

    Opik helps teams building applications or agents that call an LLM log agent actions and evaluate behavior across development, testing, and production.

    • Free plan
    • Open source
    • Windows · macOS · Linux · Web
    8.7 Club score
  3. 3

    Evidently AI

    Evidently AI evaluates, tests, and monitors machine-learning models, LLMs, RAG applications, and AI agents.

    • Free plan
    • Open source
    • Windows · macOS · Linux · Web
    8.7 Club score
  4. 4

    LangSmith

    LangSmith is a commercial platform for building, testing, deploying, monitoring, and improving AI agents.

    • Free plan
    • Windows · macOS · Linux · Web
    8.5 Club score
  5. 5

    Promptfoo

    Promptfoo is a platform for building and evaluating AI applications.

    • Free plan
    • Open source
    • Windows · macOS · Linux · Web
    8.5 Club score
  6. 6

    OpenLIT

    OpenLIT is an open-source platform for observing and managing LLM and agent work, built on OpenTelemetry.

    • Free plan
    • Open source
    • Windows · macOS · Linux · Web
    8.5 Club score
  7. 7

    LangWatch

    LangWatch is an AI agent engineering platform for teams working to ship reliable agents to production.

    • Free plan
    • Open source
    • macOS · Linux · Web · API
    8.4 Club score
  8. 8

    Langfuse

    Langfuse is an open-source platform for engineering teams that build AI agent applications.

    • Free plan
    • Open source
    • Linux · Web · API · Self-hosted
    8.2 Club score
  9. 9

    Lunary

    Lunary is an AI platform for enterprise teams and developers building chatbots or other applications powered by large language models.

    • Free plan
    • Open source
    • Web · API · Self-hosted
    8.0 Club score
  10. 10

    AgentOps

    AgentOps is a developer platform for building AI agents and LLM applications.

    • Free plan
    • Open source
    • Web · API · Self-hosted
    8.0 Club score
  11. 11

    Giskard

    Giskard provides tools for finding vulnerabilities in AI agents before they reach production.

    • Free plan
    • Open source
    • Linux · Web · API · Self-hosted
    8.0 Club score
  12. 12

    Braintrust

    Braintrust is an active observability platform for teams that want to inspect AI agents in production and improve their quality.

    • Free plan
    • Web · API · Self-hosted
    7.8 Club score
  13. 13

    Galileo

    Galileo is an observability, evaluation, and guardrail platform for generative AI and agentic applications.

    • Free plan
    • Web · API · Self-hosted
    7.5 Club score
  14. 14

    Maxim AI

    Maxim AI is an evaluation and observability platform for teams building and operating AI agents.

    • Free plan
    • Web · API · Self-hosted
    7.5 Club score
  15. 15

    TruLens

    TruLens is a free, open-source Python SDK for tracing and evaluating AI agents, RAG applications, MCP apps, and summarization systems.

    • Free plan
    • Open source
    • API · Self-hosted
    7.4 Club score
  16. 16

    Helicone

    Helicone is a platform for routing, debugging and analyzing AI applications.

    • Free plan
    • Web · API · Self-hosted
    7.4 Club score
  17. 17

    Laminar

    Laminar is an open-source observability and debugging platform for AI agents built around OpenTelemetry.

    • Free plan
    • Web · API · Self-hosted
    7.4 Club score
  18. 18

    Respan (formerly Keywords AI)

    Respan, formerly Keywords AI, is an AI gateway and observability platform for teams building and operating AI applications.

    • Free plan
    • Web · API · Self-hosted
    7.4 Club score
  19. 19

    Arize AX

    Arize AX is a platform for improving AI agents by turning their production behavior into issues, investigations, evaluations and experiments.

    • Free plan
    • Web · API · Self-hosted
    7.3 Club score
  20. 20

    Fiddler AI

    Fiddler AI provides observability and security for AI agents and predictive applications, covering development evaluation and production monitoring.

    • Free plan
    • Web · API · Self-hosted
    7.3 Club score
  21. 21

    Arize Phoenix

    Arize Phoenix helps teams trace, evaluate, debug, and improve AI applications.

    • Free plan
    • Web · API · Self-hosted
    7.2 Club score
  22. 22

    Confident AI

    Confident AI is an AI Quality platform for evaluating development changes and monitoring applications in production.

    • Free plan
    • Web · API · Self-hosted
    7.2 Club score
  23. 23

    HoneyHive

    HoneyHive is an agent observability platform for teams that need to inspect, evaluate, and improve AI agents in production.

    • Free plan
    • Web · API · Self-hosted
    7.2 Club score
  24. 24

    OpenLLMetry

    OpenLLMetry is a free, open-source project for monitoring and debugging LLM application execution.

    • Free plan
    • Web · API · Self-hosted
    7.2 Club score
  25. 25

    Parea AI

    Parea AI is a platform for experiment tracking, observability, and human annotation for teams building LLM applications.

    • Free plan
    • Web · API · Self-hosted
    7.1 Club score