OpenLLMetry

Open-source OpenTelemetry-based observability for LLMs — vendor-neutral SDK that emits standard OTel traces consumable by any backend.

llm-observability-frameworksRecently releasednpm: @traceloop/node-server-sdk
75
Hero Score
Popularity
66
Performance
100
Ecosystem
75
Maturity
61
Dev Experience
75
⭐ 7,160 stars⬇ 638.9K downloads/wkFirst release: Aug 2023Last release: May 2026
Async Support: YesPlugin Extensions: HighSpeed: Very fastDoc Quality: HighLearning Curve: Easy

Pros

  • Pure OpenTelemetry standard means traces flow into Datadog, Honeycomb, Grafana, New Relic, or any OTel backend with no lock-in
  • Single-line `Traceloop.init()` auto-instruments OpenAI, Anthropic, LangChain, LlamaIndex, Pinecone, and more
  • Lightweight library — no separate platform to host, just emit spans to your existing observability stack

Cons

  • Library only — no built-in UI, dashboards, or evaluation tooling without a backend
  • Semantic conventions for GenAI are still evolving so span attributes may shift across versions
  • Debugging requires familiarity with OpenTelemetry concepts (traces, spans, exporters)

Alternatives in llm-observability-frameworks

Compare Python Packages with ease.