OpenLLMetry
Open-source OpenTelemetry-based observability for LLMs — vendor-neutral SDK that emits standard OTel traces consumable by any backend.
75
Hero Score
Popularity
66
Performance
100
Ecosystem
75
Maturity
61
Dev Experience
75
⭐ 7,160 stars⬇ 638.9K downloads/wkFirst release: Aug 2023Last release: May 2026
Async Support: YesPlugin Extensions: HighSpeed: Very fastDoc Quality: HighLearning Curve: Easy
Pros
- • Pure OpenTelemetry standard means traces flow into Datadog, Honeycomb, Grafana, New Relic, or any OTel backend with no lock-in
- • Single-line `Traceloop.init()` auto-instruments OpenAI, Anthropic, LangChain, LlamaIndex, Pinecone, and more
- • Lightweight library — no separate platform to host, just emit spans to your existing observability stack
Cons
- • Library only — no built-in UI, dashboards, or evaluation tooling without a backend
- • Semantic conventions for GenAI are still evolving so span attributes may shift across versions
- • Debugging requires familiarity with OpenTelemetry concepts (traces, spans, exporters)