LiteLLM
Unified Python SDK and proxy server that calls 100+ LLM providers using the OpenAI API format — drop-in router with cost tracking, fallbacks, and load balancing.
llm-gateway-frameworksRecently released
82
Hero Score
Popularity
88
Performance
85
Ecosystem
100
Maturity
61
Dev Experience
75
⭐ 48,903 stars⬇ 123.9M downloads/wkFirst release: Jul 2023Last release: May 2026
Async Support: YesPlugin Extensions: Very highSpeed: FastDoc Quality: HighLearning Curve: Easy
Pros
- • Calls 100+ LLM providers through a single OpenAI-format interface, so swapping models is a one-line change
- • Built-in proxy server adds cost tracking, budgets, fallbacks, and load balancing without app changes
- • Active development with rapid support for new provider features and models
Cons
- • Provider-specific features can lag behind official SDKs
- • The unification abstraction occasionally leaks when providers diverge on edge cases
- • Very frequent releases can introduce churn and breaking-ish behavior between versions