BerriAI/litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
View on GitHub →PythonNOASSERTIONanthropiclangchainllmllmopsopenai
Stars
54.3k
Δ 7d
—
Δ 30d
—
Age
2 yrs
Last push
1h ago
90-day star history
Most-wanted open issues
Ranked by 👍 reactions. 1,491 open issues total, checked 2026-07-22.
| Issue | 👍 | Comments | Opened |
|---|---|---|---|
| 137 | 119 | 4 mo | |
[Feature]: Dark Mode enhancement | 68 | 58 | 1 yr |
| 33 | 6 | 4 mo | |
| 26 | 5 | 4 mo | |
| 25 | 19 | 3 mo |
Alternatives in Gateways & routing
A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & fr…
⭐12.5k
TypeScript
2 yrs
Drop-in OpenAI-compatible API gateway for Qwen AI models. Use your Qwen account (chat.qwen.ai) as a free AI AP…
⭐105
+37d
TypeScript
2 mo