BerriAI/litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
View on GitHub →Where this sits in the catalog
Most-wanted open issues
Ranked by 👍 reactions. 1,636 open issues total, checked 2026-09-02.
| Issue | 👍 | Comments | Opened |
|---|---|---|---|
| 136 | 119 | 5 mo | |
[Feature]: Dark Mode enhancement | 75 | 65 | 1 yr |
| 39 | 6 | 5 mo | |
| 26 | 6 | 5 mo | |
[Feature]: unlimited SSO Login with Standard Plan enhancement, proxy | 23 | 15 | 4 mo |
Head to head with its peers
The same six axes and the same star history, two projects at a time.
Alternatives in Gateways & routing
Never stop coding. Free MIT AI gateway: one endpoint, 352 providers (150+ free), 1200+ models Kimi, Claude, GP…
A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & fr…
Open-source multi-provider AI gateway for Claude Code and other coding agents, with model routing, streaming,…
Drop-in OpenAI-compatible API gateway for Qwen AI models. Use your Qwen account (chat.qwen.ai) as a free AI AP…