BerriAI/litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
View on GitHub →Where this sits in the catalog
Most-wanted open issues
Ranked by 👍 reactions. 1,851 open issues total, checked 2026-10-14.
| Issue | 👍 | Comments | Opened |
|---|---|---|---|
| 52 | 5 | 1 mo | |
| 45 | 7 | 7 mo | |
[Feature]: unlimited SSO Login with Standard Plan enhancement, proxy | 30 | 17 | 6 mo |
| 20 | 29 | 3 mo | |
| 17 | 12 | 6 mo |
Head to head with its peers
The same six axes and the same star history, two projects at a time.
Alternatives in Gateways & routing
Never stop coding. Free MIT AI gateway: one endpoint, 375 providers (150+ free), 1,400+ models Kimi, Claude, G…
A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & fr…
Open-source multi-provider AI gateway for Claude Code and other coding agents, with model routing, streaming,…
Make Codex and Claude Code subscriptions go further: a local model router that gives routine agent work to eco…