litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
Activity
- Latest release
- 1d ago
- Total releases
- 1263
- Cadence
- ~daily
- Last 12 months
- 216
Reach
- Stars
- 58.6k
Details
- License
- MIT
- First release
- Jul 27, 2023
Releases
1–50 of 1263