litellm
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
- Latest release
- 1d ago
- Releases
- 1239
- Known CVEs
- 23
- First release
- Jul 27, 2023
- License
- MIT
Repository
Source
- Stars
- 49.7k
- Forks
- 8.7k
- Open issues
- 1.4k
- Language
- Python
- anthropic
- langchain
- llm
- llmops
- openai
- ai-gateway
- azure-openai
- bedrock
Security score
No OpenSSF Scorecard available for this repository.
Packages from this repo
Insights
Activity
- Total releases
- 1239
- Last 12 months
- 163
- Cadence
- ~daily
- Dependencies
- 67
Releases per month
last 12 monthsRelease mix
- major 1
- minor 102
- patch 691
- pre 166
1239
releases
Dependencies
Depends on
1.84.6-
a2a-sdk
==0.3.24
-
aiohttp
<4.0,>=3.10
-
anthropic
==0.84.0
-
apscheduler
==3.11.2
-
aurelio-sdk
==0.0.19
-
azure-ai-contentsafety
==1.0.0
-
azure-identity
==1.25.2
-
azure-keyvault-secrets
==4.10.0
-
azure-storage-blob
==12.28.0
-
azure-storage-file-datalake
==12.20.0
1–10 of 67
Used by
135-
nemo-retriever
-
agent-magnet
-
metagit-cli
-
imgl
-
chakra-marina
-
agntspace
-
novastack-llms-litellm
-
mcp-second-opinion
-
kogniterm
-
datarobot-genai
1–10 of 135
Releases
| Version | Released | |
|---|---|---|
1.84.6
patch
| ||
1.88.1
patch
| ||
1.88.0
minor
| ||
1.89.0rc1
pre
| ||
1.88.0rc3
pre
| ||
1.88.0rc2
pre
| ||
1.87.1
patch
| ||
1.86.4
patch
| ||
1.85.4
patch
| ||
1.84.5
patch
| ||
1.86.3
patch
| ||
1.87.0
minor
| ||
1.85.3
patch
| ||
1.88.0rc1
pre
| ||
1.84.4
patch
| ||
1.88.0.dev1
pre
| ||
1.84.3
patch
| ||
1.86.2
patch
| ||
1.85.2
patch
| ||
1.84.2
patch
|
1–20 of 1239