Sign in Sign up
pypi

litellm

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

pypi View on Pypi github View on Github

Activity

Latest release
7h ago
Total releases
1346
Cadence
~daily
Last 12 months
286

Reach

Stars
62.2k

Details

License
MIT
First release
Jul 27, 2023
Releases
Version Released
1.108.0rc1 pre
1.105.7 patch
1.106.6 patch
1.109.0.dev1 pre
1.106.5 patch
1.105.6 patch
1.103.10 patch
1.104.8 patch
1.106.4 patch
1.104.7 patch
1.105.5 patch
1.103.9 patch
1.106.3 patch
1.105.4 patch
1.104.6 patch
1.103.8 patch
1.107.0 minor
1.106.2 patch
1.105.3 patch
1.103.7 patch
1.104.5 patch
1.106.1 patch
1.105.2 patch
1.103.6 patch
1.107.0rc2 pre
1.104.4 patch
1.107.0rc1 pre
1.106.0 minor
1.103.5 patch
1.107.0.dev3 pre
1.106.0rc4 pre
1.107.0.dev2 pre
1.106.0rc3 pre
1.107.0.dev1 pre
1.105.1 patch
1.106.0rc2 pre
1.104.3 patch
1.105.0 minor
1.106.0rc1 pre
1.106.0.dev3 pre
1.105.0rc3 pre
1.104.2 patch
1.102.4 patch
1.101.6 patch
1.106.0.dev2 pre
1.105.0rc2 pre
1.104.1 patch
1.103.4 patch
1.102.3 patch
1.100.5 patch
1–50 of 1346