Sign in Sign up
pypi

xinference

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

Activity

Latest release
4d ago
Total releases
151
Cadence
~13 days
Last 12 months
28

Reach

Stars
9.6k

Details

License
Apache-2.0
First release
Jul 07, 2023
Releases
Version Released
3.4.0 minor
3.3.0 minor
3.2.1 patch
3.2.0 minor
3.1.0 minor
3.1.0rc1 pre
3.0.0 major
2.12.0 minor
2.11.0 minor
2.10.0 minor
2.9.0 minor
2.8.0 minor
2.7.0 minor
2.5.0 minor
1 CVE
2.4.0 minor
1 CVE
2.3.0 minor
1 CVE
2.2.0 minor
1 CVE
2.1.0 minor
1 CVE
2.0.0 major
1 CVE
1.17.1 patch
1 CVE
1.17.0 minor
1 CVE
1.16.0 minor
1 CVE
1.15.0 minor
1 CVE
1.14.0 minor
1 CVE
1.13.0 minor
1 CVE
1.12.0 minor
1 CVE
1.11.0.post1 pre
1 CVE
1.11.0 minor
1 CVE
1.10.1 patch
1 CVE
1.10.0 minor
1 CVE
1.9.1 patch
1 CVE
1.9.0 minor
1 CVE
1.8.1 patch
1 CVE
1.8.1rc1 pre
1 CVE
1.8.0 minor
1 CVE
1.7.1.post1 pre
1 CVE
1.7.1 patch
1 CVE
1.7.0.post1 pre
1 CVE
1.7.0 minor
1 CVE
1.6.1 patch
1 CVE
1.6.0.post1 pre
1 CVE
1.6.0 minor
1 CVE
1.5.1 patch
1 CVE
1.5.0.post2 pre
1 CVE
1.5.0.post1 pre
1 CVE
1.5.0 minor
1 CVE
1.4.1 patch
1 CVE
1.4.0 minor
1 CVE
1.3.1.post1 pre
1 CVE
1.3.1 patch
1 CVE
1–50 of 151