Sign in Sign up
pypi

llm-infer

Multi-backend LLM client library, a from-scratch PagedAttention inference engine, and an OpenAI-compatible serve wrapper.

pypi View on Pypi

Activity

Latest release
1w ago
Total releases
12
Cadence
~16 days
Last 12 months
12

Details

License
Apache-2.0
First release
Feb 21, 2026
Releases
Version Released
0.7.1 patch
0.7.0 minor
0.6.3 patch
0.6.2 patch
0.6.1 patch
0.6.0 minor
0.5.0 minor
0.4.0 minor
0.3.0 minor
0.2.0 minor
0.1.1 patch
0.1.0 initial