Sign in Sign up
pypi

vec-inf

Efficient LLM inference on Slurm clusters using vLLM.

Latest release
Apr 10, 2026
Releases
17
Known CVEs
0
First release
Aug 27, 2024
License
MIT
View on Pypi
Insights

Activity

Total releases
17
Last 12 months
7
Cadence
~33 days
Dependencies
12

Releases per month

last 12 months

Release mix

  • minor 6
  • patch 9
  • pre 1
17 releases
Dependencies

Depends on

0.9.0
  • pypi click >=8.1.0
  • pypi orjson >=3.11.0
  • pypi pydantic >=2.10.6
  • pypi pyyaml >=6.0.2
  • pypi ray >=2.51.0
  • pypi requests >=2.31.0
  • pypi rich >=13.7.0
  • pypi sglang >=0.5.5
  • pypi sgl-kernel >=0.3.0
  • pypi torchao >=0.9.0
1–10 of 12

Used by

Nothing tracked depends on this yet.

Releases
Version Released
0.9.0 minor
0.8.1 patch
0.8.0 minor
0.7.3 patch
0.7.2 patch
0.7.1 patch
0.7.0 minor
0.6.1 patch
0.6.0 minor
0.5.0 minor
0.4.1 patch
0.4.0.post1 pre
0.4.0 minor
0.3.3 patch
0.3.2 patch
0.3.1 patch
0.3.0 initial