vllm-tpu
A high-throughput and memory-efficient inference and serving engine for LLMs
Activity
- Latest release
- 1w ago
- Total releases
- 33
- Cadence
- ~9 days
- Last 12 months
- 26
Details
- License
- Apache-2.0
- First release
- May 27, 2025
Releases
| Version | Released | |
|---|---|---|
0.32.0
minor
| ||
0.31.0
minor
| ||
0.30.0
minor
| ||
0.29.0
minor
| ||
0.28.0
minor
| ||
0.27.0
minor
| ||
0.26.0
minor
| ||
0.25.0
minor
| ||
0.24.0
minor
| ||
0.23.0
minor
| ||
0.22.0
minor
| ||
0.21.0
minor
| ||
0.20.0
minor
| ||
0.19.0
minor
| ||
0.18.0
minor
| ||
0.18.0rc1
pre
| ||
0.13.3
minor
| ||
0.13.2.post6
pre
| ||
0.13.2rc4
pre
| ||
0.13.2rc4.post6
pre
| ||
0.13.2rc3
pre
| ||
0.13.2rc1
pre
| ||
0.12.0
minor
| ||
0.12.0rc2
pre
| ||
0.12.0rc1
pre
| ||
0.11.2rc1
pre
| ||
0.11.1
minor
| ||
0.11.1rc3
pre
| ||
0.11.1rc2
pre
| ||
0.11.1rc1
pre
| ||
0.10.1.1
minor
| ||
0.9.4.dev0
pre
| ||
0.9.3
initial
|