speculators
A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM
View on Github
Activity
- Latest release
- 1w ago
- Total releases
- 20
- Cadence
- ~21 days
- Last 12 months
- 14
Reach
- Stars
- 821
Details
- License
- Apache-2.0
- First release
- May 01, 2025
Releases
| Version | Released | |
|---|---|---|
0.8.0
minor
| ||
0.7.0.1
patch
| ||
0.6.0.1
patch
| ||
0.7.0
minor
| ||
0.6.0
minor
| ||
0.5.0
minor
| ||
0.5.0a0
pre
| ||
0.4.0.1
patch
| ||
0.4.0a1
pre
| ||
0.4.0
minor
| ||
0.4.0a0
pre
| ||
0.3.0
minor
| ||
0.2.0
minor
| ||
0.2.0a0
pre
| ||
0.1.0
minor
| ||
0.1.0a9
pre
| ||
0.1.0a8
pre
| ||
0.1.0a7
pre
| ||
0.1.0a6
pre
| ||
0.0.1
initial
|