kvboost
Chunk-level KV cache reuse for faster HuggingFace inference
View on Github
Activity
- Latest release
- 3mo ago
- Total releases
- 9
- Cadence
- ~6 days
- Last 12 months
- 9
Reach
- Stars
- —
Details
- License
- MIT
- First release
- Mar 31, 2026
Releases
| Version | Released | |
|---|---|---|
0.9.0
minor
| ||
0.8.0
minor
| ||
0.7.0
minor
| ||
0.6.0
minor
| ||
0.4.1
patch
| ||
0.4.0
minor
| ||
0.3.0
minor
| ||
0.2.0
minor
| ||
0.1.0
initial
|