llmcompressor
Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM
Activity
- Latest release
- 1mo ago
- Total releases
- 32
- Cadence
- ~23 days
- Last 12 months
- 19
Reach
- Stars
- 3.7k
Details
- License
- Apache-2.0
- First release
- Aug 08, 2024
Releases