Sign in Sign up
pypi

exllamav3

An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs

Activity

Latest release
4d ago
Total releases
60
Cadence
~4 days
Last 12 months
49

Reach

Stars
1.8k

Details

License
MIT
First release
May 09, 2025
Releases
Version Released
1.6.5 patch
1.6.4 patch
1.6.3 patch
1.6.2 patch
1.6.1 patch
1.6.0 minor
1.5.3 patch
1.5.2 patch
1.5.1 patch
1.5.0 minor
1.4.9 patch
1.4.8 patch
1.4.7 patch
1.4.6 patch
1.4.5 patch
1.4.2 patch
1.4.1 patch
1.4.0 minor
1.2.0 minor
1.1.0 minor
1.0.0 major
0.0.43 patch
0.0.42 patch
0.0.41 patch
0.0.40 patch
0.0.39 patch
0.0.37 patch
0.0.36 patch
0.0.35 patch
0.0.33 patch
0.0.32 patch
0.0.31 patch
0.0.30 patch
0.0.29 patch
0.0.28 patch
0.0.27 patch
0.0.26 patch
0.0.25 patch
0.0.24 patch
0.0.23 patch
0.0.22 patch
0.0.21 patch
0.0.20 patch
0.0.19 patch
0.0.18 patch
0.0.17 patch
0.0.16 patch
0.0.15 patch
0.0.12 patch
0.0.11 patch
1–50 of 60