Sign in Sign up
pypi

exllamav3

An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs

Activity

Latest release
1d ago
Total releases
51
Cadence
~6 days
Last 12 months
44

Reach

Stars
1.4k

Details

License
MIT
First release
May 09, 2025
Releases
Version Released
1.5.0 minor
1.4.9 patch
1.4.8 patch
1.4.7 patch
1.4.6 patch
1.4.5 patch
1.4.2 patch
1.4.1 patch
1.4.0 minor
1.2.0 minor
1.1.0 minor
1.0.0 major
0.0.43 patch
0.0.42 patch
0.0.41 patch
0.0.40 patch
0.0.39 patch
0.0.37 patch
0.0.36 patch
0.0.35 patch
0.0.33 patch
0.0.32 patch
0.0.31 patch
0.0.30 patch
0.0.29 patch
0.0.28 patch
0.0.27 patch
0.0.26 patch
0.0.25 patch
0.0.24 patch
0.0.23 patch
0.0.22 patch
0.0.21 patch
0.0.20 patch
0.0.19 patch
0.0.18 patch
0.0.17 patch
0.0.16 patch
0.0.15 patch
0.0.12 patch
0.0.11 patch
0.0.10 patch
0.0.9 patch
0.0.8 patch
0.0.7 patch
0.0.6 patch
0.0.5 patch
0.0.4 patch
0.0.3 patch
0.0.2 patch
1–50 of 51