Sign in Sign up
pypi

snaptokens

Fast BPE tokenization from local Hugging Face tokenizer.json files

pypi View on Pypi github View on Github

Activity

Latest release
1mo ago
Total releases
3
Cadence
~19 days
Last 12 months
3

Reach

Stars
—

Details

First release
Jul 31, 2026
Releases
Version Released
0.2.6 patch
0.2.5 patch
0.2.4 initial