@huggingface/tokenizers
🤗 Tokenizers.js: A pure JS/TS implementation of today's most used tokenizers
View on Github
Activity
- Latest release
- 1w ago
- Total releases
- 11
- Cadence
- ~8 days
- Last 12 months
- 11
Reach
- Stars
- 56
Details
- License
- Apache-2.0
- First release
- Nov 03, 2025
Releases
| Version | Released | |
|---|---|---|
0.2.0
minor
| ||
0.1.3
patch
| ||
0.1.2
patch
| ||
0.1.1
patch
| ||
0.1.0
minor
| ||
0.0.6
patch
| ||
0.0.5
patch
| ||
0.0.4
patch
| ||
0.0.3
patch
| ||
0.0.2
patch
| ||
0.0.1
initial
|