tokenizers
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
View on Github
Activity
- Latest release
- 1w ago
- Total releases
- 101
- Cadence
- ~28 days
- Last 12 months
- 6
Reach
- Stars
- 11.0k
Details
- License
- Apache-2.0
- First release
- Nov 01, 2019
Releases
| Version | Released | |
|---|---|---|
0.23.2
patch
| ||
0.23.1
minor
| ||
0.23.1rc0
pre
| ||
0.23.0rc0
pre
| ||
0.22.2
patch
| ||
0.22.2rc0
pre
| ||
0.22.1
patch
| ||
0.22.1rc0
pre
| ||
0.22.0
minor
| ||
0.22.0rc0
pre
| ||
0.21.4
patch
| ||
0.21.2
patch
| ||
0.21.2rc0
pre
| ||
0.21.1
patch
| ||
0.21.1rc0
pre
| ||
0.21.0
minor
| ||
0.21.0rc0
pre
| ||
0.20.4
patch
| ||
0.20.4rc0
pre
| ||
0.20.3
patch
| ||
0.20.2
patch
| ||
0.20.1
patch
| ||
0.20.0
minor
| ||
0.19.1
patch
| ||
0.19.0
minor
| ||
0.15.2
patch
| ||
0.15.1
patch
| ||
0.15.0
minor
| ||
0.14.1
patch
| ||
0.14.0
minor
| ||
0.13.3
patch
| ||
0.13.2
patch
| ||
0.13.1
patch
| ||
0.13.0
minor
| ||
0.12.1
patch
| ||
0.12.0
minor
| ||
0.11.6
patch
| ||
0.11.5
patch
| ||
0.11.4
patch
| ||
0.11.3
patch
| ||
0.11.2
patch
| ||
0.11.1
patch
| ||
0.11.0
minor
| ||
0.10.3
patch
| ||
0.10.2
patch
| ||
0.10.1
patch
| ||
0.10.0
minor
| ||
0.10.0rc1
pre
| ||
0.9.4
patch
| ||
0.9.3
patch
|
1–50 of 101