tktkt
Tokeniser toolkit: a collection of Pythonic subword tokenisers and text preprocessing tools.
- Latest release
- May 05, 2026
- Releases
- 25
- Known CVEs
- 0
- First release
- Mar 24, 2026
- License
- —
Repository
Source
- Stars
- —
- Forks
- —
- Open issues
- —
Security score
No OpenSSF Scorecard available for this repository.
Packages from this repo
No other tracked packages from this repository.
Insights
Activity
- Total releases
- 25
- Last 12 months
- 25
- Cadence
- ~daily
- Dependencies
- 20
Releases per month
last 12 monthsRelease mix
- major 2
- minor 16
- patch 6
25
releases
Dependencies
Depends on
2026.5.1
1–10 of 20
Used by
3Releases
| Version | Released | |
|---|---|---|
2026.5.1
minor
| ||
2026.4.1
minor
| ||
2026.3.12
minor
| ||
2026.2.22
patch
| ||
2026.2.1
minor
| ||
2026.1.9
patch
| ||
2026.1.8
patch
| ||
2026.1.1
major
| ||
2025.12.16
patch
| ||
2025.12.5
patch
| ||
2025.12.1
minor
| ||
2025.11.24
patch
| ||
2025.11.1
minor
| ||
2025.10.1
minor
| ||
2025.9.1
minor
| ||
2025.8.1
minor
| ||
2025.7.1
minor
| ||
2025.4.1
major
| ||
2024.12.1
minor
| ||
2024.10.1
minor
|
1–20 of 25