bpe_knockout
Implementation of BPE-knockout, a morphologically informed post-processing step for BPE tokenisers.
- Latest release
- Mar 24, 2026
- Releases
- 18
- Known CVEs
- 0
- First release
- Mar 16, 2026
- License
- custom
Repository
Source
- Stars
- —
- Forks
- —
- Open issues
- —
Security score
No OpenSSF Scorecard available for this repository.
Packages from this repo
No other tracked packages from this repository.
Insights
Activity
- Total releases
- 18
- Last 12 months
- 18
- Cadence
- ~daily
- Dependencies
- 13
Releases per month
last 12 monthsRelease mix
- major 2
- minor 8
- patch 7
18
releases
Dependencies
Depends on
2026.3.24-
datasets
>=2.10.1
-
fiject
-
langcodes
-
language-data
-
modest-bauwenst
-
numpy
>=1.23.5
-
requests
-
scipy
-
tktkt
-
tokenizers
>=0.13.2
1–10 of 13
Used by
Nothing tracked depends on this yet.
Releases
| Version | Released | |
|---|---|---|
2026.3.24
patch
| ||
2026.3.13
minor
| ||
2026.2.22
patch
| ||
2026.2.1
minor
| ||
2026.1.8
patch
| ||
2026.1.1
major
| ||
2025.12.16
patch
| ||
2025.12.10
patch
| ||
2025.12.4
patch
| ||
2025.12.1
minor
| ||
2025.11.1
minor
| ||
2025.10.2
patch
| ||
2025.10.1
minor
| ||
2025.9.1
major
| ||
2024.8.1
minor
| ||
2024.4.1
minor
| ||
2024.3.1
minor
| ||
2024.2.1
initial
|