splintr-vocab-qwen
A high-performance tokenizer (BPE, WordPiece, SentencePiece) built with Rust with Python bindings, focused on speed, safety, and resource optimization.
View on Github
Activity
- Latest release
- 1mo ago
- Total releases
- 1
- Cadence
- —
- Last 12 months
- 1
Reach
- Downloads
- 0
- Stars
- 60
Details
- License
- Apache-2.0
- First release
- Aug 11, 2026