ManySpeech.Tiktoken
The fastest tokenizer for gpt2, multilingual, whisper and qwen3 inspired by Tiktoken.
Activity
- Latest release
- 5mo ago
- Total releases
- 2
- Cadence
- ~6 months
- Last 12 months
- 1
Details
- First release
- Sep 16, 2025
Releases
| Version | Released | |
|---|---|---|
1.1.0
minor
|
1.1.0
minor
Dependencies (1)
|
|
1.0.0
initial
|
1.0.0
initial
Dependencies (1)
|