tiktoken
High-performance Rust tiktoken BPE tokenizer + WASM bindings (@goliapkg/tiktoken-wasm)
Activity
- Latest release
- 1mo ago
- Total releases
- 26
- Cadence
- ~daily
- Last 12 months
- 25
Reach
- Downloads
- 32.4k
- Stars
- 7
Details
- License
- MIT OR Apache-2.0
- First release
- Aug 18, 2023
Releases