ai-tokenizer
A faster than tiktoken tokenizer with first-class support for Vercel's AI SDK.
Activity
- Latest release
- 9mo ago
- Total releases
- 7
- Cadence
- ~daily
- Last 12 months
- 7
Details
- License
- MIT
- First release
- Oct 09, 2025
| Version | Released | |
|---|---|---|
1.0.6
patch
|
1.0.6
patch
Dependencies (1)
|
|
1.0.5
patch
|
1.0.5
patch
Dependencies (1)
|
|
1.0.4
patch
|
1.0.4
patch
Dependencies (1)
|
|
1.0.3
patch
|
1.0.3
patch
Dependencies (1)
|
|
1.0.2
patch
|
1.0.2
patch
Dependencies (1)
|
|
1.0.1
patch
|
1.0.1
patch
Dependencies (1)
|
|
1.0.0
initial
|
1.0.0
initial
Dependencies (2)
|