github.com/tiktoken-go/tokenizer
Pure Go implementation of OpenAI's tiktoken tokenizer
View on Github
Activity
- Latest release
- 1w ago
- Total releases
- 19
- Cadence
- ~31 days
- Last 12 months
- 5
Reach
- Stars
- 459
Details
- First release
- Apr 09, 2023
| Version | Released | |
|---|---|---|
v0.10.0
minor
|
v0.10.0
minor
Dependencies (1)
|
|
v0.9.0
minor
|
v0.9.0
minor
Dependencies (1)
|
|
v0.8.2
patch
|
v0.8.2
patch
Dependencies (1)
|
|
v0.8.1
patch
|
v0.8.1
patch
Dependencies (1)
|
|
v0.8.0
minor
|
v0.8.0
minor
Dependencies (1)
|
|
v0.7.0
minor
|
v0.7.0
minor
Dependencies (1)
|
|
v0.6.2
patch
|
v0.6.2
patch
Dependencies (1)
|
|
v0.6.1
patch
|
v0.6.1
patch
Dependencies (1)
|
|
v0.6.0
minor
|
v0.6.0
minor
Dependencies (1)
|
|
v0.5.1
patch
|
v0.5.1
patch
Dependencies (1)
|
|
v0.5.0
minor
|
v0.5.0
minor
Dependencies (1)
|
|
v0.4.0
minor
|
v0.4.0
minor
Dependencies (1)
|
|
v0.3.0
minor
|
v0.3.0
minor
Dependencies (1)
|
|
v0.2.1
patch
|
v0.2.1
patch
Dependencies (1)
|
|
v0.2.0
minor
|
v0.2.0
minor
Dependencies (1)
|
|
v0.1.1
patch
|
v0.1.1
patch
Dependencies (1)
|
|
v0.1.0
minor
|
v0.1.0
minor
Dependencies (1)
|
|
v0.0.9
patch
|
v0.0.9
patch
|
|
v0.0.8
initial
|
v0.0.8
initial
|