Sign in Sign up
nuget

Tiktoken.Encodings.Tokenizer

Load tokenizer.json (HuggingFace format) as a Tiktoken encoding.

nuget View on Nuget

Activity

Latest release
1w ago
Total releases
26
Cadence
~daily
Last 12 months
26

Details

License
MIT
First release
Mar 18, 2026
Releases
Version Released
3.1.6-alpha.0.30 pre
3.1.6-alpha.0.29 pre
3.1.6-alpha.0.28 pre
3.1.6-alpha.0.27 pre
3.1.6-alpha.0.26 pre
3.1.6-alpha.0.23 pre
3.1.6-alpha.0.22 pre
3.1.6-alpha.0.21 pre
3.1.6-alpha.0.20 pre
3.1.5 patch
3.1.5-alpha.0.6 pre
3.1.4 patch
3.1.3 patch
3.1.2 patch
3.1.2-alpha.0.1 pre
3.1.1 patch
3.1.1-alpha.0.1 pre
3.1.0 minor
3.1.0-rc.1.4 pre
3.1.0-rc.1.3 pre
3.0.1-alpha.0.4 pre
3.1.0-rc.1.2 pre
3.1.0-rc.1.1 pre
3.1.0-rc.1 pre
3.0.0 major
2.2.0 initial