Microsoft.ML.Tokenizers.Data.Cl100kBase
The Microsoft.ML.Tokenizers.Data.Cl100kBase class includes the Tiktoken tokenizer data file cl100k_base.tiktoken, which is utilized by models such as GPT-4.
Activity
- Latest release
- 6mo ago
- Total releases
- 14
- Cadence
- ~17 days
- Last 12 months
- 5
Details
- License
- MIT
- First release
- Oct 23, 2024
| Version | Released | |
|---|---|---|
3.0.0-preview.26160.2
pre
|
3.0.0-preview.26160.2
pre
Dependencies (10)
+ 2 more |
|
2.0.0
major
|
2.0.0
major
Dependencies (11)
+ 3 more |
|
2.0.0-preview.25527.5
pre
|
2.0.0-preview.25527.5
pre
Dependencies (11)
+ 3 more |
|
1.0.3
patch
|
1.0.3
patch
Dependencies (1)
|
|
2.0.0-preview.25503.2
pre
|
2.0.0-preview.25503.2
pre
Dependencies (11)
+ 3 more |
|
2.0.0-preview.25373.1
pre
|
2.0.0-preview.25373.1
pre
Dependencies (11)
+ 3 more |
|
2.0.0-preview.1.25127.4
pre
|
2.0.0-preview.1.25127.4
pre
Dependencies (1)
|
|
1.0.2
patch
|
1.0.2
patch
Dependencies (1)
|
|
2.0.0-preview.1.25125.4
pre
|
2.0.0-preview.1.25125.4
pre
Dependencies (1)
|
|
1.0.1
patch
|
1.0.1
patch
Dependencies (1)
|
|
1.0.0
major
|
1.0.0
major
Dependencies (1)
|
|
0.22.0
initial
|
0.22.0
initial
Dependencies (1)
|
|
0.22.0-preview.24526.1
pre
|
0.22.0-preview.24526.1
pre
Dependencies (1)
|
|
0.22.0-preview.24522.7
pre
|
0.22.0-preview.24522.7
pre
Dependencies (1)
|