llm-tokenizer
A lightweight tokenizer for OpenAI's GPT model series. Uses OpenAI's tiktoken python package
- Latest release
- Sep 07, 2023
- Releases
- 2
- Known CVEs
- 0
- First release
- Sep 02, 2023
- License
- Apache-2.0
Repository
Source
- Stars
- —
- Forks
- —
- Open issues
- —
Security score
No OpenSSF Scorecard available for this repository.
Packages from this repo
No other tracked packages from this repository.
Insights
Activity
- Total releases
- 2
- Last 12 months
- 0
- Cadence
- ~5 days
- Dependencies
- 0
Releases per month
last 12 monthsRelease mix
- patch 1
2
releases
Dependencies
Depends on
1.0.2No dependencies recorded for the latest release.
Used by
1Releases
| Version | Released | |
|---|---|---|
1.0.2
patch
| ||
1.0.1
initial
|