@tmfi/tokenizers
Provides an implementation of today's most used tokenizers, with a focus on performances and versatility.
- Latest release
- Aug 22, 2024
- Releases
- 2
- Known CVEs
- 0
- First release
- Jul 16, 2024
- License
- Apache-2.0
Repository
Source
- Stars
- —
- Forks
- —
- Open issues
- —
Security score
No OpenSSF Scorecard available for this repository.
Packages from this repo
-
@tmfi/tokenizers-android-arm64
-
@tmfi/tokenizers-android-arm-eabi
-
@tmfi/tokenizers-darwin-arm64
-
@tmfi/tokenizers-darwin-universal
-
@tmfi/tokenizers-darwin-x64
-
@tmfi/tokenizers-linux-arm64-gnu
-
@tmfi/tokenizers-linux-arm64-musl
-
@tmfi/tokenizers-linux-arm-gnueabihf
-
@tmfi/tokenizers-linux-riscv64-gnu
-
@tmfi/tokenizers-linux-x64-gnu
-
@tmfi/tokenizers-linux-x64-musl
-
@tmfi/tokenizers-win32-arm64-msvc
Insights
Activity
- Total releases
- 2
- Last 12 months
- 0
- Cadence
- ~37 days
- Dependencies
- 14
Releases per month
last 12 monthsRelease mix
- pre 2
2
releases
Dependencies
Depends on
0.20.0-dev0-
@tmfi/tokenizers-android-arm64
0.20.0-dev0
optional
-
@tmfi/tokenizers-android-arm-eabi
0.20.0-dev0
optional
-
@tmfi/tokenizers-darwin-arm64
0.20.0-dev0
optional
-
@tmfi/tokenizers-darwin-universal
0.20.0-dev0
optional
-
@tmfi/tokenizers-darwin-x64
0.20.0-dev0
optional
-
@tmfi/tokenizers-linux-arm64-gnu
0.20.0-dev0
optional
-
@tmfi/tokenizers-linux-arm64-musl
0.20.0-dev0
optional
-
@tmfi/tokenizers-linux-arm-gnueabihf
0.20.0-dev0
optional
-
@tmfi/tokenizers-linux-riscv64-gnu
0.20.0-dev0
optional
-
@tmfi/tokenizers-linux-x64-gnu
0.20.0-dev0
optional
1–10 of 14
Used by
1Releases