bitcannon
SIMD Unicode atom classification + bitstream pre-tokenization: one classify pass into byte-exact token spans (cl100k, o200k, GPT-2/ByteLevel, DeepSeek, Whitespace, Bert, ...).
Activity
- Latest release
- 1w ago
- Total releases
- 4
- Cadence
- ~daily
- Last 12 months
- 4
Reach
- Downloads
- 0
Details
- License
- Apache-2.0
- First release
- Sep 21, 2026
Releases
| Version | Released | |
|---|---|---|
0.1.0-rc.3
pre
| ||
0.1.0-rc.2
pre
| ||
0.1.0-rc.1
pre
| ||
0.1.0-dev.0
pre
|