FastBertTokenizer
Fast and memory-efficient WordPiece tokenizer as it is used by BERT and others. Tokenizes text for further processing using NLP/language models.
Activity
- Latest release
- 1y ago
- Total releases
- 6
- Cadence
- ~3 months
- Last 12 months
- 0
Details
- License
- MIT
- First release
- Sep 14, 2023
Releases
| Version | Released | |
|---|---|---|
1.1.30-alpha
pre
| ||
1.0.28
major
| ||
0.5.18-alpha
pre
| ||
0.4.67
minor
| ||
0.3.29
minor
| ||
0.2.7
initial
|