PortedFastBertTokenizer
Fast and memory-efficient WordPiece tokenizer as it is used by BERT and others. Tokenizes text for further processing using NLP/language models. This fork only supports .NET Standard 2.1
Activity
- Latest release
- 2y ago
- Total releases
- 1
- Cadence
- —
- Last 12 months
- 0
Details
- License
- MIT
- First release
- Nov 24, 2023