bpe-tokenizer
Build your own vocabulary from application-specific corpus using Byte pair encoding (BPE) algorithm.
Activity
- Latest release
- 2y ago
- Total releases
- 10
- Cadence
- ~daily
- Last 12 months
- 0
Details
- License
- BSD-2-Clause
- First release
- Feb 28, 2024
| Version | Released | |
|---|---|---|
2.2.0
minor
|
2.2.0
minor
Dependencies (2)
|
|
2.1.0
minor
|
2.1.0
minor
Dependencies (2)
|
|
2.0.0
major
|
2.0.0
major
Dependencies (2)
|
|
1.3.0
minor
|
1.3.0
minor
Dependencies (2)
|
|
1.2.1
patch
|
1.2.1
patch
Dependencies (2)
|
|
1.2.0
minor
|
1.2.0
minor
Dependencies (2)
|
|
1.1.1
patch
|
1.1.1
patch
|
|
1.1.0
minor
|
1.1.0
minor
|
|
1.0.1
major
|
1.0.1
major
|
|
0.0.0
initial
|
0.0.0
initial
|