NTokenizers
Collection of stream-capable tokenizers for XML, JSON, HTML, YAML, TOML, Markdown, TypeScript, CSS, C#, SQL, Java, C, C++, Rust, Kotlin, Go, Swift and Python processing. See README for usage and details.
Activity
- Latest release
- 2mo ago
- Total releases
- 21
- Cadence
- ~daily
- Last 12 months
- 21
Details
- License
- MIT
- First release
- Nov 19, 2025
Releases
| Version | Released | |
|---|---|---|
6.2.0
minor
|
6.2.0
minor
|
|
6.1.1
patch
|
6.1.1
patch
|
|
6.1.0
minor
|
6.1.0
minor
|
|
6.0.1
patch
|
6.0.1
patch
|
|
6.0.0
major
|
6.0.0
major
|
|
5.0.0
major
|
5.0.0
major
|
|
4.0.0
major
|
4.0.0
major
|
|
3.0.0
major
|
3.0.0
major
|
|
2.2.0
minor
|
2.2.0
minor
|
|
2.1.0
minor
|
2.1.0
minor
|
|
2.0.0
major
|
2.0.0
major
|
|
1.0.1
patch
|
1.0.1
patch
|
|
1.0.0
initial
|
1.0.0
initial
|
|
0.8.0-preview
pre
|
0.8.0-preview
pre
|
|
0.7.0-preview
pre
|
0.7.0-preview
pre
|
|
0.6.0-preview
pre
|
0.6.0-preview
pre
|
|
0.5.0-preview
pre
|
0.5.0-preview
pre
|
|
0.4.0-preview
pre
|
0.4.0-preview
pre
|
|
0.3.0-preview
pre
|
0.3.0-preview
pre
|
|
0.2.0-preview
pre
|
0.2.0-preview
pre
|
|
0.1.0-preview
pre
|
0.1.0-preview
pre
|