Starlings.Tokenizers

Managed .NET tokenizer for Hugging Face tokenizer.json files (format 1.0): Unigram, byte-level BPE, SentencePiece-style BPE with byte fallback, and WordPiece. Exact against huggingface/tokenizers on published conformance fixtures, fails explicitly on any component it does not support, no native code and no package dependencies. Profile descriptors with pinned asset digests and per-capability status are packed under profiles/.