Starlings.Models.QwenChat
Qwen/Qwen3-0.6B (revision c1899de2, thinking disabled) and Qwen/Qwen2.5-0.5B-Instruct (revision 7ae55760) text chat generation in-process on ONNX Runtime GenAI 0.17.1: the pinned chat templates rendered in C# for system, user and assistant messages (tools and multimodal input rejected), prompt ids from the owned tokenizer (Starlings.Tokenizers: no Microsoft.ML.Tokenizers, no GenAI tokenizer), and Starling's decode loop (greedy, stop tokens and strings, streaming, cancellation between steps, usage). Ships no weights: QwenChatModelAssets downloads the profile's bundle explicitly from Starling's public Hugging Face hosting (or it is built locally from the pinned original), and Load verifies every file against the profile's digests. Profiles qwen3-0.6b/ortgenai-fp32-cpu and qwen2.5-0.5b-instruct/ortgenai-fp32-cpu, Linux x64. The application adds Microsoft.ML.OnnxRuntimeGenAI. Maturity is per model profile (Stable, Preview or Experimental): see the README, generated from the model registry.
Activity
- Latest release
- 1w ago
- Total releases
- 1
- Cadence
- —
- Last 12 months
- 1
Details
- License
- MIT OR Apache-2.0
- First release
- Oct 19, 2026