Starlings.Models.Qwen35
Qwen/Qwen3.5-0.8B (revision 2fc06364) chat generation in-process on ONNX Runtime GenAI 0.17.1: the pinned chat template rendered in C# for text and tool-calling conversations (system, user, assistant and tool messages, tool definitions and calls, thinking switch; images rejected), a parser for the template's tool-call format (whole or streamed), prompt ids from the owned tokenizer (Starlings.Tokenizers profile qwen35-bpe-chat: no Microsoft.ML.Tokenizers, no GenAI tokenizer), and Starling's decode loop (greedy or seeded sampling, stop tokens and strings, streaming, cancellation between steps, usage). Ships the asset lock, not the weights. Profiles qwen3.5-0.8b/ortgenai-fp32x (CPU; CUDA with TF32 off) and ortgenai-fp16x (CUDA), Linux x64, Stable. The application adds Microsoft.ML.OnnxRuntimeGenAI or Microsoft.ML.OnnxRuntimeGenAI.Cuda. Maturity is per model profile (Stable, Preview or Experimental): see the README, generated from the model registry.
Activity
- Latest release
- 1w ago
- Total releases
- 3
- Cadence
- ~2 days
- Last 12 months
- 3
Details
- License
- MIT OR Apache-2.0
- First release
- Oct 14, 2026
| Version | Released | |
|---|---|---|
0.3.0
minor
| ||
0.2.0
initial
| ||
0.1.0-preview.6
pre
|