Starlings.Models.Kev
Kev decision models (jaredpalmer/kev-0.8b and jaredpalmer/kev-4b, Kev 1.0) on ONNX Runtime: one state and typed questions (noul, choice, score) in, a calibrated probability per option out, in one prefill pass without generating text. Kev's request rendering and delimiter escaping in C#, token ids from the owned tokenizer (Starlings.Tokenizers profile qwen2-bpe-kev: no Microsoft.ML.Tokenizers), the Qwen3.5 backbone as an fp32 ONNX graph (the LoRA merged; ONNX Runtime GenAI builder without the LM head), the state run once and every question as its own row on the cached state, and Kev's pointer head. Ships the asset locks, not the weights. Profiles kev-0.8b/onnx-fp32-cpu and kev-4b/onnx-fp32-cpu, and onnx-fp32-cuda on the same bundles (TF32 off). The application adds the ONNX Runtime native package. Maturity is per model profile (Stable, Preview or Experimental): see the README, generated from the model registry.
Activity
- Latest release
- 1w ago
- Total releases
- 1
- Cadence
- —
- Last 12 months
- 1
Details
- License
- MIT OR Apache-2.0
- First release
- Oct 19, 2026