blazr
LLM inference server with an OpenAI-compatible API, plus speech synthesis (TTS) and transcription (ASR). Serves Llama, Mistral, Qwen, Mamba2, MLA+MoE and hybrid models from SafeTensors, AWQ, GPTQ and GGUF.
Activity
- Latest release
- 2w ago
- Total releases
- 8
- Cadence
- ~daily
- Last 12 months
- 8
Reach
- Downloads
- 112
Details
- License
- Apache-2.0
- First release
- Dec 05, 2025
Releases