oxillama-runtime
Pure Rust LLM Inference Engine — The Sovereign Alternative to llama.cpp License Rust Complete GGUF model loading, multi-format quantized inference, and an OpenAI-compatible API server — all without a single line of C, C++, or Fortran code.
View on Github
Activity
- Latest release
- 4w ago
- Total releases
- 5
- Cadence
- ~9 days
- Last 12 months
- 5
Reach
- Downloads
- 415
- Stars
- 31
Details
- License
- Apache-2.0
- First release
- Apr 15, 2026
Releases