Sign in Sign up
cargo

octoroute

Smart HTTP router for local LLMs (Ollama, LM Studio, llama.cpp). Rule-based + LLM-powered routing, health checks, load balancing, Prometheus metrics. Rust-native, zero-overhead.

cargo View on Cargo github View on Github

Activity

Latest release
1d ago
Total releases
14
Cadence
~5 days
Last 12 months
14

Reach

Downloads
268
Stars
8

Details

License
MIT
First release
Nov 25, 2025
Releases
Version Released
3.0.2 patch
3.0.1 patch
3.0.0 major
2.2.2 patch
2.2.1 patch
2.2.0 minor
2.1.2 patch
2.1.1 patch
2.1.0 minor
2.0.1 patch
2.0.0 major
1.0.0 major
0.1.1 patch
0.1.0 initial