Sign in Sign up
cargo

smg

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.

cargo View on Cargo github View on Github

Activity

Latest release
1w ago
Total releases
22
Cadence
~10 days
Last 12 months
22

Reach

Downloads
449
Stars
690

Details

License
Apache-2.0
First release
Jan 06, 2026
Releases
Version Released
1.13.0 minor
1.12.0 minor
1.11.0 minor
1.10.1 patch
1.10.0 minor
1.9.0 minor
1.8.0 minor
1.7.0 minor
1.6.0 minor
1.5.0 minor
1.4.1 patch
1.4.0 minor
1.3.3 patch
1.3.2 patch
1.3.1 patch
1.3.0 minor
1.2.0 minor
1.1.0 minor
1.0.1 patch
1.0.0 major
0.4.0 minor
0.0.1 initial