smg-mcp
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across SGLang, vLLM, TRT-LLM, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.
- Latest release
- Apr 09, 2026
- Releases
- 6
- Known CVEs
- 0
- First release
- Jan 06, 2026
- License
- Apache-2.0
Repository
Source
- Stars
- 322
- Forks
- 94
- Open issues
- 65
- Language
- Rust
- anthropic
- claude
- gemini
- inference-gateway
- llm
- openai
- routing
- sglang
Security score
No OpenSSF Scorecard available for this repository.
Packages from this repo
Insights
Activity
- Total releases
- 6
- Last 12 months
- 6
- Cadence
- ~15 days
- Dependencies
- 24
Releases per month
last 12 monthsRelease mix
- major 2
- minor 2
- patch 1
6
releases
Dependencies
Depends on
2.2.0-
async-trait
^0.1
-
axum
^0.8.6
-
backoff
^0.4
-
chrono
^0.4
-
dashmap
^6.1.0
-
futures
^0.3
-
lru
^0.16.2
-
openai-protocol
^1.7.0
-
parking_lot
^0.12.4
-
regex
^1.12
1–10 of 24
Used by
Nothing tracked depends on this yet.
Releases