smg-grpc-proto
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across SGLang, vLLM, TRT-LLM, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.
- Latest release
- 6h ago
- Releases
- 12
- Known CVEs
- 0
- First release
- Feb 10, 2026
- License
- Apache-2.0
Repository
Source
- Stars
- 322
- Forks
- 94
- Open issues
- 65
- Language
- Rust
- anthropic
- claude
- gemini
- inference-gateway
- llm
- openai
- routing
- sglang
Security score
No OpenSSF Scorecard available for this repository.
Packages from this repo
Insights
Activity
- Total releases
- 12
- Last 12 months
- 12
- Cadence
- ~11 days
- Dependencies
- 2
Releases per month
last 12 monthsRelease mix
- minor 1
- patch 10
12
releases
Dependencies
Depends on
0.4.9Used by
1Releases
| Version | Released | |
|---|---|---|
0.4.9
patch
| ||
0.4.8
patch
| ||
0.4.7
patch
| ||
0.4.6
patch
| ||
0.4.5
patch
| ||
0.4.4
patch
| ||
0.4.3
patch
| ||
0.4.2
patch
| ||
0.4.1
patch
| ||
0.4.0
minor
| ||
0.3.3
patch
| ||
0.3.2
initial
|