openai-protocol
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across SGLang, vLLM, TRT-LLM, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.
- Latest release
- Apr 09, 2026
- Releases
- 10
- Known CVEs
- 0
- First release
- Jan 06, 2026
- License
- Apache-2.0
Repository
Source
- Stars
- 322
- Forks
- 94
- Open issues
- 65
- Language
- Rust
- anthropic
- claude
- gemini
- inference-gateway
- llm
- openai
- routing
- sglang
Security score
No OpenSSF Scorecard available for this repository.
Packages from this repo
Insights
Activity
- Total releases
- 10
- Last 12 months
- 10
- Cadence
- ~10 days
- Dependencies
- 12
Releases per month
last 12 monthsRelease mix
- major 1
- minor 7
- patch 1
10
releases
Releases
| Version | Released | |
|---|---|---|
1.7.0
minor
| ||
1.6.0
minor
| ||
1.5.0
minor
| ||
1.4.1
patch
| ||
1.4.0
minor
| ||
1.3.0
minor
| ||
1.2.0
minor
| ||
1.1.0
minor
| ||
1.0.0
major
| ||
0.0.1
initial
|