reasoning-parser
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across SGLang, vLLM, TRT-LLM, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.
- Latest release
- Apr 09, 2026
- Releases
- 8
- Known CVEs
- 0
- First release
- Jan 06, 2026
- License
- Apache-2.0
Repository
Source
- Stars
- 322
- Forks
- 94
- Open issues
- 65
- Language
- Rust
- anthropic
- claude
- gemini
- inference-gateway
- llm
- openai
- routing
- sglang
Security score
No OpenSSF Scorecard available for this repository.
Packages from this repo
Insights
Activity
- Total releases
- 8
- Last 12 months
- 8
- Cadence
- ~14 days
- Dependencies
- 4
Releases per month
last 12 monthsRelease mix
- major 1
- minor 2
- patch 4
8
releases
Dependencies
Depends on
1.2.3-
parking_lot
^0.12.4
-
thiserror
^2.0.12
-
tokio
^1.42.0
dev
-
tokio
^1.42.0
Used by
Nothing tracked depends on this yet.
Releases
| Version | Released | |
|---|---|---|
1.2.3
patch
| ||
1.2.2
patch
| ||
1.2.1
patch
| ||
1.2.0
minor
| ||
1.1.0
minor
| ||
1.0.1
patch
| ||
1.0.0
major
| ||
0.0.1
initial
|