Sign in Sign up
cargo

reasoning-parser

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.

Activity

Latest release
2w ago
Total releases
14
Cadence
~14 days
Last 12 months
14

Reach

Downloads
1.3M
Stars
522

Details

License
Apache-2.0
First release
Jan 06, 2026
Releases
Version Released
1.7.0 minor
1.6.0 minor
1.5.0 minor
1.4.0 minor
1.3.1 patch
1.3.0 minor
1.2.3 patch
1.2.2 patch
1.2.1 patch
1.2.0 minor
1.1.0 minor
1.0.1 patch
1.0.0 major
0.0.1 initial