onnx-genai-scheduler
Continuous batching and preemption scheduler for LLM inference
Activity
- Latest release
- 4d ago
- Total releases
- 5
- Cadence
- ~6 days
- Last 12 months
- 5
Reach
- Downloads
- 164
Details
- License
- MIT
- First release
- Jul 12, 2026
Releases
Continuous batching and preemption scheduler for LLM inference