drama_llama
Local LLM inference behind an Anthropic-shaped API: llama.cpp and Metal-MoE backends, chat sessions with prefix caching, per-model tool-call dialects, and GBNF-constrained structured output.
Activity
- Latest release
- 3w ago
- Total releases
- 28
- Cadence
- ~daily
- Last 12 months
- 6
Details
- License
- unknown
- First release
- Apr 20, 2024
Releases