Lyntai.Providers.Local
Lyntai LLM provider for in-process local inference of GGUF models via LLamaSharp (llama.cpp). References LLamaSharp managed only — the consuming app picks an LLamaSharp.Backend.* (Cpu/Cuda/Vulkan/Metal) matching its hardware. Wired via builder.AddLocalProvider(modelPath).
View on Github
Activity
- Latest release
- 3w ago
- Total releases
- 14
- Cadence
- ~daily
- Last 12 months
- 14
Reach
- Stars
- 1
Details
- License
- MIT
- First release
- Jul 29, 2026
Releases
| Version | Released | |
|---|---|---|
3.1.0
minor
| ||
3.0.2
patch
| ||
3.0.1
patch
| ||
3.0.0
major
| ||
2.5.0
minor
| ||
2.4.0
minor
| ||
2.3.0
minor
| ||
2.2.0
minor
| ||
2.1.0
minor
| ||
2.0.1
major
| ||
1.2.2
patch
| ||
1.2.1
patch
| ||
1.2.0
minor
| ||
1.1.0
initial
|