red-candle
Ruby gem for running state-of-the-art language models locally. Access LLMs, embeddings, rerankers, and NER models directly from Ruby using Rust-powered Candle with Metal/CUDA acceleration.
Activity
- Latest release
- 8h ago
- Total releases
- 36
- Cadence
- ~3 days
- Last 12 months
- 14
Reach
- Stars
- 204
Details
- License
- MIT
- First release
- Sep 28, 2023
Releases