vllm-consul
A high-throughput and memory-efficient inference and serving engine for LLMs
- Latest release
- Oct 30, 2023
- Releases
- 5
- Known CVEs
- 0
- First release
- Oct 26, 2023
- License
- Apache-2.0
Repository
Source
- Stars
- —
- Forks
- —
- Open issues
- —
Security score
No OpenSSF Scorecard available for this repository.
Packages from this repo
Insights
Activity
- Total releases
- 5
- Last 12 months
- 0
- Cadence
- ~daily
- Dependencies
- 16
Releases per month
last 12 monthsRelease mix
- pre 4
5
releases
Dependencies
Depends on
0.2.1.dev5-
fastapi
-
fschat
-
ninja
-
numpy
-
pandas
-
psutil
-
pyarrow
-
pydantic
==1.10.13
-
python-consul
-
python-json-logger
1–10 of 16
Used by
Nothing tracked depends on this yet.
Releases
| Version | Released | |
|---|---|---|
0.2.1.dev5
pre
| ||
0.2.1.dev4
pre
| ||
0.2.1.dev2
pre
| ||
0.2.1.dev1
pre
| ||
0.2.1
initial
|