Sign in Sign up
npm

llm-load-balancer

A small service package allowing to perform load balancing of LLM prompts between models, regions and model hosting platforms

Latest release
Dec 31, 2024
Releases
26
Known CVEs
0
First release
Dec 08, 2024
License
MIT
View on Npm
Repository

Source

yeshmeain/llm-load-balancer
Stars
—
Forks
—
Open issues
—

Security score

No OpenSSF Scorecard available for this repository.

Packages from this repo

No other tracked packages from this repository.

Insights

Activity

Total releases
26
Last 12 months
0
Cadence
~daily
Dependencies
6

Releases per month

last 12 months

Release mix

  • minor 4
  • patch 21
26 releases
Dependencies

Depends on

0.5.3

Used by

Nothing tracked depends on this yet.

Releases
Version Released
0.5.3 patch
0.5.2 patch
0.5.1 patch
0.5.0 minor
0.4.7 patch
0.4.6 patch
0.4.5 patch
0.4.4 patch
0.4.3 patch
0.4.2 patch
0.4.1 patch
0.4.0 minor
0.3.1 patch
0.3.0 minor
0.2.2 patch
0.2.1 patch
0.2.0 minor
0.1.8 patch
0.1.7 patch
0.1.6 patch
1–20 of 26