nemo-evaluator
NeMo Evaluator — benchmark environments, pluggable solvers, interceptor proxy, and decision-grade scoring for LLMs
- Latest release
- Jun 03, 2026
- Releases
- 106
- Known CVEs
- 0
- First release
- Sep 17, 2025
- License
- Apache-2.0
Repository
Source
- Stars
- —
- Forks
- —
- Open issues
- —
Security score
No OpenSSF Scorecard available for this repository.
Packages from this repo
Insights
Activity
- Total releases
- 106
- Last 12 months
- 106
- Cadence
- ~daily
- Dependencies
- 33
Releases per month
last 12 monthsRelease mix
- minor 2
- patch 101
- pre 2
106
releases
Dependencies
Depends on
0.3.0-
aiohttp
>=3.9
-
boto3
>=1.28
-
click
>=8.0
-
datasets
>=2.14
-
fastapi
>=0.100
-
harbor
<0.4.0,>=0.3.0
-
inspect-ai
-
jinja2
>=3.0
-
lm-eval
>=0.4
-
mlflow
1–10 of 33
Used by
23-
nemo-evaluator-launcher
-
nvidia-compute-eval
-
nvidia-aa-lcr
-
nvidia-bfcl
-
nvidia-bigcode-eval
-
nvidia-crfm-helm
-
nvidia-long-context-eval
-
nvidia-simple-evals
-
nvidia-eval-factory-garak
-
nvidia-hle
1–10 of 23
Releases
| Version | Released | |
|---|---|---|
0.3.0
minor
| ||
0.2.8
patch
| ||
0.2.7
patch
| ||
0.2.6
patch
| ||
0.2.5
patch
| ||
0.2.4
patch
| ||
0.2.3
patch
| ||
0.2.2
patch
| ||
0.2.1
patch
| ||
0.2.0
minor
| ||
0.1.95
patch
| ||
0.1.94
patch
| ||
0.1.93
patch
| ||
0.1.92
patch
| ||
0.1.91
patch
| ||
0.1.90
patch
| ||
0.1.89
patch
| ||
0.1.88
patch
| ||
0.1.87
patch
| ||
0.1.86
patch
|
1–20 of 106