fmbench
Benchmark performance of **any Foundation Model (FM)** deployed on **any AWS Generative AI service**, be it **Amazon SageMaker**, **Amazon Bedrock**, **Amazon EKS**, or **Amazon EC2**. The FMs could be deployed on these platforms either directly through `FMbench`, or, if they are already deployed then also they could be benchmarked through the **Bring your own endpoint** mode supported by `FMBench`.
- Latest release
- Apr 11, 2025
- Releases
- 83
- Known CVEs
- 0
- First release
- Feb 13, 2024
- License
- MIT
Insights
Activity
- Total releases
- 83
- Last 12 months
- 0
- Cadence
- ~4 days
- Dependencies
- 33
Releases per month
last 12 monthsRelease mix
- major 1
- minor 1
- patch 80
83
releases
Dependencies
Depends on
2.1.6-
boto3
>=1.36.6
-
datasets
>=3.2.0
-
ec2-metadata
>=2.14.0
-
ipykernel
>=6.29.5
-
ipywidgets
>=8.1.5
-
jinja2
>=3.1.5
-
jupyter
>=1.1.1
-
jupyter-client
>=8.6.3
-
kaleido
==0.2.1
-
litellm
>=1.59.8
1–10 of 33
Used by
Nothing tracked depends on this yet.
Releases
| Version | Released | |
|---|---|---|
2.1.6
patch
|
2.1.6
patch
Dependencies (33)
+ 25 more |
|
2.1.5
patch
|
2.1.5
patch
|
|
2.1.4
patch
|
2.1.4
patch
|
|
2.1.3
patch
|
2.1.3
patch
|
|
2.1.2
patch
|
2.1.2
patch
|
|
2.1.1
patch
|
2.1.1
patch
|
|
2.1.0
minor
|
2.1.0
minor
|
|
2.0.26
patch
|
2.0.26
patch
|
|
2.0.25
patch
|
2.0.25
patch
|
|
2.0.24
patch
|
2.0.24
patch
|
|
2.0.23
patch
|
2.0.23
patch
|
|
2.0.22
patch
|
2.0.22
patch
|
|
2.0.21
patch
|
2.0.21
patch
|
|
2.0.20
patch
|
2.0.20
patch
|
|
2.0.19
patch
|
2.0.19
patch
|
|
2.0.18
patch
|
2.0.18
patch
|
|
2.0.17
patch
|
2.0.17
patch
|
|
2.0.16
patch
|
2.0.16
patch
|
|
2.0.15
patch
|
2.0.15
patch
|
|
2.0.14
patch
|
2.0.14
patch
|
1–20 of 83