github.com/petmal/mindtrial
MindTrial: Evaluate and compare AI language models (LLMs) on text-based tasks with optional file/image attachments and tool use. Supports multiple providers (OpenAI, Google, Anthropic, DeepSeek, Mistral AI, xAI, Alibaba, Moonshot AI, OpenRouter), custom tasks in YAML, and HTML/CSV/JSON reports.
Activity
- Latest release
- 3d ago
- Total releases
- 49
- Cadence
- ~6 days
- Last 12 months
- 34
Reach
- Stars
- 15
Details
- First release
- Apr 26, 2025
| Version | Released | |
|---|---|---|
v0.20.2
patch
|
v0.20.2
patch
Dependencies (25)
+ 17 more |
|
v0.20.1
patch
|
v0.20.1
patch
Dependencies (25)
+ 17 more |
|
v0.20.0
minor
|
v0.20.0
minor
Dependencies (25)
+ 17 more |
|
v0.19.9
patch
|
v0.19.9
patch
Dependencies (24)
+ 16 more |
|
v0.19.8
patch
|
v0.19.8
patch
Dependencies (24)
+ 16 more |
|
v0.19.7
patch
|
v0.19.7
patch
Dependencies (24)
+ 16 more |
|
v0.19.6
patch
|
v0.19.6
patch
Dependencies (24)
+ 16 more |
|
v0.19.5
patch
|
v0.19.5
patch
Dependencies (24)
+ 16 more |
|
v0.19.4
patch
|
v0.19.4
patch
Dependencies (24)
+ 16 more |
|
v0.19.3
patch
|
v0.19.3
patch
Dependencies (24)
+ 16 more |
|
v0.19.2
patch
|
v0.19.2
patch
Dependencies (24)
+ 16 more |
|
v0.19.1
patch
|
v0.19.1
patch
Dependencies (24)
+ 16 more |
|
v0.19.0
minor
|
v0.19.0
minor
Dependencies (24)
+ 16 more |
|
v0.18.0
minor
|
v0.18.0
minor
Dependencies (24)
+ 16 more |
|
v0.17.1
patch
|
v0.17.1
patch
Dependencies (24)
+ 16 more |
|
v0.17.0
minor
|
v0.17.0
minor
Dependencies (24)
+ 16 more |
|
v0.16.0
minor
|
v0.16.0
minor
Dependencies (24)
+ 16 more |
|
v0.15.0
minor
|
v0.15.0
minor
Dependencies (24)
+ 16 more |
|
v0.14.1
patch
|
v0.14.1
patch
Dependencies (24)
+ 16 more |
|
v0.14.0
minor
|
v0.14.0
minor
Dependencies (24)
+ 16 more |
|
v0.13.4
patch
|
v0.13.4
patch
Dependencies (25)
+ 17 more |
|
v0.13.3
patch
|
v0.13.3
patch
Dependencies (24)
+ 16 more |
|
v0.13.2
patch
|
v0.13.2
patch
Dependencies (24)
+ 16 more |
|
v0.13.1
patch
|
v0.13.1
patch
Dependencies (24)
+ 16 more |
|
v0.13.0
minor
|
v0.13.0
minor
Dependencies (24)
+ 16 more |
|
v0.12.2
patch
|
v0.12.2
patch
Dependencies (24)
+ 16 more |
|
v0.12.1
patch
|
v0.12.1
patch
Dependencies (24)
+ 16 more |
|
v0.12.0
minor
|
v0.12.0
minor
Dependencies (24)
+ 16 more |
|
v0.11.1
patch
|
v0.11.1
patch
Dependencies (24)
+ 16 more |
|
v0.11.0
minor
|
v0.11.0
minor
Dependencies (23)
+ 15 more |
|
v0.10.1
patch
|
v0.10.1
patch
Dependencies (21)
+ 13 more |
|
v0.10.0
minor
|
v0.10.0
minor
Dependencies (21)
+ 13 more |
|
v0.9.0
minor
|
v0.9.0
minor
Dependencies (21)
+ 13 more |
|
v0.8.0
minor
|
v0.8.0
minor
Dependencies (21)
+ 13 more |
|
v0.7.2
patch
|
v0.7.2
patch
Dependencies (21)
+ 13 more |
|
v0.7.1
patch
|
v0.7.1
patch
Dependencies (21)
+ 13 more |
|
v0.7.0
minor
|
v0.7.0
minor
Dependencies (21)
+ 13 more |
|
v0.6.1
patch
|
v0.6.1
patch
Dependencies (21)
+ 13 more |
|
v0.6.0
minor
|
v0.6.0
minor
Dependencies (21)
+ 13 more |
|
v0.5.0
minor
|
v0.5.0
minor
Dependencies (21)
+ 13 more |
|
v0.4.2
patch
|
v0.4.2
patch
Dependencies (21)
+ 13 more |
|
v0.4.1
patch
|
v0.4.1
patch
Dependencies (21)
+ 13 more |
|
v0.4.0
minor
|
v0.4.0
minor
Dependencies (21)
+ 13 more |
|
v0.3.2
patch
|
v0.3.2
patch
Dependencies (19)
+ 11 more |
|
v0.3.1
patch
|
v0.3.1
patch
Dependencies (19)
+ 11 more |
|
v0.3.0
minor
|
v0.3.0
minor
Dependencies (19)
+ 11 more |
|
v0.2.1
patch
|
v0.2.1
patch
Dependencies (19)
+ 11 more |
|
v0.2.0
minor
|
v0.2.0
minor
Dependencies (19)
+ 11 more |
|
v0.1.0
initial
|
v0.1.0
initial
Dependencies (18)
+ 10 more |