tensorrt-llm
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
View on Github
Activity
- Latest release
- 1d ago
- Total releases
- 81
- Cadence
- ~6 days
- Last 12 months
- 47
Reach
- Stars
- 14.3k
Details
- License
- Apache-2.0
- First release
- Oct 20, 2023
Releases
| Version | Released | |
|---|---|---|
1.3.0rc23
pre
| ||
1.3.0rc22
pre
| ||
1.3.0rc15
pre
| ||
1.3.0rc12.post1
pre
| ||
1.3.0rc14
pre
| ||
1.3.0rc13
pre
| ||
1.3.0rc5.post2
pre
| ||
1.2.1
patch
| ||
1.3.0rc12
pre
| ||
1.3.0rc11
pre
| ||
1.3.0rc10
pre
| ||
1.3.0rc9
pre
| ||
1.3.0rc8
pre
| ||
1.2.0
minor
| ||
1.3.0rc7
pre
| ||
1.3.0rc5.post1
pre
| ||
1.3.0rc6
pre
| ||
1.3.0rc5
pre
| ||
1.3.0rc4
pre
| ||
1.3.0rc3
pre
| ||
1.2.0rc6.post3
pre
| ||
1.2.0rc2.post2
pre
| ||
1.3.0rc2
pre
| ||
1.3.0rc1
pre
| ||
1.2.0rc6.post2
pre
| ||
1.3.0rc0
pre
| ||
1.2.0rc8
pre
| ||
1.2.0rc6.post1
pre
| ||
1.2.0rc7
pre
| ||
1.2.0rc6
pre
| ||
1.1.0
minor
| ||
1.2.0rc5
pre
| ||
1.2.0rc4
pre
| ||
1.2.0rc3
pre
| ||
1.2.0rc2
pre
| ||
1.2.0rc1
pre
| ||
1.2.0rc0
pre
| ||
1.0.0
major
| ||
1.1.0rc5
pre
| ||
1.1.0rc4
pre
| ||
1.1.0rc3
pre
| ||
1.1.0rc2
pre
| ||
1.1.0rc1
pre
| ||
1.1.0rc0
pre
| ||
1.0.0rc6
pre
| ||
1.0.0rc5
pre
| ||
0.21.0
minor
| ||
1.0.0rc4
pre
| ||
1.0.0rc3
pre
| ||
1.0.0rc2
pre
|
1–50 of 81