TensorRT-LLM
https://github.com/nvidia/tensorrt-llm- Category
- AI Tools
- Pricing
- Open Source
- Type
- TOOL
- Builder
- nvidia
- GitHub
- 14.2k stars
- Added
- May 22, 2026
About
NVIDIA's Python API for defining LLMs and running them on NVIDIA GPUs with state-of-the-art inference optimizations.
Why it made the leaderboard
NVIDIA's own Python API for defining LLMs and running them on NVIDIA GPUs with state-of-the-art inference optimizations — the first-party path to maximum throughput on that hardware.
Tags
llminferencenvidiatensorrtgpu
Tech Stack
Python
Comments (0)
No comments yet
Indexed by a proprietary survey. Corrections welcome.