TensorRT Edge LLM
https://github.com/nvidia/tensorrt-edge-llmAbout
Lightweight C++ LLM and VLM inference engine optimized for edge devices and physical AI.
Why it made the leaderboard
Lightweight C++ inference engine for LLMs and VLMs optimized for edge devices and physical AI — run language and vision models where a Python serving stack will not fit.
Tags
tensorrtllminferenceedgenvidia
Tech Stack
Python
Comments (0)
No comments yet
Indexed by a proprietary survey. Corrections welcome.