Vibeleaderboard
Index / tool
Visit github.com
Category
Developer Tools
Rank
No. 2003Tools index
Pricing
Open Source
Type
TOOL
GitHub
4 stars
Latest release
0.4.0
Date

About

A Rust SDK for writing custom backends for NVIDIA Triton Inference Server. Backends are built as shared libraries that run inside Triton, and the project also ships an async gRPC client for calling a running server. It targets Triton 25.09 and checks compatibility at backend startup.

Tags

rusttritoninferencenvidiagrpcffi

Tech Stack

Rust

Comments (0)

No comments yet

Editorially curated, with community endorsements as a secondary signal. Corrections welcome.