Triton-ng
github.com/rdcm/triton-ng- Category
- Developer Tools
- Rank
- No. 2003Tools index
- Pricing
- Open Source
- Type
- TOOL
- GitHub
- 4 stars
- Latest release
- 0.4.0
- Date
About
A Rust SDK for writing custom backends for NVIDIA Triton Inference Server. Backends are built as shared libraries that run inside Triton, and the project also ships an async gRPC client for calling a running server. It targets Triton 25.09 and checks compatibility at backend startup.
Tags
rusttritoninferencenvidiagrpcffi
Tech Stack
Rust
Comments (0)
No comments yet
Editorially curated, with community endorsements as a secondary signal. Corrections welcome.