InferenceX
inferencex.semianalysis.com- Category
- Developer Tools
- Type
- TOOL
- GitHub
- 1.3k stars
- Added
- Jul 31, 2026
About
Open-source, continuously updated inference benchmark comparing models, accelerators, serving frameworks, throughput, latency, and cost across real deployment configurations.
Why it made the leaderboard
Inference performance depends on the full serving system, not only the model. Continuous, reproducible measurements make hardware, runtime, throughput, latency, and cost tradeoffs visible.
Tags
benchmarkinferencemodelsacceleratorsservingevaluation
Comments (0)
No comments yet
Indexed by a proprietary survey. Corrections welcome.