← Back to Vibers

Builder
EleutherAI
0 Apps · 1 Intel
Intel
lm-evaluation-harness v0.4.12(github.com)
New release with four new model backends, tensor parallel support for `transformers` based models (`hf`), new benchmarks, a `TaskManager` refactor, and a long tail of task correctness fixes. ## Highlights ### New Model Backends * **TensorRT-LLM (`trt-llm`)** — NVIDIA TensorRT-LLM backend for optimized GPU inference by @Tracin in #3628 * **Megatron-LM (`megatron-lm`)** — Megatron-LM backend with TP/EP/DP support by @shangxiaokang in #3521 (with follow-up hardening in #3607) * **Intel G