Vibeleaderboard
Index / tool
Visit github.com
Category
AI Tools
Rank
No. 2181Tools index
Pricing
Open Source
Type
TOOL
GitHub
270 stars
Date

About

Jeeves is a 9B decision model built on Qwen3.5-9B with LoRA and a pointer head that reasons before it decides. It handles yes/no, multiple-choice and rating questions in one request through a Jev-compatible API, with a diffusion drafter for speed. The repository reports 0.889 on held-out test data versus 0.822 for Kev-9B and 0.857 for Jev, and includes training code and data.

Why it made the leaderboard

It gives teams a self-hostable, Jev-compatible LLM judge for yes/no, multiple-choice, and rating evaluation with published benchmark gains over prior open judge models, useful for building eval pipelines.

Tags

llmclassifierreasoningqwenloratraining

Tech Stack

Python

Comments (0)

No comments yet

Editorially curated, with community endorsements as a secondary signal. Corrections welcome.