Vibeleaderboard
Index / tool
Visit github.com
Category
Developer Tools
Rank
No. 3698Tools index
Pricing
Open Source
Type
TOOL
GitHub
1 stars
Date

About

A minimal Python script that scores a RAG pipeline against a golden set of questions and reference answers. It reports retrieval recall at K, answer faithfulness, answer relevance, exact match and token F1, plus latency and estimated judge cost. You supply a retriever function and a generator function, so failures in retrieval or generation show up before users hit them.

Tags

ragevaluationpythonllmgolden-setretrieval

Tech Stack

Python

Comments (0)

No comments yet

Editorially curated, with community endorsements as a secondary signal. Corrections welcome.