Vibeleaderboard
Index / agent

FinTrace and PITfall

github.com/fredxing1/fintrace
Visit github.com
Category
AI Agents
Rank
No. 3072Tools index
Pricing
Open Source
Type
AGENT
Date

About

FinTrace builds auditable financial research agents that answer using only evidence available at a chosen point in time, with each claim traceable to as-filed data. PITfall is a leakage-controlled benchmark for this: the repository reports that a naive live-data agent answers 82% of impossible questions with the true future value, while the gated agent leaks none. It is research software, not investment advice.

Why it made the leaderboard

Financial LLM agents can leak future data into historical questions. This gates retrieval to as-filed evidence and ships a leakage benchmark (PITfall) to measure it.

Tags

financellm-agentsbenchmarkpoint-in-timeauditabilitypython

Tech Stack

Python

Comments (0)

No comments yet

Editorially curated, with community endorsements as a secondary signal. Corrections welcome.