Who Do Language Models Think Is Competent? A Mechanistic Analysis of Occupational Bias
Source
arxiv.org
Author
Keren Fuentes, Aaron Mueller
Date
Why it matters
Clean behavioral bias scores do not mean the representation is clean — intervening on a model's internal estimate of user expertise changes its output, so output-only evalA repeatable test for AI quality — a set of tasks plus scoring — used the way software teams use test suites, because model output is too variable to judge by eyeballing.Full definition → suites can miss the disparity entirely.
Terms in this piece · Glossary
eval — A repeatable test for AI quality — a set of tasks plus scoring — used the way software teams use test suites, because model output is too variable to judge by eyeballing.
articleWhy Better Models Can Create Riskier Systems: Evidence from LLM Agents in Financial MarketsJillian Ross, Eric So, Zoe De Simone, Charles Pozniak, Andrew W. Lo
articleRegister Bias in Complexity-Based Large Language Model RoutingSimran Koul
articleDiagnostic Foundation for Evaluating LLMs' Research Integrity as Co-ScientistsYash Tripathi, Silu Sharma, Sai Sidhanth Manoharan Jayanthi, Shivank Garg, Lin Li