Yu Hou, Hal Daum\'e III, Rachel Rudinger, William Walden
Date
Why it matters
If you run LLMA large language model — the neural network behind tools like Claude and ChatGPT, trained on huge amounts of text to predict what comes next.Full definition → judges or collect preference data on cited answers, citation count and diversity are quietly moving the scores — and model judges weigh them differently from humans, without seeing the sources.
Terms in this piece · Glossary
LLM — A large language model — the neural network behind tools like Claude and ChatGPT, trained on huge amounts of text to predict what comes next.
articleSelf- and Other-Labels Induce Bidirectional Bias in LLM JudgesSongeun Chae, Min Kim, Donghoon Jung, Seojin Choi, Seohyon Jung
articleInter-dimension Dependence for Multi-Dimensional Evaluation of Open-Ended TextHaoyuan Li, Snigdha Chaturvedi
articleLLM Judge Validation Under Sparse Overlap: From Inference to DesignJunxuan Li, Arko Mukherjee, Soumyabrata Pal