
Chatbot Arena rankings, often cited as ground truth for model quality, can be inflated up to 112% through private variant testing and disproportionate battle-data access — engineers relying on these leaderboards to pick models should discount rankings accordingly.
Sign in to comment.
Loading comments…