Selecting Open-Weight Language Models for Zero-Shot Intent Classification: A Systematic Evaluation of 41 Models
Source
Parishruthi Ganesh, Gerry Dozier, Cheryl Seals
Author
Parishruthi Ganesh, Gerry Dozier, Cheryl Seals
Date
Terms in this piece · Glossary
open weights — A model whose trained parameters are published for anyone to download and run — unlike API-only models you can access but never possess.
calibration — How well a model's confidence matches reality — a calibrated model saying "90% sure" is right about 90% of the time.
Why it matters
Concrete evidence that parameter count is the wrong selection axis for classification-style routing: tuned 3B models beat larger base models, and the benchmarks most people cite no longer separate anything.
articleOptimismBench: Forecasting Bias and the Alignment Effect in Language Model JudgmentSeonglae Cho, Adriano Koshiyama
articleWhen Synthetic Users Fail: A Cross-Domain Benchmark of LLM-Simulated Human Survey ResponsesZihan Chen, Di Zhu, Lei Nico Zheng
articleTraining Compute-Optimal Large Language ModelsJordan Hoffmann et al.