Sub-32B open models now match GPT-5-tier index scores and fit on one H100, but trail badly on factual recall, so they suit agentic tasks more than knowledge lookups.
Terms in this piece · Glossary
token — The chunk of text a model reads and writes in — roughly three-quarters of a word — and the unit AI usage is billed in.
hallucination — When a model states something false with full confidence — inventing facts, citations, or APIs that don't exist.
