The Parser Already Knows: Lightweight Bias Correction in Constrained Decoding
Source
I\c{s}{\i}l \"Ozg\"u, Yaoxuan Wu, Guy Van den Broeck, Miryung Kim
Author
I\c{s}{\i}l \"Ozg\"u, Yaoxuan Wu, Guy Van den Broeck, Miryung Kim
Date
Terms in this piece · Glossary
structured output — Forcing a model's response to match a schema, so downstream code can parse it instead of guessing at prose.
token — The chunk of text a model reads and writes in — roughly three-quarters of a word — and the unit AI usage is billed in.
Why it matters
structured outputForcing a model's response to match a schema, so downstream code can parse it instead of guessing at prose.Full definition → and tool-call schemas run through constrained decoding everywhere, and this removes the quality-versus-latency compromise those pipelines currently accept.
articleVoice Memory for Agentic Speech RecognitionChao-Han Huck Yang, Zih-Ching Chen, Piotr Zelasko, Zhehuai Chen, Jagadeesh Balam, Boris Ginsburg
articleA Closed-Loop Control Architecture for Reliable Constraint Satisfaction in LLM Text GenerationQuan Zhou, Shahbaz Siddeeq, Mika Saari, Pekka Abrahamsson
articleCompound Prompt Constraints in LLM Code Generation: A Factorial Study of Format, Persona, and UrgencyShrenik Jadhav, Nickalsa LaPlaca, Caleb Stone, Ashok Raja, Omar Ochoa, Vidhyashree Nagaraju