Diverse reasoning traces teach LLMs to make better decisions
Source
www.amazon.science
Date
Terms in this piece · Glossary
fine-tuning — Taking a trained model and training it a bit more on your own examples so it gets better at one specific job.
token — The chunk of text a model reads and writes in — roughly three-quarters of a word — and the unit AI usage is billed in.
Why it matters
Self-consistency only helps when sampled reasoning paths actually differ. Training with global forking tokenThe chunk of text a model reads and writes in — roughly three-quarters of a word — and the unit AI usage is billed in.Full definition → gives a single model explicit handles for distinct reasoning modes, so diversity comes from the model rather than temperature.
articleCategories of Inference-Time Scaling for Improved LLM ReasoningSebastian Raschka, PhD
articleControlling Reasoning Effort in LLMsSebastian Raschka, PhD
articleAre the Financial Reasoning from LLMs Credible? A Real World Test over Long-Horizon StatementsXinke Tong, Xuanming Zhang, Tianyi Tang, An Yang, Jiatu Hu, Guojie Lin, Zhenzhen Shi, Lingfeng Zeng, Boyu Yang, Bing Zhao, Hu Wei, Lin Qu, Dayiheng Liu