Can Skills Learned in Games Transfer to Real-World Work?
- Source
- latent.space
- Author
- Richard MacManus
- Date

Context
Good Start Labs, which builds AI training environments, reports that the way it taught a railroad game determined whether learning carried over to financial research. Training a roughly 30-billion-parameter model to answer isolated questions about game states improved game performance but left its score on a subset of the Finance- essentially unchanged, 21.7% against 22.0%.
Training it instead as a terminal agent, using tools to read the game state and plan across a full game, improved results on real company-filing research questions in the same benchmark, from 12.1% to 18.3%. The company's write-up attributes much of that gain to fewer confident false claims rather than more finance knowledge. The two designs were evaluated in separate runs with their own baselines, so their percentages are not directly comparable, and the experiment supports transfer between similarly structured workflows, not broad financial expertise from game mastery.
- Good Start Labs found only one of two training designs on the board game 1830 transferred to real work: single-turn Q&A improved in-game play but not a finance benchmark, while a multi-turn terminal agent that explores and adapts improved both.
- a model on the strategy game Diplomacy improved its performance on customer-support and industrial-operations benchmarks, says Good Start Labs' Alex Duffy, evidence strategic reasoning learned in a game can transfer to unrelated work.
- In a 2025 Twitch stream, OpenAI's o3 won Diplomacy by planning betrayals while Anthropic's Claude Opus 4 refused to lie and lost, a personality divergence (betrayal, collaboration, theory of mind) Good Start Labs says persists in newer frontier models too.
- Good Start Labs' CEO says design matters more, not less, as models improve: GPT-6 Astra jumps to answers with less visible reasoning, so forcing it to work in code rather than silently is what makes its output trustworthy.
- Good Start Labs sells two data products to frontier labs: anonymized trajectories of agents playing games, and custom data from agents live inside game publishers' own titles, plus full game environments models can play end to end.
- AI agent — An AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.
- benchmark — A standard public test set for comparing AI models — the shared scoreboards behind every "model X beats model Y" claim.
- fine-tuning — Taking a trained model and training it a bit more on your own examples so it gets better at one specific job.
- agent harness — The scaffolding around a model that turns it into a working agent — the loop, the tools it can call, and the rules for when to stop.
articleCrossing the Threshold: How OpenAI and Anthropic Approach Autonomy and Safety in Financial Agents
articleHow Anthropic’s Dynamic Workflows Coordinate Claude Agents
articleCan a Cloud-Native Harness Make Agents Reliable Beyond the Desktop?
articleInside-Out AI: Rebuilding Airbnb Behind the Scenes and Across the Guest Experience
Checking sign-in…
Loading comments…


