Don't Want Your LLM to Recommend Nuclear Strike? Try Asking It in Japanese
Source
Rian Touchent (ALMAnaCH)
Author
Rian Touchent (ALMAnaCH)
Published
Terms in this piece · Glossary
LLM — A large language model — the neural network behind tools like Claude and ChatGPT, trained on huge amounts of text to predict what comes next.
alignment — The work of making AI systems actually pursue what their builders and users intend, rather than something subtly or dangerously different.
AI agent — An AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.
eval — A repeatable test for AI quality — a set of tasks plus scoring — used the way software teams use test suites, because model output is too variable to judge by eyeballing.
Why it matters
Safety behavior measured only in English does not transfer, and reasoning-language is an uncontrolled variable in any multilingual AI agentAn AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.Full definition → deployment or evalA repeatable test for AI quality — a set of tasks plus scoring — used the way software teams use test suites, because model output is too variable to judge by eyeballing.Full definition → suite.
articleDiagnostic Foundation for Evaluating LLMs' Research Integrity as Co-ScientistsYash Tripathi, Silu Sharma, Sai Sidhanth Manoharan Jayanthi, Shivank Garg, Lin Li
articleOptimismBench: Forecasting Bias and the Alignment Effect in Language Model JudgmentSeonglae Cho, Adriano Koshiyama
articleEven More Deception: Objective Misalignment in Mixed-Motive LLM Multi-Agent SystemsMarylou Fauchard, Florian Carichon, Margarida Carvalho, Golnoosh Farnadi