Your agent can find the policy, understand it, and still violate it. That happen
Source
AlphaSignalAI
Author
AlphaSignalAI
Date
Terms in this piece · Glossary
benchmark — A standard public test set for comparing AI models — the shared scoreboards behind every "model X beats model Y" claim.
context window — The maximum amount of text a model can consider at once — its working memory for the current conversation or task.
AI agent — An AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.
Why it matters
Per-step accuracy compounds: 99% across 100 decisions is ~37% end-to-end. A bigger context windowThe maximum amount of text a model can consider at once — its working memory for the current conversation or task.Full definition → keeps a rule available but doesn't make it binding — that needs checkpoints, action gates and verification of what the AI agentAn AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.Full definition → actually changed.
