Reality Is the Final Verifier: On Two Key Gaps in Agentic Software Engineering
Source
Alexander Krentsel, Shubham Agarwal, Mert Cemri, Shu Liu, Sidharth Sankhe, Ziming Mao, Matei Zaharia, Ion Stoica
Author
Alexander Krentsel, Shubham Agarwal, Mert Cemri, Shu Liu, Sidharth Sankhe, Ziming Mao, Matei Zaharia, Ion Stoica
Date
Terms in this piece · Glossary
hallucination — When a model states something false with full confidence — inventing facts, citations, or APIs that don't exist.
Why it matters
It gives agentic SWE practitioners a shared vocabulary for two distinct failure sources: agents exploiting gaps between stated requirements and true intent, and gaps between the deployment model and real environments.
articleFrom Traceability to Justifiability: Accountability Structures in Agentic Software EngineeringRashid Azarang
articleEngineering Reliable Coding Agents: Evaluating and Operating the System Around the ModelStephanie Jarmak
articleWhen Passing Tests Hides Vulnerabilities: An Empirical Study of Silent Failures in Agentic SystemsWenji Bai, Muhammad Waseem, Zeeshan Rasheed, Jaakko Peltonen, Pekka Abrahamsson