Do GUI Agents Know When Not to Act? Enabling Conflict-Aware Termination for Multimodal GUI Agents
- Source
- arxiv.org
- Author
- Zhaoyuan Huang, Tianjie Ju, Pengzhou Cheng, Zheng Wu, Yansi Li, Chuanbiao Song, Jun Lan, Huijia Zhu, Weiqiang Wang, Zhuosheng Zhang
- Date

Context
An that operates a screen needs to recognize when a request cannot be carried out coherently. CONFLICTGUI tests instructions that contradict themselves or conflict with the visible interface. The authors report that agents capable of completing ordinary tasks often keep acting in these situations. Their proposed CONFLICTGUARD framework checks the instruction's logic and screen evidence before action, then steers the agent toward stopping when execution is inappropriate. Across five tested agents, the authors report better handling of conflicting tasks while preserving ordinary task performance. The contribution is a way to test and improve appropriate stopping as part of interface automation. Study abstract.
- AI agent — An AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.
- benchmark — A standard public test set for comparing AI models — the shared scoreboards behind every "model X beats model Y" claim.
- inference — Running a trained model to get answers — the phase where AI is actually used, as opposed to trained.
articleGUI-CC: Benchmarking Contextual Consistency of GUI World Models as Agent EnvironmentsLin Fu, Zheyuan Yang, Tianhui Zhang, Jinbiao Wei, Guo Gan, Boxu Liu, Yilun Zhao, Yu Rong
articleLegacyWorld: Atomicity-Aware Evaluation of GUI Agents for Legacy WorkflowsThilo Reintjes, Sivajeet Chand, Derui Zhu, Sushant Kumar Pandey, Alexander Pretschner
articleUI-Venus-2 Technical ReportVenus Team, Zhuohan Cai, Haoxing Chen, Jiaxuan Chen, Weizhi Chen, Changlong Gao, Zhangxuan Gu, Yuan Guo, Yusong Hu, Jianrong Jiang, Jianguo Li, Runze Li, Jinzhen Lin, Zhenyu Ma, Changhua Meng, Han Peng, Xinyu Qiu, Shuheng Shen, Zhongyi Shui, Weiqiang Wang, Ming Wen, Zhuoer Xu, Hang Yan, Kaiwen Yang, Ruilin Yao, Nanjun Yu, Zhengwen Zeng, Lianrui Zhang, Yunzhu Zhang, Zhe Zhao, Beitong Zhou
Checking sign-in…
Loading comments…