MetaSpace: Metamorphic Testing for Spatial Cognition in Embodied Agents
Source
Gengyang Xu, Dongwei Xiao, Yiteng Peng, Shuai Wang
Author
Gengyang Xu, Dongwei Xiao, Yiteng Peng, Shuai Wang
Date
Terms in this piece · Glossary
AI agent — An AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.
eval — A repeatable test for AI quality — a set of tasks plus scoring — used the way software teams use test suites, because model output is too variable to judge by eyeballing.
Why it matters
Task-success rates hide agents that finish by unsafe or incoherent means. Encoding invariants as executable rules and replaying them over real trajectories is an evalA repeatable test for AI quality — a set of tasks plus scoring — used the way software teams use test suites, because model output is too variable to judge by eyeballing.Full definition → pattern that extends past robotics.
articleRepository-Aware Metamorphic Relation Generation for Augmented Reality Applications using Large Language ModelsDibyendu Brinto Bose, Jiawei Qin, Chris Brown
articleTangent: An Empirical Study of Testing Practices for LLM-Based Agent ApplicationsRangeet Pan, Tyler Stennett, Divya Sankar, Bridget McGinn, Alessandro Orso, Raju Pavuluri, Saurabh Sinha, Maja Vukovic
articleFantastic Adaptive Taxonomies and How to Use ThemMert Cemri, Andrei Cojocaru, Melissa Pan, Shu Liu, Shubham Agarwal, Alexander Krentsel, Jay Tang, Kannan Ramchandran, Joseph E. Gonzalez, Matei Zaharia, Alex Dimakis, Ion Stoica