Training Object Permanence in World Models
- Source
- arxiv.org
- Author
- Haotian Zhang, Fengyuan Yu, Dezhi Luo, Haoran Sun, Zehong Zhao, Qingying Gao, Yihan Li, Siyuan An, Huayi Qin, Yilan Zhang, Zhengze Jiang, Pinyuan Feng, Renrui Zhang, Ziyu Guo, Letian Wang, Mengyue Yang, Kangfu Mei, Maijunxian Wang, Ran Ji, Vikash Kumar, Freda Shi, Chandra Sripada, Vincent C. Muller, Philip Torr, Alan Yuille, Nikolaus Kriegeskorte, Felix Juefei-Xu, Lvmin Zhang, Jieneng Chen, Yilun Du, Hokin Deng
- Date

Context
WROP trains and tests video models on whether objects persist when hidden and behave consistently around solid barriers. Its synthetic scenes include objects passing behind occluders and reappearing with their identity intact. The generators vary speed, lighting and camera angle while retaining the underlying physical challenge.
The project releases a 1.5 million sample training corpus and a 300-question exam. In a blind pairwise study of outputs from 14 models, the authors' own model, the only one trained on WROP data, ranked first among those that continue an input video and third overall. That shows an effect of training on these controlled synthetic tasks, not general physical understanding, and gives researchers a focused way to examine physical consistency beyond visual polish.
- WROP is 150 hand-designed tasks inspired by cognitive science, grouped into six categories. Blender generators randomize speed, lighting, camera angle and other nuisance parameters while keeping each task's structure, yielding 10,000+ samples per task.
- The release includes a 1.5M-sample training corpus and a 300-question exam, on which the authors evaluated 14 video models: 3 reference-to-video, 7 edit and 4 continuation models.
- Their 16B world model, PWM-WROP, ranked first among continuation models and third overall in a blind pairwise Elo study, behind only a statistical tie between two reference-to-video models.
- Data, exam, model answers, scores and weights are released, along with PWM, a native-PyTorch training stack for AWS Trainium2.
articleAutoWorldModel-Bench: A State-Centric Benchmark for Automated World-Model ResearchMarjan Moodi, Xuankang Zhu, Fernando De Mesentier Silva, Harold Chaput, Mohammad Reza Taesiri
articleARC-Bench: Closed-Loop Replanning Masks Broken Action Ranking in Frozen JEPA World ModelsZhengshu Zhang, Zhiyuan Li
videoThe Best Models Still Reason Like Toddlers — Andrew Dai, ElorianAI Engineer
Checking sign-in…
Loading comments…