Runway's GWM Worlds 2 turns world models into open-ended steerable simulations
- Source
- x.com
- Date
Today, we're sharing new research on GWM Worlds 2. Our latest General World Model that generates interactive real-time simulations in continuous 720p video at 24 fps with 48000 Hz audio. Built on top of our foundational audio-visual generation model, GWM Worlds 2 allows you to define the environment, subjects, visual style, physical rules and ambience of any world. Once inside, you steer it with text actions addressed to any subject or to the scene itself, alongside continuous camera motion. The world continues from each new input instead of following a fixed clip or script so sessions have no preset length. GWM Worlds 2 creates a new foundation for interactive entertainment, virtual characters, robotics and embodied-agent simulation. Learn more about GWM Worlds 2 at the link below.
Learn more: https://t.co/qYwOPJ3vW5
Context
Runway presents GWM Worlds 2 as a research system that generates a continuing audiovisual world in response to user actions. Its WorldPrompt format combines a persistent scene description and starting image with timed actions and camera movement. Users can direct characters or change their surroundings as generation continues, without a preset session length. The research report builds on the company's earlier GWM Worlds work.
Interaction still depends on how actions are supplied. Runway says its live demo maps keys and mouse inputs to prepared prompts, while more detailed actions written beforehand currently produce better quality. This makes the control interface an important part of the generated experience. Demo description
Checking sign-in…
Loading comments…