Runway's Solaris generates interfaces as frames, not code
- Source
- x.com
- Date
Today, we're sharing new research on Solaris, our first Interface World Model. Solaris is a new kind of operating system that generates interactive interfaces frame by frame, in real time, with no code. We find that Solaris outperforms frontier LLMs when generating new interfaces, across structural similarity and information retention. Read more and request early access at the link below.
Learn more: https://t.co/JklRwT9OZn
Context
Runway's Solaris explores interfaces generated as a stream of images that respond to user actions. Its research article describes a deciding how a scene should change, while a video model generates the visible response. Clicks and drags help determine subsequent frames.
This could let a visual scene respond to interactions without separately programming every behavior. The research still faces problems central to usable software: readable text, consistency through long sessions and compatibility with accessibility tools. Solaris therefore presents an early approach to interactive visual experiences, with substantial integration work remaining.
- LLM — A large language model — the neural network behind tools like Claude and ChatGPT, trained on huge amounts of text to predict what comes next.
Checking sign-in…
Loading comments…