Vibeleaderboard
← All Intel
Intel / post

Cua's RL-Trained Decision Model Hits 92.9% on GUI-360, Open-Sourced

Source
Cua
Date
Cua@trycua
Thread · 7 parts

1/ Today we're introducing Cua-S1-4B-0.2, the first multimodal decision model trained with RLOO on live computer-use tasks, using task-completion rewards. Text and multimodal adapters are available under Apache-2.0: https://t.co/0R5fWjfpGg

2/ At each step, the CUA-S1 model receives the screen state, the task goal, and a fixed set of candidate actions. It returns one action. The environment changes, and the next step starts from the new state.

3/ The training recipe has two stages. Supervised training teaches the decision format. Agentic RL then runs the model in live cua-bench-basic environments, where only a completed task earns the environment's reward.

4/ On the same held-out tasks, Cua-S1-4B-0.2 completes 17/18 text episodes and 13/18 multimodal. Zero-shot djev completes 16/18 and 12/18.

Read the full thread on X
Key takeaways · AI-distilled
  • Training has two stages: supervised training teaches the decision format, then agentic RL with RLOO runs the model in live cua-bench-basic environments where only a completed task earns the environment's reward.
  • At each step the model gets the screen state, the task goal and a fixed set of candidate actions, and returns one action; the environment then changes and the next step starts from the new state.
  • On held-out tasks, Cua-S1-4B-0.2 completed 17 of 18 text episodes and 13 of 18 , versus 16 and 12 for zero-shot djev, a much smaller gap than the 92.9% versus 60.1% result on the frozen 168-task GUI-360 split.
  • Both GUI-360 runs used the same inputs and scoring with no accessibility tree. The training code and results are merged into the Cua repo, and a Hugging Face Space lets users see how the model scores candidate actions.
Terms in this piece · Glossary
  • multimodalA model that works with more than text — reading images, audio, or video, and sometimes generating them too.
  • benchmarkA standard public test set for comparing AI models — the shared scoreboards behind every "model X beats model Y" claim.
  • open weightsA model whose trained parameters are published for anyone to download and run — unlike API-only models you can access but never possess.
Why it matters

A concrete, reproducible RL recipe and for training small models to make GUI decisions from raw screen state, without needing an accessibility tree.

More from Cua
Recommended reads
Comments

Checking sign-in…

Loading comments…