Computer use in Codex
- Source
- youtube.com
- Author
- OpenAI
- Date
Context
Codex's computer-use design draws on textual information about an application's interface as well as screenshots. In OpenAI's walkthrough, the developers explain that accessibility information describes interface elements and can expose content beyond the visible portion of a window. That gives the model another way to understand what it can interact with. Watch the walkthrough.
Because some interactions can use this textual representation, they need not always depend on an image-capable model. The presenters connect that design to using the faster Codex Spark model for computer tasks. The useful insight is that an 's interface to software can affect which models can operate it, as well as how the agent finds controls. See the accessibility explanation.
- AI agent — An AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.
Checking sign-in…
Loading comments…






