Vibeleaderboard
← All Intel
Intel / post

Agentic Vision turns image understanding into a think, act, observe loop

Source
x.com
Date
Google AI@GoogleAI

Introducing Agentic Vision — a new frontier AI capability in Gemini 3 Flash that converts image understanding from a static act into an agentic process. By combining visual reasoning with code execution, one of the first tools supported by Agentic Vision, the model grounds answers in visual evidence and delivers a consistent 5-10% quality boost across most vision benchmarks. Here’s how the agentic ‘Think, Act, Observe’ loop works: — Think: The model analyzes an image query then architects a multi-step plan — Act: The model then generates and executes Python code to actively manipulate or analyze images — Observe: The transformed image is appended to the model's context window, allowing it to inspect the new data before generating a final response to the initial image query Learn more about Agentic Vision and how to access it in our blog ⬇️ https://t.co/UdSOuF2YXY

Context

Agentic Vision lets Gemini 3 Flash inspect an image through intermediate steps before answering. Google DeepMind describes a loop in which the model plans an investigation, writes and runs Python to crop or annotate the image, and then examines the resulting image as additional input. A small detail can therefore receive a closer inspection within the same task. Technical explanation.

The feature depends on enabling code execution. At launch, the model could decide to zoom into fine details, while operations such as rotation or visual arithmetic could still require an explicit request.

Terms in this piece · Glossary
  • agentic loop — The cycle an agent runs in: decide, call a tool, read the result, decide again — repeating until the goal is met or a stop condition fires.
  • context window — The maximum amount of text a model can consider at once — its working memory for the current conversation or task.
More from Google AI
Recommended reads
Comments

Checking sign-in…

Loading comments…