Using Blender with coding agents on macOS
- Source
- simonwillison.net
- Date
Simon Willison documented a workflow for pointing ChatGPT Codex at the full macOS Blender application and driving it entirely through plain-language prompts. Instead of hand-writing Blender's Python API calls, he lets the coding agent generate and iteratively refine .blend scenes and renders, describing changes in natural language and letting the agent translate that into working scripts against Blender's scripting interface. The pattern is repeatable with any coding agent that can shell out to a local application's Python API, not just Codex, which makes it a template rather than a one-off trick. For teams doing procedural 3D work, this cuts out a step that used to require someone who actually knew Blender's scripting API, replacing it with someone who can describe the scene they want. It is a concrete example of agents extending past code editors into full creative applications with their own scripting surfaces.
Context
A coding can produce an editable 3D scene by driving Blender through code. Simon Willison reports using OpenAI's Codex on a Mac with the full Blender application installed, prompting it to render a pelican riding a bicycle and then asking twice for more flair and improvement. The post says the resulting image was generated using Blender's Python API.
Willison writes that frontier models can produce .blend files that can be edited in Blender itself, and can render images and even movies by rendering a sequence of images and combining them with ffmpeg. That general statement is what makes the output useful as a starting point for further scene work. The post does not show a .blend file or assess the image, so editability is described as a capability of the models rather than demonstrated for this particular scene.
- AI agent — An AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.
Checking sign-in…
Loading comments…