Controlling Blender with AI Coding Agents on macOS
Simon Willison demonstrated a straightforward workflow for prompting AI coding agents on macOS to automatically script and render 3D scenes in Blender. By instructing the agent to utilize the locally installed `/Applications/Blender` binary, the AI generates Python code that programmatically builds and renders detailed 3D artwork. This technique showcases how autonomous coding agents with local execution capabilities can expand into creative multimedia domains like 3D computer graphics. It demonstrates that powerful desktop applications with native Python APIs can be directly orchestrated by LLMs without needing complex custom plugins. The agent runs Blender headlessly via the command line to execute generated scripts utilizing Blender's built-in `bpy` Python module. Users can iteratively refine complex scene elements, lighting, materials, and camera positioning simply by giving follow-up natural language instructions.
## BACKGROUND
Blender is a widely used open-source 3D creation suite that embeds a full Python interpreter and provides the `bpy` module to give scripts complete programmatic access to its features and data structures. AI coding agents are tools powered by large language models that can read and write files, execute terminal commands, and solve programming tasks on a user's machine.