I ran an experiment: how far can agentic AI go from idea to final delivery, with me directing and an AI agent doing the work?
Starting point: a simple video shot on my iPhone. End result: a fully composited VFX shot with camera tracking, layer separation, simulated physics, storm effects, and a final grade, delivered as a broadcast master, plus the edit and the vertical version you're watching.
Everything in between was executed by an AI agent (Claude Code) driving DaVinci Resolve, Python, and ffmpeg through natural language:
- AI background removal and character matting for clean layer separation
- Camera tracking and ground-plane matchmoving, solved from the footage itself
- Character transformation with MiniMax H3
- Real stock VFX elements found and pulled through APIs, then conformed and composited: rain, fog, embers, lightning
- Physics-based effects: impact-synced camera shakes, tracked ground cracks, debris with real gravity
- Interactive lighting synced to the lightning in the plate
- Full finishing: color grade, bloom, anamorphic streaks, grain, cinemascope
- Editing, VFX breakdown, rendering, and even this 9:16 version, recomposed shot by shot
I approved every creative decision. The agent did the labor. That division of work is the whole point: this is what the pipeline looks like when one person with taste can direct a machine that executes.
Tools: Claude Code + DaVinci Resolve MCP, MiniMax H3, Comfyui, RobustVideoMatting, OpenCV, ffmpeg, Pexels/Pixabay APIs
#agenticAI #VFX #AIfilmmaking #DaVinciResolve #ClaudeCode #MiniMaxh3 #filmmaking #AIVideo #comfyui
Starting point: a simple video shot on my iPhone. End result: a fully composited VFX shot with camera tracking, layer separation, simulated physics, storm effects, and a final grade, delivered as a broadcast master, plus the edit and the vertical version you're watching.
Everything in between was executed by an AI agent (Claude Code) driving DaVinci Resolve, Python, and ffmpeg through natural language:
- AI background removal and character matting for clean layer separation
- Camera tracking and ground-plane matchmoving, solved from the footage itself
- Character transformation with MiniMax H3
- Real stock VFX elements found and pulled through APIs, then conformed and composited: rain, fog, embers, lightning
- Physics-based effects: impact-synced camera shakes, tracked ground cracks, debris with real gravity
- Interactive lighting synced to the lightning in the plate
- Full finishing: color grade, bloom, anamorphic streaks, grain, cinemascope
- Editing, VFX breakdown, rendering, and even this 9:16 version, recomposed shot by shot
I approved every creative decision. The agent did the labor. That division of work is the whole point: this is what the pipeline looks like when one person with taste can direct a machine that executes.
Tools: Claude Code + DaVinci Resolve MCP, MiniMax H3, Comfyui, RobustVideoMatting, OpenCV, ffmpeg, Pexels/Pixabay APIs
#agenticAI #VFX #AIfilmmaking #DaVinciResolve #ClaudeCode #MiniMaxh3 #filmmaking #AIVideo #comfyui
- Категория
- AI Картинки
Выполните вход или зарегистрируйтесь для отправки комментария.
Комментариев нет.
