Workflow · Breakthrough Workflows
Curious Refuge films a real actor, then lets AI rebuild the world around them
Curious Refuge is exploring a filmmaking approach that begins with an actor rather than an AI prompt. The team films the performance first, then uses image and video models to transform the world around it.
Reporting updated Sep 23, 2026
THE TAKEAWAY
Curious Refuge is exploring a filmmaking approach that begins with an actor rather than an AI prompt. The team films the performance first, then uses image and video models to transform the world around it.
What Happened
An actor stands in a simple gray-box environment. The performance is already there: the gestures, movement and timing have been captured. Now imagine turning that ordinary space into a dramatic cliffside location without filming the scene again. That's the idea behind a hybrid filmmaking experiment from Curious Refuge. The team begins with live-action footage and creates a redesigned first frame using image-generation tools including GPT Image 2.5 and Seedream. Seedance 2.5 then generates a new video using the original performance as guidance. In some tests, the filmmakers also use depth maps to describe the spatial relationships and movement in the original shot. But the experiment reveals an important limitation. A transformed shot can look beautiful while quietly changing the performance. The team documented disappearing props, unexpected object changes and gestures that drifted away from the source footage.
Why It Matters
For independent filmmakers, this offers a different way to approach AI production. Instead of asking a model to invent everything, directors can begin with performances they've actually directed. The challenge becomes preserving those performances while changing the world around them.
VEYR Angle
The interesting possibility is giving filmmakers more control over human performance while expanding the environments they can create. An actor's gesture may be more important to a scene than the spectacular background surrounding it. Curious Refuge's experiment is a reminder that the two have to work together.
