Code and Technical Projects · 2023–present
Live Image Generation
A live-performance system that uses an image generation model to transform a camera feed and project the newly constructed image alongside the performers.
- Role
- Design and full-stack code
- Technologies
- Python, Computer vision, Image generation, Live video
- Collaborators
- Asa Wember, Michael Yates Crowley
- Organizations
- Akademie für Theater und Digitalität
A camera captures a live video feed of a performance. An image generation model interprets a text prompt and transforms the image of the actors in real time; the generated result is projected onto the stage alongside the live action.
The system does not apply a conventional visual effect. It constructs an entirely new image from the statistical patterns in the model’s training data. When that image is projected back onto the stage, two versions of the same figure exist simultaneously: one is the live performer, while the other remains connected to the performer but operates according to a different visual logic. Because the output changes every second in response to movement, no two performances are identical.
The project was developed at the Akademie für Theater und Digitalität in Dortmund with Asa Wember and Michael Yates Crowley.
