Filmmaker works on a short film with AI image generation software cc Reinhard W. Wolf (created with Stable Diffusion 2.1)
On June 26, production company Waymark released “The Frost,” a 12-minute short film created entirely with the help of AI tools that is nearly indistinguishable from non-machine-imaging films.
The source for the production of “The Frost” was an original script by producer Josh Rubin, thus feeding the OpenAI imaging model DALL-E 2. After a few attempts to get the model to generate images in a style they were happy with, the filmmakers used DALL-E 2 to generate individual shots. Then they used D-ID, an AI tool that can add motion to still images, to animate those shots.
The result, a film about a group of people in an Arctic world is heavily influenced by the guidelines of DALL-E, which favors fantasy styles. “We built a world out of what DALL-E gave us back,” producer Rubin commented. “It’s a strange aesthetic, but we welcomed it with open arms. It became the look of the film.”
Waymark is a Detroit studio that provides tools for making commercials and corporate films.
DALL-E 2 is a computer program developed by OpenAI that can create images from text descriptions based on machine learning.
“The Frost” on YouTube: https://www.youtube.com/watch?v=QW-NFkVDfdA
URL: Making of auf YouTube: https://www.youtube.com/watch?v=p31COxNbTWs
URL DALL-E 2 https://openai.com/dall-e-2
featured image: Filmmaker works on a short film with AI image generation software cc Reinhard W. Wolf (created with Stable Diffusion 2.1)