The first AI-generated Films
Film production is a huge industry that could benefit immensely from the advances in Artificial Intelligence (AI).
A few attempts to use AI in filmmaking have resulted in minor content and major news buzz. The deepfake algorithm uses the same Generative Adversarial Networks (GANs) to detect faces and replace them with other faces. That could be help save on expensive actors, assuming the actor agrees that his image is being used but without him having to act, and computer graphics. It could be use to dig some big names out of their grave and give them new roles such as Bruce Lee in the Matrix.
The deepface uses the same GAN algorithm that we use at ALAgrApHY to generate faces of non-existing people in 2016 and later on in 2019 by NVIDIA hi-res hyper realistic faces: www.thispersondoesnotexis.com.
Another huge buzz on social networks was claimed by the fully acted “Sunspring” that uses Recursive Neural Networks (RNNs) from deep
learning to generate text based on already seen text, in this case it was thousands of movie scripts.
These are all great first steps towards AI-assisted filmmaking or AI-generated cinema-on-demand. However, with the advances in deep learning methods and GPU processing power, much more can be expected, not to replace filmmakers but to assist them and help them express their ideas more efficiently.
As a filmmaker, artist and expert in Artificial Intelligence, I have been passionately following these topics with great interest and dedication. One of the rather simpler applications of AI in filmmaking uses GANs for the stylization in the post-production.
It takes a lot of GPU to render this at full HD and much more at 4k, however, it is worth the investment. AI-generated clips can have cartoon-ish style or feel.
In order to fully generate a clip from scratch, much more is required. The biggest challenge is in breaking the footage into meaningful features that the machine can understand. The second biggest challenge is in optimizing the computational power to be able to generate a decent short film in high resolution. A more detailed study of project’s requirements in
terms of time, equipment and human resources for an expected outcome is available upon request. How would you like to invest in the first machine that will write, direct, produce a film? How would you like to invest in the first Cinema-on-demand. Contact me for more information!
EDIT: a huge step towards AI-generated film could be achieved via DVD-GAN currently with tiny animations but one day with feature films, thanks to Merzmensch Kosmopol for the reference!