Autolume MzTon is a result of research-creation at the Metacreation Lab for creative AI to develop new generative video approach conditioned on sound. The piece is a cinematic music video for the track Mzton by French collective robonom. Since 1999, robonom has been producing generative music using a unique networked approach to analog sound synthesis and experimental music. Autolume is a video generation system. The heart of Autolume in an adversarial neural network custom-trained on a corpus of selected public domain pictures of modern and abstract paintings. Audio features are extracted from the soundtrack and used to guide the exploration of the neural network’s latent space. The system's output has surprising analog and organic qualities in colors, shapes and dynamics. The piece is reminiscent of early experiment cinema or "cinema without a camera".
Credits: Metacreation Lab
Artistic direction: Philippe Pasquier
Music: robonom
Visual programming and generation: Jonas Kraasch
Sound engineering and video editing: Kristian Voveris
