First, the soundtrack was composed according along the theme "Life". Nobumichi Asai and Shingo Abe was inspired by the music and then made face mapping work. Aya Sato designed choreography. TOKYO completed the project by making the video work.
The music brought Asai the image of “the radioactive.” The destructive force of the radioactive could cause “death,” “suffering,” and “sorrow.” And “prayers” could overcome them. These subjects infuse AYABAMBI’s powerful performance. Their performance crushes and conquer black tears, skulls and the Heart Sutra. We built up the concept during the production and Abe designed animation for face mapping.
There was a big challenge in technical aspects. We realized the new mapping system that allows us to follow intense performances by using the latest 1,000 fps projector, DynaFlash(*1) and a super speed sensor. It is very new and it had not been done before. Projected images become part of their skin and they transform their faces.
At the beginning of our development, there was an issue, AYABAMBI would loose freedom of performances if we accelerated the tracking speed. Asai, Yoshimura (WOW), Lecturer Watanabe and Teshima (EXVISION) explored how we could keep the tracking speed securing the freedom of performances, taking three months of trial and error to reduce a few milliseconds. And we finally developed this system(*2).
*1 “DynaFlash” is developed jointly by Ishikawa Watanabe Laboratory, the University of Tokyo and is commercialized by Tokyo Electron Device Limited.
*2 For tracking hands, we use the dynamic projection mapping technology developed by Ishikawa Watanabe Laboratory, the University of Tokyo. For tracking faces, we use the face mapping technology developed by the visual design studio, WOW inc.
Experimental project with dynamic projection mapping by Skullmapping (skullmapping.com)
Directed and animated by Filip Sterckx /
Concept by Filip Sterckx + Antoon Verbeeck /
Paintings by Antoon Verbeeck /
3D modeling by Birgit Sterckx /
Sounddesign by Roundhouse /
Mocap actor: Nicolas Vanhole /
Created with the Mirror Head and MDC-X by Dynamic Projection Institute (dynamicprojection.com)