There is a condition called synesthesia; it is an ability that is inherent, and idiosyncratic to the individual who has cross-sensory experiences derived through one type of sense. This reference reveals that individuals without this condition have multisensory neurons that are able to channel more than one sense. This source is a decent way of deriving a visual language that relates back to our own underlying multisensory abilities though the study of a conscious manifestation of multisensory phenomenon.
In this work, distinct visualizations are used to represent instruments and composition elements of a specific audio track. Informed by several accounts of multisensory experiences from various synesthetes, self-generated material is built up to create a visual composite that harnesses the essence of each instrument present in the audio composition to reinvent it into a visual space. These elements have a reference to fundamental shapes and movements that metaphorically mimic the sound associated with them to illicit a subconscious link within the audience. Relationships that form between visualizations in the first section are then manipulated once more throughout the video into an atmospheric space to reflect the locomotive force of the tempo.
My interest lies in intricate free-flowing visual design which may be constructed out of a multisensory relationship with sound. Relationships between the ability to see and the ability to listen are one of the primary concerns, along with the accuracy from one mode to visual language. Communication and translation are rudimentary themes to the work and become more apparent when coupled with Micheal Whitelaw’s concept of a signal. This signal, which mediates the positive and negative space of sensory experiences , is significant in linking two modes together. In this case, positive space becomes sound and negative space becomes sight. It is an attempt to visualize the negative spaces of an existing positive space until it becomes its own entity.
1. Ward, Jamie. The Frog Who Croaked Blue : Synesthesia and the Mixing of the Senses. London ; New York: London ; New York : Routledge, 2008.
2. Whitelaw, Mitchell. "Synesthesia and Cross-Modality in Contemporary Audiovisuals." The Senses & Society 3.3 (2008): 271-2.
Loading more stuff…
Hmm…it looks like things are taking a while to load. Try again?