AUDIO-REACTIVE PHOTOGRAPHS
Conventionally, photographs tend to rely solely on its visual presentation. This experiment aims to explore how we can introduce the element of sound into the experience of viewing photographs made possible through creative coding. The soundscapes is a combinition between sounds sourced online and recorded on-site.
THE SOUNDS OF
STILL PHOTOGRAPHS
CAN WE HEAR PHOTOGRAPHS?
This mini project came to be during a casual photo walk at Orchard Road, where I captured street portraits of the performing buskers. I wanted the picture to encapsulate the soundscapes where it lives in, for the viewers to better understand the scene. Furthermore, I also wanted to explore the possibility of combining the world of street photography with creative coding.
EXTRACTING THE
AUDIO DATA
MAKING IT AUDIO-REACTIVE
After compiling a soundscape relevant to the relevant photographs, it was placed into TouchDesigner to isolate and extract specific audio data regarding to each part of the soundscape (I.E Isolating Sound of Traffic, Er Hu instrument). With these individual audio data, it was then normalized and mapped them to trigger it's corresponding boxes, for example, letting the sound of Er Hu trigger the appearance of the Er Hu box and text. This was done for the different components in the photograph and soundscape to create the audio-reactive visual.