See "HD" version here --> youtube.com/watch?feature=player_detailpage&v=E-PZMsENml4
Building from the previous tech test, I now have 2 axies for the mesh. The first is the frequency response / FFT data displayed linearly (no log scale yet). and the second axis is time.
So basically the FFT data "flows" down the time axis and in the process "sculpts" the mesh.
The end goal is that the player can explore/navigate this terrain as its being generated, think first person Sonic. Having multi-track audio data will allow me to create a mesh for each track, --> player gets to explore and switch between the different tracks on the fly and see them around him/her.
The next step will be to get Unity's physics to play nice so that the player can go up and down the sculpted terrain.
The video above is still with single track audio. It's maxing out Unity's FFT function to fetch 8192 points of data, of which only the first 128 are used in this case. So what we're seeing in the video is are the low frequency sounds, mainly beat and bass guitar in this case of this song.
Music: Unknown Intent- Plastic Fantasic by The Electric Bends --> electricbends.bandcamp.com/
Loading more stuff…
Hmm…it looks like things are taking a while to load. Try again?