More
Speech representation in Processing. Work in progress for an interactive installation based on para-linguistic elements in a conversation.

Credits

17 Likes

Tags

  • whitekross 2 years ago
    nice, really like it
  •  
  • Kyle McDonald 1 year ago
    It looks like... height corresponds to amplitude/volume and the jitteriness corresponds to the fricatives/noisy sounds? At first I thought the silences made the jitter, which gave me an image of words floating off in the wind...
  • Jori de Goede 1 year ago
    You're almost right... Height corresponds to the frequency, the darkness of the lines to amplitude and the jitterness to the noisiness of the words to give the feeling of blowing the lines away.
  • Kyle McDonald 1 year ago
    Wow -- frequency was my initial guess for height, but it was so smooth I ruled that out. What were you using for the pitch detection?
  • Jori de Goede 1 year ago
    I used Max/MSP with a pitch detection external called Fiddle~. I use the OpenSoundControl protocol to send the data to Processing.
  •  
  • Alex Stanciu 1 year ago
    That's really really cool. Does it work live? I'd have a blast with this and a microphone :)
  • Jori de Goede 1 year ago
    Yeah it does. It all works in real-time.
  •  
  • vjdrmo plus 1 year ago
    fantastic! i want to see what the final installation looks like
  •  
This conversation is missing your voice. Take five seconds to join Vimeo or log in.

Advertisement

1 Related collections

Albums Albums

Statistics

  •  
    plays
    likes
    comments
  • Total
    plays 698
    likes 17
    comments 8
  • Dec 3rd
    plays 1
    likes 0
    comments 0
  • Dec 2nd
    plays 0
    likes 0
    comments 0
  • Dec 1st
    plays 1
    likes 0
    comments 0
  • Nov 30th
    plays 0
    likes 0
    comments 0
  • Nov 29th
    plays 0
    likes 0
    comments 0
  • Nov 28th
    plays 0
    likes 0
    comments 0
  • Nov 27th
    plays 0
    likes 0
    comments 0
  • Nov 26th
    plays 0
    likes 0
    comments 0
Previous Week

Downloads

Please join Vimeo or log in to download the original file. It only takes a few seconds.