Documenting progress for a current project, using optical flow analysis to enable a gestural interface & navigate on-screen content both 2D and 3D.

The video analysis requires only a very small (here 160 x 120) capture size and is fairly tolerant to noise. Each frame is recursively analysed in blocks of 30x30 pixels (variable) which are displaced by a certain amount (also adaptable) and then checked for matches in the previous frame. The resulting flow field is displayed and summed to compute the average direction and amount of movement. All calculations and updates to the flow field use threshold & low pass filters to reduce jitter.

Credits

42 Likes

  • sojamo 1 year ago
    wow, this runs pretty smooth. got my hands on optical flow recently, too. exciting to see how well this works.
  •  
  • postspectacular plus 1 year ago
    Yeah, it's pretty deft so far and at that res "only" takes 6-8ms on my laptop. It's interesting how many different approaches there are to this problem. This one here is using the Sum of absolute difference only and is really just useful for getting the average direction of movement. If you're looking at tracking actual features, you'll have to look into the lucas-kanade operator etc. good luck with it, it's a fascinating subject...
  •  
  • okdeluxe plus 1 year ago
    very nice and smooth!... i dabbled with a a naive attempt of achieving something similar in the tinker.it/openframeworks workshop in march ( vimeo.com/1429234 ) - but this, well, damn, this looks very efficient!
  •  
  • Vormplus plus 1 year ago
    Nice way of interacting with the computer. Like it.
  •  
  • vjdrmo plus 1 year ago
    great! it looks very responsive and smooth
  •  
  • Leander Herzog plus 11 months ago
    awesome. looks useful, for real.
  •  
  • Mark Rigler 10 months ago
    nice one
  •  
This conversation is missing your voice. Take five seconds to join Vimeo or log in.

Advertisement

3 Related collections

Statistics

  •  
    plays
    likes
    comments
  • Total
    plays 1,116
    likes 42
    comments 7
  • Dec 4th
    plays 2
    likes 0
    comments 0
  • Dec 3rd
    plays 1
    likes 0
    comments 0
  • Dec 2nd
    plays 4
    likes 0
    comments 0
  • Dec 1st
    plays 3
    likes 0
    comments 0
  • Nov 30th
    plays 3
    likes 0
    comments 0
  • Nov 29th
    plays 1
    likes 0
    comments 0
  • Nov 28th
    plays 1
    likes 0
    comments 0
  • Nov 27th
    plays 1
    likes 0
    comments 0
Previous Week

Downloads

Please join Vimeo or log in to download the original file. It only takes a few seconds.