
Optical Flow navigation prototype
1 year ago
Documenting progress for a current project, using optical flow analysis to enable a gestural interface & navigate on-screen content both 2D and 3D.
The video analysis requires only a very small (here 160 x 120) capture size and is fairly tolerant to noise. Each frame is recursively analysed in blocks of 30x30 pixels (variable) which are displaced by a certain amount (also adaptable) and then checked for matches in the previous frame. The resulting flow field is displayed and summed to compute the average direction and amount of movement. All calculations and updates to the flow field use threshold & low pass filters to reduce jitter.
The video analysis requires only a very small (here 160 x 120) capture size and is fairly tolerant to noise. Each frame is recursively analysed in blocks of 30x30 pixels (variable) which are displaced by a certain amount (also adaptable) and then checked for matches in the previous frame. The resulting flow field is displayed and summed to compute the average direction and amount of movement. All calculations and updates to the flow field use threshold & low pass filters to reduce jitter.
-
sojamo 1 year agowow, this runs pretty smooth. got my hands on optical flow recently, too. exciting to see how well this works. -
postspectacular
1 year ago Yeah, it's pretty deft so far and at that res "only" takes 6-8ms on my laptop. It's interesting how many different approaches there are to this problem. This one here is using the Sum of absolute difference only and is really just useful for getting the average direction of movement. If you're looking at tracking actual features, you'll have to look into the lucas-kanade operator etc. good luck with it, it's a fascinating subject... -
okdeluxe
1 year ago very nice and smooth!... i dabbled with a a naive attempt of achieving something similar in the tinker.it/openframeworks workshop in march ( vimeo.com/1429234 ) - but this, well, damn, this looks very efficient! -
Vormplus
1 year ago Nice way of interacting with the computer. Like it. -
vjdrmo
1 year ago great! it looks very responsive and smooth -
Leander Herzog
11 months ago awesome. looks useful, for real. -
Mark Rigler 10 months agonice one
This conversation is missing your voice. Take five seconds to join Vimeo or log in.
-
Vimeo: About / Blog / Developers / Jobs / Community Guidelines / Community Forums / Help Center / Site Map / Merchandise
/ Get Vimeo

Previous Week