This is a proof of concept on using hand gesture for moving a virtual object.
The ball is red if no hand is detected. When a hand is detected the ball turns yellow or green, depending on the openness of the palm.
The interaction is analogous to holding and moving a real ball on space. It is still very rough and jaggy, though.
Filtering could be helpful to alleviate the issue.
Created using Unity and Intel Perceptual Computing SDK.