Good toys capture the imagination of the kids. But toys today are increasingly losing battles against the interactive and engaging experiences kids get from ipads and animated movies. To encourage more physical play for kids, Morpx designed a smart eye for toy to add much needed intelligence and interactions. During the process, we faced a number of engineering as well as algorithmic challenges, which I will cover in this talk. I will also discuss how the existing computer vision pipelines, which mostly evolved from the photo processing of cameras and smartphones, are poorly designed to efficiently execute the recognition tasks in toys.
Presented at the 10th Bay Area Multimedia Forum (BAMMF), 14 April 2016