Mime: Compact Low-Power 3D Gesture Sensing

Abstract

Mime is a compact, low-power 3D sensor for unencumbered free-form, single-handed gestural interaction with head-mounted displays (HMDs). It introduces a real-time signal processing framework that combines a novel three-pixel time-of-flight (TOF) module with a standard RGB camera. The TOF module achieves accurate 3D hand localization and tracking, and it thus enables motion-controlled gesture. The joint processing of 3D information with RGB image data enables finer, shape-based gestural interaction.

Videos