Abstract

David will be presenting KinectFusion, a system developed by the Sensors and Devices group at MSR Cambridge that enables a user holding and moving a standard Kinect camera to rapidly create detailed 3D reconstructions of an indoor scene. Only the depth data from Kinect is used to track the 3D pose of the sensor and reconstruct, geometrically precise, 3D models of the physical scene in real-time. Novel extensions to the core GPU pipeline demonstrate object segmentation and user interaction directly in front of the sensor, without degrading camera tracking or reconstruction. These extensions are used to enable real-time multi-touch interactions anywhere, allowing any planar or non-planar reconstructed physical surface to be appropriated for touch. As part of his presentation, he will interactively demonstrate the uses of the core system for low-cost handheld scanning, and geometry-aware augmented reality and physics-based interactions.

Biography:

David Kim is an off-site Ph.D. candidate at Newcastle University Culture Lab since 2009 and joined the Sensors and Devices group at Microsoft Research Cambridge UK in 2010. His current research focuses on novel input and output technologies for 3D spatial and natural interaction. In particular, he is interested in holographic user interfaces, 3D input with haptic and tactile feedback and augmented reality technologies that enable unencumbered realistic interaction with virtual content without instrumenting the user. His recent works include KinectFusion, a system for real-time dense surface reconstruction and geometry-aware interaction with Kinect, HoloDesk a situated see-through display that enables direct 3D interaction, and augmented projectors for 3D interaction with a pico projector. Before moving to the UK, he received his M.Sc. degree in Media Informatics from University of Munich (LMU) in 2008 and had been working on novel multi-touch technologies and applications in the Fluidum group in Munich.