#real-time 3d interaction

[uxure-blog]

The world’s most accurate 3-D motion-control technology has joined forces with the world’s largest technology company.

Leap Motion announced a collaboration with HP to bring their 3-D motion control to some HP devices. This relationship will start with the Leap Motion Controller being bundled with select HP products and evolve to unique HP devices embedded with Leap Motion’s technology. The greatest challenge facing any new technology is reaching beyond early adopters and tech enthusiasts to embrace the wider public. While developers Companies are creating software for the Leap Motion Controller, Leap Motion is working to ensure that these apps will have the audience they need. The collaboration with HP represents a major step towards Leap Motion vision for the future – bringing 3-D motion-control technology to the world. Embedding this technology into other devices has always been an important part of that vision. With HP’s history of innovation and global consumer audience, Leap Motion is confident that they will be able to introduce Leap Motion technology to that broader public. More importantly, they'll be able to introduce these apps to more people than ever before. A whole new world of possibilities has been unlocked. Airspace™, the Leap Motion app store, will come pre-loaded on all Leap Motion-enabled HP devices. Inside Airspace, HP users will discover a wide range of software. This new software generation can introduce them to the magic of 3-D motion control

[uxure-blog]

Real-time 3D Reconstruction and Interaction Using a Moving Depth Camera

KinectFusion enables a user holding and moving a standard Kinect camera to rapidly create detailed 3D reconstructions of an indoor scene. Only the depth data from Kinect is used to track the 3D pose of the sensor and reconstruct, geometrically precise, 3D models of the physical scene in real-time. The capabilities of KinectFusion, as well as the novel GPU-based pipeline are described in full. We show uses of the core system for low-cost handheld scanning, and geometry-aware augmented reality and physics-based interactions. Novel extensions to the core GPU pipeline demonstrate object segmentation and user interaction directly in front of the sensor, without degrading camera tracking or reconstruction. These extensions are used to enable real-time multi-touch interactions anywhere, allowing any planar or non-planar reconstructed physical surface to be appropriated for touch.

They demonstrate the interactive possibilities enabled when high-quality 3D models can be acquired in real-time, including: extending multi-touch interactions to arbitrary surfaces; advanced features for augmented reality; real-time physics simulations of the dynamic model; novel methods for segmentation and tracking of scanned objects.

Source