Mockup Builder: Direct 3D Modelling on and above the surface in a continuous interaction space.
Researchers from the Technical University of Lisbon, Portugal and the University of Lille, France have developed a semi-immersive environment for conceptual design providing the ability to create and manipulate 3D shapes in a stereoscopic environment using gestures on a multi-touch surface display and in the space above the surface.
The system uses a multi-touch table with a 3D projector for stereoscopic visualisation. A Kinect sensor is used together with 2 Gametraks to track gestures on and above the Surface.
( link: http://www.youtube.com/watch?v=ZxJD9DXDB1E )
The work was presented at the Graphics Interface 2012 conference in Toronto and a paper will be published in the proceedings.
http://www.lifl.fr/~casiez/publications/MockupBuilder-GI2012.pdf
(local copy)