Behind-the-Screen Overlay Interactions
Described at a recent Microsoft TechForum, Behind-the-Screen Overlay Interactions demonstrates a device that enables 3D interaction with PC applications.
See this and other projects mentioned at
The device uses a see-through OLED display combined with depth cameras which enable users to directly interact with a virtual 3D desktop. Head tracking ensures that the correct perspective is maintained as the user moves and reaches into the virtual scene to manipulate 3D objects.
(Video Link: https://www.youtube.com/watch?v=oGa1Q7NvsI0 )