Behind-the-Screen Overlay Interactions

by Mick

Described at a recent Microsoft TechForum, Behind-the-Screen Overlay Interactions demonstrates a device that enables 3D interaction with PC applications.

See this and other projects mentioned at

The device uses a see-through OLED display combined with depth cameras which enable users to directly interact with a virtual 3D desktop. Head tracking ensures that the correct perspective is maintained as the user moves and reaches into the virtual scene to manipulate 3D objects.

(Video Link: )