Behind-the-Screen Overlay Interactions

by Mick

Described at a recent Microsoft TechForum, Behind-the-Screen Overlay Interactions demonstrates a device that enables 3D interaction with PC applications.

See this and other projects mentioned at

https://www.microsoft.com/presspass/features/2012/feb12/02-27TechForum.mspx

The device uses a see-through OLED display combined with depth cameras which enable users to directly interact with a virtual 3D desktop. Head tracking ensures that the correct perspective is maintained as the user moves and reaches into the virtual scene to manipulate 3D objects.

(Video Link: https://www.youtube.com/watch?v=oGa1Q7NvsI0 )