Gesture based controls are starting to change the way users interact with computer applications - as seen, for example, with the Wiimote a remote control used with the Wii games console.

Wouldn’t it be great if the system could detect what was happening by interpreting movement and gestures directly without  the need for any input device?

In order to do this, technology is required that can build up a 3-Dimensional picture of the scene or environment where the user is placed. Movement and gestures within this 3D enviroment can then be used by the system to determine what the user is trying to do.

The ZCam^TM is a video camera that can capture depth information (which is used to build the 3D model) along with video and is produced by 3DV Systems.

http://www.3dvsystems.com/

The technology is based on the Time of Flight principle. In this technique, 3D depth data is generated by sending pulses of infra-red light  into the scene and detecting the light reflected from the surfaces of objects in the scene. Using the time taken for a light pulse to travel to the target and back, the distance can be calculated and used to build up 3D depth information for all objects in the scene. 

The technology performs superior depth imaging (depth resolution of millimeters) in real-time (60 fps or more), using little or no CPU.

The latest ZCam^TM is based on the DeepC^TM technology which is a chipset that incoporates the sensing technology.

There are a number of related publications which describe the technology in greater detail and can be found at

http://www.3dvsystems.com/technology/tech.html

Creating an intuitive mechanism to replace the keyboard and/or mouse has been an aspiration for many people ever since Tom Cruise in “Minority Report” looked so cool moving files around with his fingers.

Perhaps this technology can be used in helping to achieve those aims.  

The Best Emerging Technology prize at Siggraph 2007 has recently been awarded to ICT Research.

Researchers at the USC (University of Southern California) Institute for Creative Technologies (ICT) along with their collaborators have devised a reproducible, low-cost 3D display system that requires no special glasses, and is viewable from all angles by multiple users. This system allows computer generated 3D objects to be seen in new ways, and will impact the future of interactive systems.

Details of the Rendering for an Interactive 360º Light Field Display can be found in a pre-print of a paper to be published in the ACM SIGGRAPH conference proceedings from the project page at

http://gl.ict.usc.edu/Research/3DDisplay/

3ddisplay_preprint.pdf

There is also a video news item by CBS at

http://www.cbs2.com/video/?id=36497@kcbs.dayport.com

The display consists of a high-speed video projector, a spinning mirror covered by a holographic diffuser, and FPGA circuitry to decode specially rendered DVI video signals. The display uses a standard programmable graphics card to render over 5,000 images per second of interactive 3D graphics, projecting 360-degree views with 1.25 degree separation up to 20 updates per second.

Find out more about ICT Research at

http://www.ict.usc.edu/

Start Slide Show with PicLens Lite

Bill Buxton is a designer and a researcher concerned with human aspects of technology. His work reflects a particular interest in the use of technology to support creative activities such as design, film making and music. Buxton’s research specialties include technologies, techniques and theories of input to computers, technology mediated human-human collaboration, and ubiquitous computing.

Recently he has published his latest book which is well worth reading.

Here is a flyer to the book, which also contains a Table of Contents

http://www.billbuxton.com/bookFlyer.pdf

and here is a link to videos accompanying the book

http://www.mkp.com/sketching

Also, check out a conversation between John Udell and Bill Buxton at Channel 9

In the latest episode of my Microsoft Conversations series I got together with Bill Buxton to talk about the design philosophy set forth in his new book Sketching User Experiences. Nowadays Bill is a principal researcher with Microsoft Research, and before that he was chief scientist at Alias/Wavefront, but his involvement in the design of software and hardware user interfaces goes all the way back to Xerox PARC. Along the way he’s accumulated a fund of wisdom about what he calls design thinking — a way of producing, illustrating, and winnowing ideas about how products could work.

LINK: http://channel9.msdn.com/ShowPost.aspx PostID=312067

You can find Bill Buxtons home page at:

LINK: http://www.billbuxton.com/

Start Slide Show with PicLens Lite

Browsed past Zsurf - it is used to convert bitmap images into “nurb” surfaces.

(Picture courtesy of Phil Kellman - 2007)

The workflow of the program is simple: load or create a bitmap, setup the filters and effects and then push the process button to process the image. The result of processing is a heightfield surface stored as an IGES file. (note: black represents minimum height and white represents maximum)

I got a copy from

http://mwt.net/~sjedging/ZSURF4.zip

Start Slide Show with PicLens Lite

The Microsoft Journal for Developers (MSDN Magazine) is available from

http://msdn.microsoft.com/msdnmag/default.aspx

Also noticed Charles Petzold is venturing into 3D with his latest book. (He published his first book “Programming Windows” back in 1988)

http://www.charlespetzold.com/

3D Programming for Windows explores and elucidates the 3D graphics programming facilities of the Windows Presentation Foundation (WPF) under Windows Vista and the .NET Framework 3.0.

http://www.charlespetzold.com/3D/index.html

Start Slide Show with PicLens Lite