FRAMINGHAM, 3 SEPTEMBER 2010 - Imagine the ability to create an iPad on any wall or surface you come across, even on a piece of paper, or the chance to control computers and other physical machines with your brain waves.
This is the future of human-computer interaction, according to innovative researchers and entrepreneurs who took the main stage at VMworld in San Francisco Thursday morning.
SixthSense, a "wearable gestural interface" created by Pranav Mistry of the MIT Media Lab's Fluid Interfaces Group, outfits humans with a small projector, mirror and camera worn around the neck (or on a helmet), and little colored markers worn on the fingers. The prototype lets the user project a computer onto a wall, to check e-mail and browse the Web similarly to how an Apple iPad works, except that the gestures can be made in the air without touching a screen.
Mistry's video demonstration of SixthSense at VMworld showed him using the technology to take pictures with his hands; project a phone dial pad onto his palm; augment newspapers with footage of President Obama speaking; play a racing game on a piece of paper; get digital updates on a flight projected onto a plane ticket; and play Pong on the Boston subway using his feet as paddles. You can even "copy and paste" text from paper books, placing it in your personal computer screen, which happens to exist anywhere you want it to.
Mistry believes current devices are too limiting, and that people should be able to interact with the information normally locked inside computers and the Internet using the normal human gestures of daily life.
"We as humans are not interested in computers. Our interest is in information," he said. "There's no need for us to have two separate worlds" that separate the digital from the physical.
Tan Le, co-founder and president of Emotiv Systems, demonstrated a brain-computer interface technology that gives the user a headset allowing control over electronic systems using brain waves.
"We have dreamed and imagined of a time when it might be possible to control and influence our environment with our brains," Le said.
Unlike SixthSense, Emotiv's EPOC Headset is available for sale, at the price of $300. But Le noted that the technology is in its infancy. We are only scratching the surface of what is possible with this technology today, she said.
Using VMware CTO Stephen Herrod as a guinea pig, Le demonstrated how the Emotiv headset lets users manipulate objects on a computer screen just by thinking. For example, Herrod was able to "lift" a virtual box after a short training session in which the computer monitored his brain waves to determine what it does when it is at rest and when it is thinking about manipulating an object. Herrod also tried to make the box disappear from the screen, a more difficult task because it is not movement-based, but he didn't fully succeed.
Sign up for Computerworld eNewsletters.