Fujitsu said its new system focuses on image processing, such that it can use off-the-shelf cameras and projectors to get the job done.
"The new technology uses the cameras together with a projector to enable a user to trace a finger across a document on a table, copy it as digital data, and display it. This simple interaction with objects makes the technology an interface between people and ICT services, thereby expanding the ways in which ICT is employed," it said.
It said it plans to commercialize the technology by 2014.
Fujitsu noted several approaches had been made to replace the mouse, keyboard, and touchscreen in having humans interact with computers and similar devices.
Current commercial technologies using hand gestures run into problems due to difficulty differentiating between the hands and background, it added.
Other technologies require placing special sensors on objects, making them impractical, it said.
"If it were possible to perform contactless detection of touch operations on real world objects, this would obviate the need to embed objects with special sensors," it said.
Fujitsu said its new technology can "accurately and rapidly detect finger operations on actual objects using an ordinary camera."
It said the camera can be made to measure irregularly shaped objects on a table and then automatically adjust the coordinate systems for the camera, projector and the objects.
"This makes it possible for the software to take the finger movements and touching of objects made by the user, and then match them with the digital display projected onto physical objects," it said.
Fujitsu said its technology can even use a regular webcam and can track objects at 300 mm per second—allowing it to follow natural finger movements.
With the technology, one can "copy important parts of a document in digital format by simply tracing one's finger across the physical document while it is placed on a table."
One can also project copied data on a tabletop and then expand and shrink it "by tracing with a finger."
"In addition, the technology can capture graphic data from handwritten sticky-notes that have been attached to a table, and enable the user to move around these newly digitalized sticky-notes with a finger over a physical surface. It would then be possible to group and rearrange these digitalized notes or perform other useful operations with them," it added.
Real, virtual worlds
A separate article on DigInfo.tv quoted Fujitsu as saying the system "doesn't use any special hardware" and involves just a device like an ordinary webcam, plus a commercial projector.
"Its capabilities are achieved by image processing technology," it added. — VC, GMA News
source: gmanetwork.com
