Sony Move, Microsoft Kinect accelerate wider use of gesture control

Gesture control, featured in the Sony Move and Microsoft Kinect video game systems launched at the 2010 E3 conference, are just the start of gesture-based interfaces, say researchers and industry professionals.

By , Staff writer

  • close
    E3 2010 conference attendees play with the gesture-based Kinect on the Xbox 360 on Tuesday in Los Angeles.
    View Caption

E3 – the video game industry’s annual confab – is over. And while Sony and Microsoft debuted their new hands-free gaming systems, "Move" and "Kinect," hoping to win bragging rights before they go on sale in the fall, the real message for the rest of us is that the age of gesture control is officially
upon us.

And that age has arrived not just for the gaming enthusiast eager to control entire virtual worlds with a real-life kick or punch, but for, well, everyone, say analysts, industry professionals and researchers. Whether it’s an emergency body sensor that sends paramedics to a security guard who collapses on duty, a bridge repairman who guides tools through a complicated fix without ever touching them, or a movie fan who stops at a digital movie poster to “throw” digital fireballs at the film’s star while he waits for a bus, it’s hands-off time all over.

With even some of the most powerful, sophisticated, and expensive technology on the planet, buttons and wires are fast becoming passe. Forget the remote,
the controller or even the simple on-off button. Dance lessons may help more. It’s all about the wave of a hand, the crook of a finger, or the jaunty kick of a leg.

Recommended: Grand Theft Auto and the biggest moments in video game history

IN PICTURES: Controversial video games

“The demand for this technology is just blossoming into the mainstream,” says Wayne Meyer, MEMS Marketing and Applications Manager for Analog Devices, Inc., a manufacturer of the tiny chips that run everything from farm equipment to iPhones. The type of products doesn't seem to matter, he says, adding, “everyone wants to be able to say they have this application somewhere in their system.”

Motion-sensing technology has been around in tailored applications such as airbags for decades. But the recent success of gesture-run software in gaming systems such as the Nintendo Wii and the now-familiar “pinch and spread” smart phone navigation feature has propelled it into the mainstream, says researcher Mark Bolas of the University of Southern California’s Institute for Creative Technologies, where his work is funded by the Department of Defense. Microsoft funds his work as an associate professor in the Interactive Media Division of the University's Cinema School.

The adoption pattern is similar to that of many other new technologies, he says.

“We are in the early phases of a new technology,” he says. Most of the new gesture-driven games on display at this past week’s E3 simply replace the actions once taken by analog buttons with arm waves and leg jabs. This is typical, he says.

What the video game industry lends to the evolutionary curve is economies of scale, points out Steve Birnhak, CEO of the firm Inwindow Outdoor, which creates gesture-controlled outdoor displays not unlike the famous “hands-free” scene in the Tom Cruise film “Minority Report.” Passers-by can direct elements in the display without touching any part of it. The company founder says his systems use essentially the same camera at the heart of the new Microsoft Kinect setup, but his low-volume creations can cost thousands apiece. The software giant will buy in massive quantities that will drive prices down and encourage new uses for the technology.

At the same time, gaming enthusiasts are prodding Microsoft and Sony to refine their own applications. Lag time is critical when you are, say, hoping to shoot or bomb the bad guy, points out social media entrepreneur Alex Huf. Traditional game controllers had driven that critical gap between pressing a button and realizing an impact onscreen to a nearly imperceptible level. With the new gesture-recognition technology, he adds, the companies are struggling with as much as a quarter second gap.

“That’s really not acceptable,” says Mr. Huf, adding that the pressure from a $35 billion industry to get that right will inevitably lead to an innovation curve that trickles down to other applications. “If you’re spending as much as $60 million to launch a single game, you will do what it takes to get that right,” he adds.

The next phase, in which a critical mass of investment and sheer “ubiquitousness,” will help push the innovation pace, “gets interesting,” says Mr. Bolas, "when the artists come in and begin to dream up things that we never thought of doing before.”

Related:

IN PICTURES: Controversial video games

Share this story:

We want to hear, did we miss an angle we should have covered? Should we come back to this topic? Or just give us a rating for this story. We want to hear from you.

Loading...

Loading...

Loading...

eZ debug

Clear cache:

Quick settings:

Timing: Jul 09 2014 12:34:14
Script start
Timing: Jul 09 2014 12:34:14
Module start 'content'
Notice: PHP: E_NOTICE Jul 09 2014 12:34:14
Undefined index: path in /var/www/www.csmonitor.com/extension/ezwebin/autoloads/ezpagedata.php on line 158
Notice: PHP: E_NOTICE Jul 09 2014 12:34:14
Undefined index: path in /var/www/www.csmonitor.com/extension/ezwebin/autoloads/ezpagedata.php on line 175
Notice: PHP: E_NOTICE Jul 09 2014 12:34:14
Undefined index: path in /var/www/www.csmonitor.com/extension/ezwebin/autoloads/ezpagedata.php on line 158
Notice: PHP: E_NOTICE Jul 09 2014 12:34:14
Undefined index: path in /var/www/www.csmonitor.com/extension/ezwebin/autoloads/ezpagedata.php on line 175
Notice: PHP: E_NOTICE Jul 09 2014 12:34:14
Undefined index: meta_class_identifier_ms in /var/www/www.csmonitor.com/extension/ezfind/classes/ezfindresultnode.php on line 111
Notice: PHP: E_NOTICE Jul 09 2014 12:34:14
Undefined index: meta_class_identifier_ms in /var/www/www.csmonitor.com/extension/ezfind/classes/ezfindresultnode.php on line 111
Notice: PHP: E_NOTICE Jul 09 2014 12:34:14
Undefined index: meta_class_identifier_ms in /var/www/www.csmonitor.com/extension/ezfind/classes/ezfindresultnode.php on line 111
Notice: PHP: E_NOTICE Jul 09 2014 12:34:14
Undefined index: meta_class_identifier_ms in /var/www/www.csmonitor.com/extension/ezfind/classes/ezfindresultnode.php on line 111
Notice: PHP: E_NOTICE Jul 09 2014 12:34:14
Undefined index: meta_remote_id_ms in /var/www/www.csmonitor.com/extension/csm_base/classes/CSMFunctionCollection.php on line 1028
Warning: eZTemplate:def @ extension/csm_base/design/csm_design/templates/content/datatype/view/ezbyline.tpl:10[1] Jul 09 2014 12:34:14
Variable 'story_source' is already defined.
Notice: PHP: E_NOTICE Jul 09 2014 12:34:14
Undefined index: meta_class_identifier_ms in /var/www/www.csmonitor.com/extension/ezfind/classes/ezfindresultnode.php on line 111
Notice: PHP: E_NOTICE Jul 09 2014 12:34:14
Undefined index: meta_remote_id_ms in /var/www/www.csmonitor.com/extension/csm_base/classes/CSMFunctionCollection.php on line 1028
Timing: Jul 09 2014 12:34:14
Module end 'content'
Timing: Jul 09 2014 12:34:14
Before parse_includes
Strict: PHP: E_STRICT Jul 09 2014 12:34:14
Non-static method MugoViewExtras::get_view_extras() should not be called statically, assuming $this from incompatible context in /var/www/www.csmonitor.com/extension/mugo_view_extras/autoloads/template_operators.php on line 37
Warning: eZTemplate:def @ extension/csm_base/design/csm_design/override/templates/extra/archive.tpl:21[1] Jul 09 2014 12:34:14
Variable 'view_extra_node' is already defined.
Timing: Jul 09 2014 12:34:14
After parse_includes
Timing: Jul 09 2014 12:34:14
End

Timing points:

CheckpointElapsedRel. ElapsedMemoryRel. Memory
Script start 0.0000 sec0.0160 sec 1,286.0547 KB1,162.3047 KB
Module start 'content' 0.0160 sec1.5412 sec 2,448.3594 KB12,015.5781 KB
Module end 'content' 1.5572 sec0.0367 sec 14,463.9375 KB399.2813 KB
Before parse_includes 1.5939 sec0.0548 sec 14,863.2188 KB274.8359 KB
After parse_includes 1.6487 sec0.0010 sec 15,138.0547 KB-184.9453 KB
End 1.6497 sec  14,953.1094 KB 
Total runtime:1.6578 sec
Peak memory usage:21,251.9297 KB

Time accumulators:

 Accumulator Elapsed Percent Count Average
ini_load
Load cache0.0090 sec0.5449%360.0003 sec
Mysql Total
Mysqli_queries0.1872 sec11.2755%2240.0008 sec
Looping result0.0416 sec2.5029%2180.0002 sec
Template Total1.5827 sec 95.3% 8 0.1978 sec
Template load0.0102 sec0.6137%80.0013 sec
Template processing1.5723 sec94.6902%80.1965 sec
Template load and register function0.0003 sec0.0205%40.0001 sec
states
state_id_array0.0106 sec0.6412%170.0006 sec
state_identifier_array0.0204 sec1.2290%240.0009 sec
override
Cache load0.0101 sec0.6082%1130.0001 sec
eZ Find
Search0.2510 sec15.1142%20.1255 sec
Query build0.0081 sec0.4851%10.0081 sec
Class attribute list0.0735 sec4.4264%10.0735 sec
Engine time0.0368 sec2.2148%10.0368 sec
MoreLikeThis0.0000 sec0.0000%00.0000 sec
Sytem overhead
Fetch class attribute can translate value0.0016 sec0.0967%50.0003 sec
Fetch class attribute name0.0003 sec0.0169%130.0000 sec
XML
Image XML parsing0.0115 sec0.6898%50.0023 sec
class_abstraction
Instantiating content class attribute0.0001 sec0.0069%140.0000 sec
General
String conversion0.0000 sec0.0014%30.0000 sec
dbfile0.0023 sec0.1410%740.0000 sec
View Extra building0.0136 sec0.8169%40.0034 sec
Total script time:1.6604 sec

CSS/JS files loaded with "ezjscPacker" during request:

CacheTypePacklevelSourceFiles
01a980f93dc967c6e39d52a11ae2108b_1404899611_all.cssCSS3extension/csm_base/design/csm_design/stylesheets/normalize.css
extension/csm_base/design/csm_design/stylesheets/html5b.css
design/standard/stylesheets/debug.css
extension/ezwt/design/standard/stylesheets/websitetoolbar.css
extension/csm_base/design/csm_design/stylesheets/jquery-ui-1.10.3.custom.min.css
extension/csm_base/design/csm_design/stylesheets/desktop.css
ede0a88fd146f1a095d27fb22227d0e5_1398846822.jsJS2extension/csm_base/design/csm_design/javascript/modernizr.js
extension/csm_base/design/standard/javascript/jquery-1.10.2.min.js
1650da1ba852ac5f9af81af07e8fa105_1404899611.jsJS2extension/csm_base/design/csm_design/javascript/jquery-ui-1.10.4.min.js
extension/csm_base/design/csm_design/javascript/json2.js
extension/csm_base/design/standard/javascript/jquery.cookie.min.js
extension/csm_base/design/csm_design/javascript/jquery.mobile.custom.min.js
extension/csm_base/design/csm_design/javascript/plugins/jquery.arthole.js
extension/csm_base/design/csm_design/javascript/plugins/jquery.sticky.js
extension/csm_base/design/csm_design/javascript/plugins/jquery.csmstory.js
extension/csm_base/design/csm_design/javascript/plugins/jquery.right_column.js
extension/csm_base/design/csm_design/javascript/plugins/jquery.csmstory_editorspickdialog.js
extension/csm_base/design/csm_design/javascript/plugins/jquery.sailthru_signup.js
extension/csm_base/design/csm_design/javascript/plugins/jquery.jcarousel.min.js
extension/csm_base/design/csm_design/javascript/plugins/jquery.history.js
extension/csm_base/design/csm_design/javascript/plugins/jquery.mainNav.js
extension/csm_base/design/csm_design/javascript/plugins/jquery.gallery.js
extension/csm_base/design/csm_design/javascript/plugins/jquery.staffdialog.js
extension/csm_base/design/csm_design/javascript/jQuery.rollChildren.js
extension/csm_base/design/csm_design/javascript/pubService_extended.js
extension/csm_base/design/standard/javascript/csm/csmNew.js
extension/csm_base/design/csm_design/javascript/jquery.quiz.js
extension/csm_base/design/csm_design/javascript/jquery.spectrumQuiz.js
extension/csm_base/design/csm_design/javascript/global.js

Templates used to render the page:

UsageRequested templateTemplateTemplate loadedEditOverride
1node/view/full.tplfull/article.tplextension/csm_base/design/csm_design/override/templates/full/article.tplEdit templateOverride template
22content/datatype/view/ezxmltags/paragraph.tpl<No override>extension/ezwebin/design/ezwebin/templates/content/datatype/view/ezxmltags/paragraph.tplEdit templateOverride template
3content/datatype/view/ezimage.tpl<No override>extension/csm_base/design/csm_design/templates/content/datatype/view/ezimage.tplEdit templateOverride template
2content/datatype/view/ezstring.tpl<No override>design/standard/templates/content/datatype/view/ezstring.tplEdit templateOverride template
20content/datatype/view/ezxmltags/link.tpl<No override>extension/csm_base/design/standard/templates/content/datatype/view/ezxmltags/link.tplEdit templateOverride template
6content/datatype/view/ezxmltags/line.tpl<No override>design/standard/templates/content/datatype/view/ezxmltags/line.tplEdit templateOverride template
8content/datatype/view/ezxmltags/strong.tpl<No override>design/standard/templates/content/datatype/view/ezxmltags/strong.tplEdit templateOverride template
4content/datatype/view/ezxmltags/li.tpl<No override>design/standard/templates/content/datatype/view/ezxmltags/li.tplEdit templateOverride template
2content/datatype/view/ezxmltags/ul.tpl<No override>design/standard/templates/content/datatype/view/ezxmltags/ul.tplEdit templateOverride template
1content/datatype/view/ezxmltext.tpl<No override>design/standard/templates/content/datatype/view/ezxmltext.tplEdit templateOverride template
1content/datatype/view/ezbyline.tpl<No override>extension/csm_base/design/csm_design/templates/content/datatype/view/ezbyline.tplEdit templateOverride template
1content/datatype/view/ezobjectrelationlist.tplcontent/datatype/view/story_images.tplextension/csm_base/design/csm_design/override/templates/content/datatype/view/story_images.tplEdit templateOverride template
1content/datatype/view/eztext.tpl<No override>design/standard/templates/content/datatype/view/eztext.tplEdit templateOverride template
1content/datatype/view/ezstring.tplcontent/datatype/view/image_credit.tplextension/csm_base/design/csm_design/override/templates/content/datatype/view/image_credit.tplEdit templateOverride template
1content/datatype/view/ezxmltext.tplcontent/datatype/view/story_info_box.tplextension/csm_base/design/csm_design/override/templates/content/datatype/view/story_info_box.tplEdit templateOverride template
1content/datatype/view/ezmatrix.tplcontent/datatype/view/ezmatrix_article_related_external_links.tplextension/csm_base/design/csm_design/override/templates/content/datatype/view/ezmatrix_article_related_external_links.tplEdit templateOverride template
1pagelayout.tpl<No override>extension/csm_base/design/csm_design/templates/pagelayout.tplEdit templateOverride template
1modules/mugo_view_extras/extra_cached.tpl<No override>extension/mugo_view_extras/design/standard/templates/modules/mugo_view_extras/extra_cached.tplEdit templateOverride template
1setup/debug_toolbar.tpl<No override>design/standard/templates/setup/debug_toolbar.tplEdit templateOverride template
 Number of times templates used: 78
 Number of unique templates used: 19
 Time used to render template usage: 0.0005 secs