Waving real hand gestures recorded by wearable motion sensors to a virtual car and driver in a mixed-reality parking game

被引：16

作者：

Bannach, David ^{[1
]}

Amft, Oliver ^{[2
]}

Kunze, Kai S. ^{[1
]}

Heinz, Ernst A. ^{[3
]}

Troester, Gerhard ^{[2
]}

Lukowicz, Paul ^{[1
,3
]}

机构：

[1] Univ Passau, Embedded Syst Lab, D-8390 Passau, Germany

[2] ETH, Wearable Comp Lab, Zurich, Switzerland

[3] UMIT, Comp Syst Networks, Hall In Tirol, Austria

来源：

2007 IEEE SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND GAMES | 2007年

关键词：

game control; gesture recognition; immersive human-computer interaction; !text type='Java']Java[!/text]-3D; mixed reality; motion sensors; wearable computing;

D O I：

10.1109/CIG.2007.368076

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

We envision to add context awareness and ambient intelligence to edutainment and computer gaming applications in general. This requires mixed-reality setups and ever-higher levels of immersive human-computer interaction. Here, we focus on the automatic recognition of natural human hand gestures recorded by inexpensive, wearable motion sensors. To study the feasibility of our approach, we chose an educational parking game with 3-D graphics that employs motion sensors and hand gestures as its sole game controls. Our implementation prototype is based on Java-3D for the graphics display and on our own CRN Toolbox for sensor integration. It shows very promising results in practice regarding game appeal, player satisfaction, extensibility, ease of interfacing to the sensors, and - last but not least - sufficient accuracy of the real-time gesture recognition to allow for smooth game control. An initial quantitative performance evaluation confirms these notions and provides further support for our setup.

引用

页码：32 / 39

页数：8