Speech/gesture interface to a visual-computing environment

被引：34
|
作者：
Sharma, R
Zeller, M
Pavlovic, VI
Huang, TS
Lo, Z
Chu, S
Zhao, YX
Phillips, JC
Schulten, K [1 ]
机构：
[1] Penn State Univ, Dept Comp Sci & Engn, University Pk, PA 16802 USA
[2] Univ So Calif, Los Angeles, CA 90089 USA
[3] Univ Illinois, Dept Elect & Comp Engn, Urbana, IL 61801 USA
[4] H&F Aeronaut Technol, Syst Engn, San Diego, CA USA
来源：
IEEE COMPUTER GRAPHICS AND APPLICATIONS | 2000年 / 20卷 / 02期
基金：
美国国家科学基金会;
关键词：
D O I：
10.1109/38.824531
中图分类号：
TP31 [计算机软件];
学科分类号：
081202 ; 0835 ;
摘要：
A bimodal speech/gesture interface that lets researchers interact with 3D graphical objects in a virtual environment using spoken words and simple, free hand gestures is presented. In this initial implementation, new users needed only a few minutes to get acquainted with the setup. Every user reported that working with the interface is more convenient and, in most cases, more efficient than the traditional interaction with visual molecular dynamics.
引用
收藏
页码：29 / 37
页数：9
相关论文
共 50 条
  • [1] Speech only interface approach for personal computing environment
    Raveendran, Vishnudas
    Sanjeev, Merin Rose
    Paul, Nicey
    Jijina, K. P.
    PROCEEDINGS OF 2ND IEEE INTERNATIONAL CONFERENCE ON ENGINEERING & TECHNOLOGY ICETECH-2016, 2016, : 372 - 377
  • [2] Gestural interface to a visual computing environment for molecular biologists
    Pavlovic, VI
    Sharma, R
    Huang, TS
    PROCEEDINGS OF THE SECOND INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION, 1996, : 30 - 35
  • [3] GIUC: A Gesture Interface for Ubiquitous Computing
    Wang, Dong
    2009 WRI INTERNATIONAL CONFERENCE ON COMMUNICATIONS AND MOBILE COMPUTING: CMC 2009, VOL 3, 2009, : 170 - +
  • [4] Speech and gesture recognition-based robust language processing interface in noise environment
    Kim, Jung-Hyun
    Hong, Kwang-Seok
    INTELLIGENT DATA ENGINEERING AND AUTOMATED LEARNING - IDEAL 2006, PROCEEDINGS, 2006, 4224 : 338 - 345
  • [5] The performance and cognitive workload analysis of a multimodal speech and visual gesture (mSVG) UAV control interface
    Abioye, Ayodeji Opeyemi
    Prior, Stephen D.
    Saddington, Peter
    Ramchurn, Sarvapali D.
    ROBOTICS AND AUTONOMOUS SYSTEMS, 2022, 147
  • [6] Hand-gesture computing for the hearing and speech impaired
    Pradhan, Gaurav
    Prabhakaran, Balakrishnan
    Li, Chuanjun
    IEEE MULTIMEDIA, 2008, 15 (02) : 20 - 27
  • [7] A head gesture recognition technique for visual user interface
    Kim, SH
    Choi, HI
    Yoo, JH
    Rhee, PK
    Park, YC
    MULTIMEDIA STORAGE AND ARCHIVING SYSTEMS III, 1998, 3527 : 295 - 305
  • [8] Qualitative Analysis of a Multimodal Interface System using Speech/Gesture
    Baig, Muhammad Zeeshan
    Kavakli, Manolya
    PROCEEDINGS OF THE 2018 13TH IEEE CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS (ICIEA 2018), 2018, : 2811 - 2816
  • [9] Multi-scale virtual environment with gesture interface
    Nariman, D
    Nishino, H
    Utsumiya, K
    Korida, K
    VSMM98: FUTUREFUSION - APPLICATION REALITIES FOR THE VIRTUAL AGE, VOLS 1 AND 2, 1998, : 318 - 323
  • [10] Research on Visual Attention Distribution Model of 3D Gesture in the Gesture Interface
    Feng, Zhiquan
    He, Nana
    Liang, Liwei
    2015 IEEE 16TH INTERNATIONAL CONFERENCE ON COMMUNICATION TECHNOLOGY (ICCT), 2015, : 449 - 459
12345