Considerations on Multimodal Human-Computer Interaction

被引:0
|
作者
Liu, Chang [1 ]
Xie, Wenjun [1 ]
Zhang, Peng [1 ]
Zhan, Jia [1 ]
Xiao, Zonghao [1 ]
机构
[1] Air Force Engn Univ, Equipment Management & Unmanned Aerial Vehicle En, Xian 710051, Shaanxi, Peoples R China
关键词
Modalities; Human-computer interaction; Fusion technology; Artificial intelligence; INTERFACES;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper first briefly reviews some key issues in multimodal human-computer interaction (MMHCI), including the history, opportunities and challenges of this field. It also reviews that development history of multimodal human-computer interaction, explains the necessity and feasibility of developing MMHCI and emphasizes the fusion of MMHCI about related technologies and the problems which need to be solved. Finally, it describes the goal of MMHCI and the technological challenges faced in the researches. With the rapid development of artificial intelligence and high performance sensors, MMHCI will replace the unimodal human-computer interaction in the future.
引用
收藏
页码:331 / 335
页数:5
相关论文
共 50 条
  • [1] Multimodal human-computer interaction
    Turk, M
    [J]. REAL-TIME VISION FOR HUMAN-COMPUTER INTERACTION, 2005, : 269 - 283
  • [2] Multimodal Interfaces of Human-Computer Interaction
    Karpov, A. A.
    Yusupov, R. M.
    [J]. HERALD OF THE RUSSIAN ACADEMY OF SCIENCES, 2018, 88 (01) : 67 - 74
  • [3] MULTIMODAL COLLABORATION AND HUMAN-COMPUTER INTERACTION
    Zhang, Zhengyou
    [J]. ICME: 2009 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, VOLS 1-3, 2009, : 1596 - 1599
  • [4] Multimodal human-computer interaction: A survey
    Jaimes, Alejandro
    Sebe, Nicu
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2007, 108 (1-2) : 116 - 134
  • [5] Modeling multimodal human-computer interaction
    Obrenovic, Z
    Starcevic, D
    [J]. COMPUTER, 2004, 37 (09) : 65 - +
  • [6] Systematic Review of Multimodal Human-Computer Interaction
    Azofeifa, Jose Daniel
    Noguez, Julieta
    Ruiz, Sergio
    Molina-Espinosa, Jose Martin
    Magana, Alejandra J.
    Benes, Bedrich
    [J]. INFORMATICS-BASEL, 2022, 9 (01):
  • [7] Measuring Multimodal Synchrony for Human-Computer Interaction
    Reidsma, Dennis
    Nijholt, Anton
    Tschacher, Wolfgang
    Ramseyer, Fabian
    [J]. 2010 INTERNATIONAL CONFERENCE ON CYBERWORLDS (CW 2010), 2010, : 67 - 71
  • [8] Gaze tracking for multimodal human-computer interaction
    Stiefelhagen, R
    Yang, J
    [J]. 1997 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOLS I - V: VOL I: PLENARY, EXPERT SUMMARIES, SPECIAL, AUDIO, UNDERWATER ACOUSTICS, VLSI; VOL II: SPEECH PROCESSING; VOL III: SPEECH PROCESSING, DIGITAL SIGNAL PROCESSING; VOL IV: MULTIDIMENSIONAL SIGNAL PROCESSING, NEURAL NETWORKS - VOL V: STATISTICAL SIGNAL AND ARRAY PROCESSING, APPLICATIONS, 1997, : 2617 - 2620
  • [9] Human Factors and Human-Computer Interaction Considerations in NextGen
    Vu, Kim-Phuong L.
    [J]. INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION, 2012, 28 (02) : 75 - 76
  • [10] Multimodal sentence similarity in human-computer interaction systems
    Ferri, Fernando
    Grifoni, Patrizia
    Paolozzi, Stefano
    [J]. KNOWLEDGE-BASED INTELLIGENT INFORMATION AND ENGINEERING SYSTEMS: KES 2007 - WIRN 2007, PT II, PROCEEDINGS, 2007, 4693 : 403 - 410