MULTI-PLATFORM INTELLIGENT SYSTEM FOR MULTIMODAL HUMAN-COMPUTER INTERACTION

被引：5

作者：

Jarosz, Mateusz ^{[1
]}

Nawrocki, Piotr ^{[1
]}

Sniezynski, Bartlomiej ^{[1
]}

Indurkhya, Bipin ^{[1
]}

机构：

[1] AGH Univ Sci & Technol, Inst Comp Sci, Fac Comp Sci Elect & Telecommun, Al A Mickiewicza 30, PL-30059 Krakow, Poland

来源：

COMPUTING AND INFORMATICS | 2021年 / 40卷 / 01期

关键词：

Human-computer interaction; multi-platform; intelligent system architecture; multimodal system; humanoid robot; ROBOT; EMOTION;

D O I：

10.31577/cai_2021_1_83

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

We present a flexible human-robot interaction architecture that incorporates emotions and moods to provide a natural experience for humans. To determine the emotional state of the user, information representing eye gaze and facial expression is combined with other contextual information such as whether the user is asking questions or has been quiet for some time. Subsequently, an appropriate robot behaviour is selected from a multi-path scenario. This architecture can be easily adapted to interactions with non-embodied robots such as avatars on a mobile device or a PC. We present the outcome of evaluating an implementation of our proposed architecture as a whole, and also of its modules for detecting emotions and questions. Results are promising and provide a basis for further development.

引用

页码：83 / 103

页数：21

共 50 条

[1] Speech recognition and intelligent translation under multimodal human-computer interaction system
Huang, Danhua
Xiang, Shuaiqiu
[J]. JOURNAL OF INTELLIGENT SYSTEMS, 2024, 33 (01)
[2] Multimodal human-computer interaction
Turk, M
[J]. REAL-TIME VISION FOR HUMAN-COMPUTER INTERACTION, 2005, : 269 - 283
[3] Multimodal human-computer interaction system for speech rehabilitation
Zhao, Jian
Wang, Liu
Shi, Li-Juan
Kuang, Zhe-Jun
Wang, Si-Bo
Sun, Yuan-Yuan
[J]. Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2020, 50 (04): : 1478 - 1486
[4] A Multimodal Human-Computer Interaction for Smart Learning System
Alzubi, Tareq Mahmod
Alzubi, Jafar A.
Singh, Ashish
Alzubi, Omar A.
Subramanian, Murali
[J]. INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION, 2023,
[5] Multi-Platform Human Computer Interaction in Converged Media Spaces
Robison, D.
Palmer, I. J.
Excell, P. S.
Earnshaw, R. A.
Salem, O. Al Sheikh
[J]. 2009 INTERNATIONAL CONFERENCE ON CYBERWORLDS, 2009, : 279 - +
[6] Multimodal Interfaces of Human-Computer Interaction
Karpov, A. A.
Yusupov, R. M.
[J]. HERALD OF THE RUSSIAN ACADEMY OF SCIENCES, 2018, 88 (01) : 67 - 74
[7] Considerations on Multimodal Human-Computer Interaction
Liu, Chang
Xie, Wenjun
Zhang, Peng
Zhan, Jia
Xiao, Zonghao
[J]. PROCEEDINGS OF 2018 5TH IEEE INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND INTELLIGENCE SYSTEMS (CCIS), 2018, : 331 - 335
[8] MULTIMODAL COLLABORATION AND HUMAN-COMPUTER INTERACTION
Zhang, Zhengyou
[J]. ICME: 2009 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, VOLS 1-3, 2009, : 1596 - 1599
[9] Multimodal human-computer interaction: A survey
Jaimes, Alejandro
Sebe, Nicu
[J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2007, 108 (1-2) : 116 - 134
[10] Modeling multimodal human-computer interaction
Obrenovic, Z
Starcevic, D
[J]. COMPUTER, 2004, 37 (09) : 65 - +

← 1 2 3 4 5 →