A Multimodal Approach to Communicative Interactivity Classification

被引:0
|
作者
Tomasz M. Rutkowski
Danilo Mandic
Allan Kardec Barros
机构
[1] RIKEN,Brain Science Institute
[2] Imperial College of Science,Department of Electrical and Electronic Engineering
[3] Technology and Medicine,Laboratory for Biological Information Processing
[4] Universidade Federal do Maranhāo,undefined
关键词
human communication analysis; data fusion; multimedia information processing; audiovisual data fusion;
D O I
暂无
中图分类号
学科分类号
摘要
The problem of modality detection in so called communicative interactivity is addressed. Multiple audio and video recordings of human communication are analyzed within this framework, based on fusion of the extracted features. At the decision level, support vector machines (SVMs) are utilized to segregate between the communication modalities. The proposed approach is verified through simulations on real world recordings.
引用
收藏
页码:317 / 328
页数:11
相关论文
共 50 条
  • [21] Perception of Multimodal Hedges in Communicative Behavior of a Companion Robot
    Malkina, Maria
    Kotov, Artemiy
    Zinina, Anna
    [J]. 2022 10TH INTERNATIONAL CONFERENCE ON AFFECTIVE COMPUTING AND INTELLIGENT INTERACTION WORKSHOPS AND DEMOS, ACIIW, 2022,
  • [22] The will for terroir: A communicative approach
    Castello, Enric
    [J]. JOURNAL OF RURAL STUDIES, 2021, 86 : 386 - 397
  • [23] The communicative wheel: Symptom, signal, and model in multimodal communication
    Durst-Andersen, Per
    Cobley, Paul
    [J]. SEMIOTICA, 2018, (225) : 77 - 102
  • [24] Kontakte: A Communicative Approach
    Henderson, Dayton
    Nikolai, Brigitte
    Terrell, Tracy D.
    [J]. UNTERRICHTSPRAXIS-TEACHING GERMAN, 2008, 41 (02): : 204 - 205
  • [25] Multimodal Interactivity in the Foreign Language Section of the Spanish University Admission Examination
    Magal-Royo, Teresa
    Gimenez Lopez, Jose Luis
    [J]. REVISTA DE EDUCACION, 2012, (357): : 163 - 176
  • [26] Emotion Classification from Speech and Text in Videos Using a Multimodal Approach
    Caschera, Maria Chiara
    Grifoni, Patrizia
    Ferri, Fernando
    [J]. MULTIMODAL TECHNOLOGIES AND INTERACTION, 2022, 6 (04)
  • [27] New approach to the mass multipurpose interactivity
    [J]. Elektrosvyaz, 5 (3-7):
  • [28] A Boosting-based Approach for Remote Sensing Multimodal Image Classification
    Ferreira, Edemir, Jr.
    Araujo, Arnaldo de A.
    dos Santos, Jefersson A.
    [J]. 2016 29TH SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI), 2016, : 416 - 423
  • [29] A Multimodal Transfer Learning Approach Using PubMedCLIP for Medical Image Classification
    Dao, Hong N.
    Nguyen, Tuyen
    Mugisha, Cherubin
    Paik, Incheon
    [J]. IEEE ACCESS, 2024, 12 : 75496 - 75507
  • [30] A multimodal temporal panorama approach for moving vehicle detection, reconstruction and classification
    Wang, Tao
    Zhu, Zhigang
    [J]. GROUND/AIR MULTISENSOR INTEROPERABILITY, INTEGRATION, AND NETWORKING FOR PERSISTENT ISR III, 2012, 8389