A multimodal approach to communicative interactivity classification

被引：5
|
作者：
Rutkowski, Tomasz M. [1 ]
Mandic, Danilo
Barros, Allan Kardec
机构：
[1] RIKEN, Brain Sci Inst, Wako, Saitama, Japan
[2] Univ London Imperial Coll Sci Technol & Med, Dept Elect & Elect Engn, London, England
[3] Univ Fed Maranhao, Lab Biol Informat Proc, Sao Luis, Maranhao, Brazil
来源：
JOURNAL OF VLSI SIGNAL PROCESSING SYSTEMS FOR SIGNAL IMAGE AND VIDEO TECHNOLOGY | 2007年 / 49卷 / 02期
关键词：
human communication analysis; data fusion; multimedia information processing; audiovisual data fusion;
D O I：
10.1007/s11265-007-0081-6
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
The problem of modality detection in so called communicative interactivity is addressed. Multiple audio and video recordings of human communication are analyzed within this framework, based on fusion of the extracted features. At the decision level, support vector machines (SVMs) are utilized to segregate between the communication modalities. The proposed approach is verified through simulations on real world recordings.
引用
收藏
页码：317 / 328
页数：12
相关论文
共 50 条
  • [1] A Multimodal Approach to Communicative Interactivity Classification
    Tomasz M. Rutkowski
    Danilo Mandic
    Allan Kardec Barros
    [J]. The Journal of VLSI Signal Processing Systems for Signal, Image, and Video Technology, 2007, 49 : 317 - 328
  • [2] Communicative interactivity - A multimodal communicative situation classification approach
    Rutkowski, TM
    Mandic, D
    [J]. ARTIFICIAL NEURAL NETWORKS: FORMAL MODELS AND THEIR APPLICATIONS - ICANN 2005, PT 2, PROCEEDINGS, 2005, 3697 : 741 - 746
  • [3] A hierarchical approach to multimodal classification
    Skowron, A
    Wang, H
    Wojna, A
    Bazan, J
    [J]. ROUGH SETS, FUZZY SETS, DATA MINING, AND GRANULAR COMPUTING, PT 2, PROCEEDINGS, 2005, 3642 : 119 - 127
  • [4] A Multimodal Approach to High Resolution Image Classification
    Givens, Ryan N.
    Walli, Karl C.
    Eismann, Michael T.
    [J]. 2013 IEEE (AIPR) APPLIED IMAGERY PATTERN RECOGNITION WORKSHOP: SENSING FOR CONTROL AND AUGMENTATION, 2013,
  • [5] A multimodal prototypical approach for unsupervised sound classification
    Kushwaha, Saksham Singh
    Fuentes, Magdalena
    [J]. INTERSPEECH 2023, 2023, : 266 - 270
  • [6] A DEEP MULTIMODAL APPROACH FOR MAP IMAGE CLASSIFICATION
    Sawada, Tomoya
    Katsurai, Marie
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 4457 - 4461
  • [7] Multimodal assessment of communicative-pragmatic features in schizophrenia: a machine learning approach
    Parola, Alberto
    Gabbatore, Ilaria
    Berardinelli, Laura
    Salvini, Rogerio
    Bosco, Francesca M.
    [J]. NPJ SCHIZOPHRENIA, 2021, 7 (01):
  • [8] A Multimodal Communicative Approach to the Analysis of Typography in Online English Learner's Dictionaries
    Hao, Junjie
    Xu, Hai
    Hu, Huilian
    [J]. INTERNATIONAL JOURNAL OF LEXICOGRAPHY, 2022, 35 (02) : 234 - 260
  • [9] Multimodal assessment of communicative-pragmatic features in schizophrenia: a machine learning approach
    Alberto Parola
    Ilaria Gabbatore
    Laura Berardinelli
    Rogerio Salvini
    Francesca M. Bosco
    [J]. npj Schizophrenia, 7
  • [10] The multimodal nature of communicative efficiency in social interaction
    Marlou Rasenberg
    Wim Pouw
    Asli Özyürek
    Mark Dingemanse
    [J]. Scientific Reports, 12
12345