A Multimodal Approach to Communicative Interactivity Classification

被引：0
|
作者：
Tomasz M. Rutkowski
Danilo Mandic
Allan Kardec Barros
机构：
[1] RIKEN,Brain Science Institute
[2] Imperial College of Science,Department of Electrical and Electronic Engineering
[3] Technology and Medicine,Laboratory for Biological Information Processing
[4] Universidade Federal do Maranhāo,undefined
来源：
The Journal of VLSI Signal Processing Systems for Signal, Image, and Video Technology | 2007年 / 49卷
关键词：
human communication analysis; data fusion; multimedia information processing; audiovisual data fusion;
D O I：
暂无
中图分类号：
学科分类号：
摘要：
The problem of modality detection in so called communicative interactivity is addressed. Multiple audio and video recordings of human communication are analyzed within this framework, based on fusion of the extracted features. At the decision level, support vector machines (SVMs) are utilized to segregate between the communication modalities. The proposed approach is verified through simulations on real world recordings.
引用
收藏
页码：317 / 328
页数：11
相关论文
共 50 条
  • [1] A multimodal approach to communicative interactivity classification
    Rutkowski, Tomasz M.
    Mandic, Danilo
    Barros, Allan Kardec
    [J]. JOURNAL OF VLSI SIGNAL PROCESSING SYSTEMS FOR SIGNAL IMAGE AND VIDEO TECHNOLOGY, 2007, 49 (02): : 317 - 328
  • [2] Communicative interactivity - A multimodal communicative situation classification approach
    Rutkowski, TM
    Mandic, D
    [J]. ARTIFICIAL NEURAL NETWORKS: FORMAL MODELS AND THEIR APPLICATIONS - ICANN 2005, PT 2, PROCEEDINGS, 2005, 3697 : 741 - 746
  • [3] A hierarchical approach to multimodal classification
    Skowron, A
    Wang, H
    Wojna, A
    Bazan, J
    [J]. ROUGH SETS, FUZZY SETS, DATA MINING, AND GRANULAR COMPUTING, PT 2, PROCEEDINGS, 2005, 3642 : 119 - 127
  • [4] A Multimodal Approach to High Resolution Image Classification
    Givens, Ryan N.
    Walli, Karl C.
    Eismann, Michael T.
    [J]. 2013 IEEE (AIPR) APPLIED IMAGERY PATTERN RECOGNITION WORKSHOP: SENSING FOR CONTROL AND AUGMENTATION, 2013,
  • [5] A multimodal prototypical approach for unsupervised sound classification
    Kushwaha, Saksham Singh
    Fuentes, Magdalena
    [J]. INTERSPEECH 2023, 2023, : 266 - 270
  • [6] A DEEP MULTIMODAL APPROACH FOR MAP IMAGE CLASSIFICATION
    Sawada, Tomoya
    Katsurai, Marie
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 4457 - 4461
  • [7] Multimodal assessment of communicative-pragmatic features in schizophrenia: a machine learning approach
    Parola, Alberto
    Gabbatore, Ilaria
    Berardinelli, Laura
    Salvini, Rogerio
    Bosco, Francesca M.
    [J]. NPJ SCHIZOPHRENIA, 2021, 7 (01):
  • [8] A Multimodal Communicative Approach to the Analysis of Typography in Online English Learner's Dictionaries
    Hao, Junjie
    Xu, Hai
    Hu, Huilian
    [J]. INTERNATIONAL JOURNAL OF LEXICOGRAPHY, 2022, 35 (02) : 234 - 260
  • [9] Multimodal assessment of communicative-pragmatic features in schizophrenia: a machine learning approach
    Alberto Parola
    Ilaria Gabbatore
    Laura Berardinelli
    Rogerio Salvini
    Francesca M. Bosco
    [J]. npj Schizophrenia, 7
  • [10] The multimodal nature of communicative efficiency in social interaction
    Marlou Rasenberg
    Wim Pouw
    Asli Özyürek
    Mark Dingemanse
    [J]. Scientific Reports, 12
12345