Multi-modal local receptive field extreme learning machine for object recognition

被引:28
|
作者
Liu, Huaping [1 ]
Li, Fengxue [1 ]
Xu, Xinying [1 ]
Sun, Fuchun [1 ]
机构
[1] Tsinghua Univ, State Key Lab Intelligent Technol & Syst, TNLIST, Dept Comp Sci & Technol, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Representation learning; Multi-modal; Local receptive field; Extreme learning machine; FEEDFORWARD NETWORKS;
D O I
10.1016/j.neucom.2017.04.077
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Learning rich representations efficiently plays an important role in the multi-modal recognition task, which is crucial to achieving high generalization performance. To address this problem, in this paper, we propose an effective Multi-Modal Local Receptive Field Extreme Learning Machine (MM-LRF-ELM) structure, while maintaining ELM's advantages of training efficiency. In this structure, LRF-ELM is first conducted for feature extraction for each modality separately. And then, the shared layer is developed by combining these features from each modality. Finally, the Extreme Learning Machine (ELM) is used as supervised feature classifier for the final decision. Experimental validation on Washington RGB-D Object Dataset illustrates that the proposed multiple modality fusion method achieves better recognition performance. (C) 2017 Elsevier B.V. All rights reserved.
引用
收藏
页码:4 / 11
页数:8
相关论文
共 50 条
  • [21] Multi-modal deep learning for landform recognition
    Du, Lin
    You, Xiong
    Li, Ke
    Meng, Liqiu
    Cheng, Gong
    Xiong, Liyang
    Wang, Guangxia
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2019, 158 : 63 - 75
  • [22] Correntropy Extreme Learning Machine Based on Spatial Pyramid Matching and Local Receptive Field
    Liu Bin
    Liu Jing
    Wu Chao
    Yang Youheng
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2021, 43 (08) : 2343 - 2351
  • [23] Local Receptive Field-Extreme Learning Machine based Adult Content Detection
    AlDahoul, Nouar
    Karim, Hezerul Abdul
    Abdullah, Mohd Haris Lye
    Fauzi, Mohamad Faizal Ahmad
    Mansour, Sarina
    See, John
    PROCEEDINGS OF THE 2019 IEEE INTERNATIONAL CONFERENCE ON SIGNAL AND IMAGE PROCESSING APPLICATIONS (IEEE ICSIPA 2019), 2019, : 128 - 133
  • [24] Extreme learning machine with multi-scale local receptive fields for texture classification
    Huang, Jinghong
    Yu, Zhu Liang
    Cai, Zhaoquan
    Gu, Zhenghui
    Cai, Zhiyin
    Gao, Wei
    Yu, Shengfeng
    Du, Qianyun
    MULTIDIMENSIONAL SYSTEMS AND SIGNAL PROCESSING, 2017, 28 (03) : 995 - 1011
  • [25] Extreme learning machine with multi-scale local receptive fields for texture classification
    Jinghong Huang
    Zhu Liang Yu
    Zhaoquan Cai
    Zhenghui Gu
    Zhiyin Cai
    Wei Gao
    Shengfeng Yu
    Qianyun Du
    Multidimensional Systems and Signal Processing, 2017, 28 : 995 - 1011
  • [26] RetrievalMMT: Retrieval-Constrained Multi-Modal Prompt Learning for Multi-Modal Machine Translation
    Wang, Yan
    Zeng, Yawen
    Liang, Junjie
    Xing, Xiaofen
    Xu, Jin
    Xu, Xiangmin
    PROCEEDINGS OF THE 4TH ANNUAL ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, ICMR 2024, 2024, : 860 - 868
  • [27] Multi-modal user identification and object recognition surveillance system
    Clapes, Albert
    Reyes, Miguel
    Escalera, Sergio
    PATTERN RECOGNITION LETTERS, 2013, 34 (07) : 799 - 808
  • [28] Multi-modal Extreme Classification
    Mittal, Anshul
    Dahiya, Kunal
    Malani, Shreya
    Ramaswamy, Janani
    Kuruvilla, Seba
    Ajmera, Jitendra
    Chang, Keng-Hao
    Agarwal, Sumeet
    Kar, Purushottam
    Varma, Manik
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 12383 - 12392
  • [29] Emotion recognition using multi-modal data and machine learning techniques: A tutorial and review
    Zhang, Jianhua
    Yin, Zhong
    Chen, Peng
    Nichele, Stefano
    INFORMATION FUSION, 2020, 59 : 103 - 126
  • [30] Local receptive field based extreme learning machine with three channels for histopathological image classification
    Fang, Jing
    Xu, Xinying
    Liu, Huaping
    Sun, Fuchun
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2019, 10 (06) : 1437 - 1447