Multi-representation adaptation network for cross-domain image classification

被引:165
|
作者
Zhu, Yongchun [1 ,2 ]
Zhuang, Fuzhen [1 ,2 ]
Wang, Jindong [3 ]
Chen, Jingwu [1 ,2 ]
Shi, Zhiping [4 ]
Wu, Wenjuan [5 ]
He, Qing [1 ,2 ]
机构
[1] Chinese Acad Sci, Inst Comp Technol, Key Lab Intelligent Informat Proc, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] Microsoft Res, Beijing, Peoples R China
[4] Capital Normal Univ, Beijing, Peoples R China
[5] Renmin Univ China, Sch Informat, Beijing 100872, Peoples R China
基金
中国国家自然科学基金;
关键词
Domain adaptation; Multi-representation; KERNEL; ALIGNMENT;
D O I
10.1016/j.neunet.2019.07.010
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In image classification, it is often expensive and time-consuming to acquire sufficient labels. To solve this problem, domain adaptation often provides an attractive option given a large amount of labeled data from a similar nature but different domains. Existing approaches mainly align the distributions of representations extracted by a single structure and the representations may only contain partial information, e.g., only contain part of the saturation, brightness, and hue information. Along this line, we propose Multi-Representation Adaptation which can dramatically improve the classification accuracy for cross-domain image classification and specially aims to align the distributions of multiple representations extracted by a hybrid structure named Inception Adaptation Module (IAM). Based on this, we present Multi-Representation Adaptation Network (MRAN) to accomplish the cross-domain image classification task via multi-representation alignment which can capture the information from different aspects. In addition, we extend Maximum Mean Discrepancy (MMD) to compute the adaptation loss. Our approach can be easily implemented by extending most feed-forward models with IAM, and the network can be trained efficiently via back-propagation. Experiments conducted on three benchmark image datasets demonstrate the effectiveness of MRAN. (C) 2019 Elsevier Ltd. All rights reserved.
引用
收藏
页码:214 / 221
页数:8
相关论文
共 50 条
  • [1] Multi-Source and Multi-Representation Adaptation for Cross-Domain Electroencephalography Emotion Recognition
    Cao, Jiangsheng
    He, Xueqin
    Yang, Chenhui
    Chen, Sifang
    Li, Zhangyu
    Wang, Zhanxiang
    [J]. FRONTIERS IN PSYCHOLOGY, 2022, 12
  • [2] A DISCRIMINATIVE DOMAIN ADAPTATION MODEL FOR CROSS-DOMAIN IMAGE CLASSIFICATION
    Chou, Yen-Cheng
    Wei, Chia-Po
    Wang, Yu-Chiang Frank
    [J]. 2013 20TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2013), 2013, : 3083 - 3087
  • [3] Unsupervised Domain Adaptation for Cross-domain Histopathology Image Classification
    Xiangning Li
    Chen Pan
    Lingmin He
    Xinyu Li
    [J]. Multimedia Tools and Applications, 2024, 83 : 23311 - 23331
  • [4] Unsupervised Domain Adaptation for Cross-domain Histopathology Image Classification
    Li, Xiangning
    Pan, Chen
    He, Lingmin
    Li, Xinyu
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (8) : 23311 - 23331
  • [5] Unsupervised Domain Adaptation for Cross-domain Histopathology Image Classification
    Li, Xiangning
    Pan, Chen
    He, Lingmin
    Li, Xinyu
    [J]. Multimedia Tools and Applications, 2024, 83 (08) : 23311 - 23331
  • [6] A Multi-Domain and Multi-Modal Representation Disentangler for Cross-Domain Image Manipulation and Classification
    Yang, Fu-En
    Chang, Jing-Cheng
    Tsai, Chung-Chi
    Wang, Yu-Chiang Frank
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 2795 - 2807
  • [7] Multi-Representation Dynamic Adaptation Network for Remote Sensing Scene Classification
    Niu, Ben
    Pan, Zongxu
    Wu, Jixiang
    Hu, Yuxin
    Lei, Bin
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [8] Multi-Representation Joint Dynamic Domain Adaptation Network for Cross-Database Facial Expression Recognition
    Yan, Jingjie
    Yue, Yuebo
    Yu, Kai
    Zhou, Xiaoyang
    Liu, Ying
    Wei, Jinsheng
    Yang, Yuan
    [J]. ELECTRONICS, 2024, 13 (08)
  • [9] Adversarial Domain Adaptation with Semantic Consistency for Cross-Domain Image Classification
    Cao, Manliang
    Zhou, Xiangdong
    Xu, Yiming
    Pang, Yue
    Yao, Bo
    [J]. PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT (CIKM '19), 2019, : 259 - 268
  • [10] Cross-domain Network Traffic Classification Using Unsupervised Domain Adaptation
    Li, Dongpu
    Yuan, Qifeng
    Li, Tan
    Chen, Shuangwu
    Yang, Jian
    [J]. 2020 34TH INTERNATIONAL CONFERENCE ON INFORMATION NETWORKING (ICOIN 2020), 2020, : 245 - +