Rotation-Invariant and Relation-Aware Cross-Domain Adaptation Object Detection Network for Optical Remote Sensing Images

被引:12
|
作者
Chen, Ying [1 ]
Liu, Qi [2 ,3 ]
Wang, Teng [4 ]
Wang, Bin [4 ]
Meng, Xiaoliang [1 ]
机构
[1] Wuhan Univ, Sch Remote Sensing & Informat Engn, Wuhan 430079, Peoples R China
[2] Southwest Univ, Westa Coll, Tiansheng Rd 2, Chongqing 400715, Peoples R China
[3] Univ Tasmania, Coll Sci & Engn, Churchill Ave, Hobart, Tas 7055, Australia
[4] Surveying & Mapping Inst, Lands & Resource Dept Guangdong Prov, Guangzhou 510500, Peoples R China
基金
中国国家自然科学基金;
关键词
object detection; unsupervised domain adaptation; remote sensing images; rotation invariance; graph convolutional neural network (GCN);
D O I
10.3390/rs13214386
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
In recent years, object detection has shown excellent results on a large number of annotated data, but when there is a discrepancy between the annotated data and the real test data, the performance of the trained object detection model is often degraded when it is directly transferred to the real test dataset. Compared with natural images, remote sensing images have great differences in appearance and quality. Traditional methods need to re-label all image data before interpretation, which will consume a lot of manpower and time. Therefore, it is of practical significance to study the Cross-Domain Adaptation Object Detection (CDAOD) of remote sensing images. To solve the above problems, our paper proposes a Rotation-Invariant and Relation-Aware (RIRA) CDAOD network. We trained the network at the image-level and the prototype-level based on a relation aware graph to align the feature distribution and added the rotation-invariant regularizer to deal with the rotation diversity. The Faster R-CNN network was adopted as the backbone framework of the network. We conducted experiments on two typical remote sensing building detection datasets, and set three domain adaptation scenarios: WHU 2012 -> WHU 2016, Inria (Chicago) -> Inria (Austin), and WHU 2012 -> Inria (Austin). The results show that our method can effectively improve the detection effect in the target domain, and outperform competing methods by obtaining optimal results in all three scenarios.
引用
收藏
页数:22
相关论文
共 50 条
  • [41] Cross-Domain Land Cover Classification of Remote Sensing Images Based on Full-Level Domain Adaptation
    Meng, Yuke
    Yuan, Zhanliang
    Yang, Jian
    Liu, Peizhuo
    Yan, Jian
    Zhu, Hongbo
    Ma, Zhigao
    Jiang, Zhenzhao
    Zhang, Zhouwei
    Mi, Xiaofei
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 11434 - 11450
  • [42] Domain Generalized Object Detection for Remote Sensing Images
    Durakli, Efkan
    Aptoula, Erchan
    [J]. 2023 31ST SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE, SIU, 2023,
  • [43] Boundary-Aware Salient Object Detection in Optical Remote-Sensing Images
    Yu, Longxuan
    Zhou, Xiaofei
    Wang, Lingbo
    Zhang, Jiyong
    [J]. ELECTRONICS, 2022, 11 (24)
  • [44] Semantic Context-Aware Network for Multiscale Object Detection in Remote Sensing Images
    Zhang, Ke
    Wu, Yulin
    Wang, Jingyu
    Wang, Yezi
    Wang, Qi
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [45] Cross-View Adaptation Network for Cross-Domain Relation Extraction
    Yan, Bo
    Zhang, Dongmei
    Wang, Huadong
    Wu, Chunhua
    [J]. CHINESE COMPUTATIONAL LINGUISTICS, CCL 2019, 2019, 11856 : 306 - 317
  • [46] DOMAIN-INVARIANT REGION PROPOSAL NETWORK FOR CROSS-DOMAIN DETECTION
    Yang, Xuebin
    Wan, Shouhong
    Jin, Peiquan
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2020,
  • [47] Attention Guided Network for Salient Object Detection in Optical Remote Sensing Images
    Lin, Yuhan
    Sun, Han
    Liu, Ningzhong
    Bian, Yetong
    Cen, Jun
    Zhou, Huiyu
    [J]. ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2022, PT I, 2022, 13529 : 25 - 36
  • [48] Adjacent Complementary Network for Salient Object Detection in Optical Remote Sensing Images
    Song, Dawei
    Dong, Yongsheng
    Li, Xuelong
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [49] Sequential Instance Refinement for Cross-Domain Object Detection in Images
    Chen, Jin
    Wu, Xinxiao
    Duan, Lixin
    Chen, Lin
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 3970 - 3984
  • [50] Inter- and Intra-Domain Relation-Aware Heterogeneous Graph Convolutional Networks for Cross-Domain Recommendation
    Wang, Ke
    Zhu, Yanmin
    Liu, Haobing
    Zang, Tianzi
    Wang, Chunyang
    Liu, Kuan
    [J]. DATABASE SYSTEMS FOR ADVANCED APPLICATIONS, DASFAA 2022, PT II, 2022, : 53 - 68