Rotation-Invariant and Relation-Aware Cross-Domain Adaptation Object Detection Network for Optical Remote Sensing Images

被引:12
|
作者
Chen, Ying [1 ]
Liu, Qi [2 ,3 ]
Wang, Teng [4 ]
Wang, Bin [4 ]
Meng, Xiaoliang [1 ]
机构
[1] Wuhan Univ, Sch Remote Sensing & Informat Engn, Wuhan 430079, Peoples R China
[2] Southwest Univ, Westa Coll, Tiansheng Rd 2, Chongqing 400715, Peoples R China
[3] Univ Tasmania, Coll Sci & Engn, Churchill Ave, Hobart, Tas 7055, Australia
[4] Surveying & Mapping Inst, Lands & Resource Dept Guangdong Prov, Guangzhou 510500, Peoples R China
基金
中国国家自然科学基金;
关键词
object detection; unsupervised domain adaptation; remote sensing images; rotation invariance; graph convolutional neural network (GCN);
D O I
10.3390/rs13214386
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
In recent years, object detection has shown excellent results on a large number of annotated data, but when there is a discrepancy between the annotated data and the real test data, the performance of the trained object detection model is often degraded when it is directly transferred to the real test dataset. Compared with natural images, remote sensing images have great differences in appearance and quality. Traditional methods need to re-label all image data before interpretation, which will consume a lot of manpower and time. Therefore, it is of practical significance to study the Cross-Domain Adaptation Object Detection (CDAOD) of remote sensing images. To solve the above problems, our paper proposes a Rotation-Invariant and Relation-Aware (RIRA) CDAOD network. We trained the network at the image-level and the prototype-level based on a relation aware graph to align the feature distribution and added the rotation-invariant regularizer to deal with the rotation diversity. The Faster R-CNN network was adopted as the backbone framework of the network. We conducted experiments on two typical remote sensing building detection datasets, and set three domain adaptation scenarios: WHU 2012 -> WHU 2016, Inria (Chicago) -> Inria (Austin), and WHU 2012 -> Inria (Austin). The results show that our method can effectively improve the detection effect in the target domain, and outperform competing methods by obtaining optimal results in all three scenarios.
引用
收藏
页数:22
相关论文
共 50 条
  • [1] Rapid Object Detection in VHR Optical Remote Sensing Images Based on Rotation-Invariant Discrete Hashing
    Xu, Hui
    Liu, Yazhou
    Sun, Quansen
    [J]. PROCEEDINGS 2017 4TH IAPR ASIAN CONFERENCE ON PATTERN RECOGNITION (ACPR), 2017, : 91 - 96
  • [2] Learning Rotation-Invariant Convolutional Neural Networks for Object Detection in VHR Optical Remote Sensing Images
    Cheng, Gong
    Zhou, Peicheng
    Han, Junwei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2016, 54 (12): : 7405 - 7415
  • [3] ROTATION-INVARIANT LATENT SEMANTIC REPRESENTATION LEARNING FOR OBJECT DETECTION IN VHR OPTICAL REMOTE SENSING IMAGES
    Yao, Xiwen
    Feng, Xiaoxu
    Cheng, Gong
    Han, Junwei
    Guo, Lei
    [J]. 2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 1382 - 1385
  • [4] Object detection in VHR optical remote sensing images via learning rotation-invariant HOG feature
    Cheng, Gong
    Zhou, Peicheng
    Yao, Xiwen
    Yao, Chao
    Zhang, Yanbang
    Han, Junwei
    [J]. 2016 4RTH INTERNATIONAL WORKSHOP ON EARTH OBSERVATION AND REMOTE SENSING APPLICATIONS (EORSA), 2016,
  • [5] Rotation-Invariant Feature Learning for Object Detection in VHR Optical Remote Sensing Images by Double-Net
    Zhang, Zhi
    Jiang, Ruoqiao
    Mei, Shaohui
    Zhang, Shun
    Zhang, Yifan
    [J]. IEEE ACCESS, 2020, 8 : 20818 - 20827
  • [6] Ship Detection in Optical Remote Sensing Images Based on Saliency and a Rotation-Invariant Descriptor
    Dong, Chao
    Liu, Jinghong
    Xu, Fang
    [J]. REMOTE SENSING, 2018, 10 (03):
  • [7] Learning rotation-invariant binary codes for efficient object detection from remote sensing images
    Liu, Yazhou
    Xu, Hui
    Sun, Quansen
    [J]. JOURNAL OF APPLIED REMOTE SENSING, 2019, 13 (03)
  • [8] Rotation-Invariant Object Detection in Remote Sensing Images Based on Radial-Gradient Angle
    Lin, Yudong
    He, Hongjie
    Yin, Zhongke
    Chen, Fan
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2015, 12 (04) : 746 - 750
  • [9] Oriented Object Detection for Remote Sensing Images via Object-Wise Rotation-Invariant Semantic Representation
    Zheng, Shangdong
    Wu, Zebin
    Du, Qian
    Xu, Yang
    Wei, Zhihui
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 15
  • [10] Object Classification of Remote Sensing Images Based on Rotation-Invariant Discrete Hashing
    Xu, Hui
    Liu, Yazhou
    Sun, Quansen
    [J]. ADVANCES IN MULTIMEDIA INFORMATION PROCESSING - PCM 2017, PT II, 2018, 10736 : 264 - 274