RSDet plus plus : Point-Based Modulated Loss for More Accurate Rotated Object Detection

被引:29
|
作者
Qian, Wen [1 ,2 ]
Yang, Xue [3 ]
Peng, Silong [1 ,2 ]
Zhang, Xiujuan [4 ]
Yan, Junchi [3 ]
机构
[1] Chinese Acad Sci, Inst Automat, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 101408, Peoples R China
[3] Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, Shanghai 200240, Peoples R China
[4] Inner Mongolia Key Lab Mol Biol Featured Plants, Hohhot 010018, Peoples R China
关键词
Object detection; Detectors; Sensitivity; Feature extraction; Benchmark testing; Training; Measurement units; Rotated object detection; modulated loss; point-based; tiny objects; TEXT DETECTION; NETWORK; REFINEMENT;
D O I
10.1109/TCSVT.2022.3186070
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
We classify the discontinuity of loss in both five-param and eight-param rotated object detection methods as rotation sensitivity error (RSE) which will result in performance degeneration. We introduce a novel modulated rotation loss to alleviate the problem and a rotation sensitivity detection network (RSDet) which consists of an eight-param single-stage rotated object detector and the modulated rotation loss. Our proposed RSDet has several advantages: 1) it reformulates the rotated object detection problem as predicting the corners of objects while most previous methods employ a five-param-based regression method with different measurement units. 2) modulated rotation loss achieves consistent improvement on both five-param and eight-param rotated object detection methods by solving the discontinuity of loss. To further improve the accuracy of our method on objects smaller than 10 pixels, we introduce a novel RSDet++ which consists of a point-based anchor-free rotated object detector and a modulated rotation loss. Extensive experiments demonstrate the effectiveness of both RSDet and RSDet++, which achieve competitive results on rotated object detection in the challenging benchmarks DOTA-v1.0, DOTA-v1.5, and DOTA-v2.0. We hope the proposed method can provide a new perspective for designing algorithms to solve rotated object detection and pay more attention to tiny objects. The codes and models are available at: https://github.com/yangxue0827/RotationDetection.
引用
收藏
页码:7869 / 7879
页数:11
相关论文
共 48 条
  • [1] Learning Modulated Loss for Rotated Object Detection
    Qian, Wen
    Yang, Xue
    Peng, Silonge
    Yan, Junchi
    GuO, Yue
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 2458 - 2466
  • [2] NPBG plus plus : Accelerating Neural Point-Based Graphics
    Rakhimov, Ruslan
    Ardelean, Andrei-Timotei
    Lempitsky, Victor
    Burnaev, Evgeny
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 15948 - 15958
  • [3] PointNeRF plus plus : A Multi-scale, Point-Based Neural Radiance Field
    Sun, Weiwei
    Trulls, Eduard
    Tseng, Yang-Che
    Sambandam, Sneha
    Sharma, Gopal
    Tagliasacchi, Andrea
    Yi, Kwang Moo
    COMPUTER VISION-ECCV 2024, PT XXXVIII, 2025, 15096 : 221 - 238
  • [4] PPDM plus plus : Parallel Point Detection and Matching for Fast and Accurate HOI Detection
    Liao, Yue
    Liu, Si
    Gao, Yulu
    Zhang, Aixi
    Li, Zhimin
    Wang, Fei
    Li, Bo
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (10) : 6826 - 6841
  • [5] R-FCN plus plus : Towards Accurate Region-Based Fully Convolutional Networks for Object Detection
    Li, Zeming
    Chen, Yilun
    Yu, Gang
    Deng, Yangdong
    THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 7073 - 7080
  • [6] Point-Based Learnable Query Generator for Human–Object Interaction Detection
    Lin, Wang-Kai
    Zhang, Hong-Bo
    Fan, Zongwen
    Liu, Jing-Hua
    Yang, Li-Jie
    Lei, Qing
    Du, Jixiang
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 6469 - 6484
  • [7] RoCNet plus plus : Triangle-based descriptor for accurate and robust point cloud registration
    Slimani, Karim
    Achard, Catherine
    Tamadazte, Brahim
    PATTERN RECOGNITION, 2024, 147
  • [8] Point-Based Estimator for Arbitrary-Oriented Object Detection in Aerial Images
    Fu, Kun
    Chang, Zhonghan
    Zhang, Yue
    Sun, Xian
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (05): : 4370 - 4387
  • [9] ERASOR plus plus : Height Coding Plus Egocentric Ratio Based Dynamic Object Removal for Static Point Cloud Mapping
    Zhang, Jiabao
    Zhang, Yu
    2024 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA 2024, 2024, : 4067 - 4073
  • [10] Semantics feature sampling for point-based 3D object detection
    Huang, Jing-Dong
    Du, Ji-Xiang
    Zhang, Hong-Bo
    Liu, Huai-Jin
    IMAGE AND VISION COMPUTING, 2024, 149