Multiple Instance Graph Learning for Weakly Supervised Remote Sensing Object Detection

被引:49
|
作者
Wang, Binglu [1 ,2 ]
Zhao, Yongqiang [1 ,3 ]
Li, Xuelong [2 ]
机构
[1] Northwestern Polytech Univ, Sch Automat Engn, Xian 710072, Peoples R China
[2] Northwestern Polytech Univ, Sch Artificial Intelligence Opt & Elect iOPEN, Xian 710072, Peoples R China
[3] Northwestern Polytech Univ Shenzhen, Res & Dev Inst, Shenzhen 518057, Peoples R China
基金
中国国家自然科学基金;
关键词
Multiple instance graph (MIG) learning; object detection; remote sensing images (RSIs); weakly supervised learning; ROTATION-INVARIANT; TARGET DETECTION; IMAGES; MODEL; FEATURES;
D O I
10.1109/TGRS.2021.3123231
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Weakly supervised object detection (WSOD) has recently attracted much attention in the field of remote sensing, where only image-level labels that distinguish the existence of an object in images are required. However, existing methods frequently treat the most discriminative area of an object as the optimal solution and, meanwhile, ignore the fact that more than one instance may exist in a certain class in remote sensing images (RSIs). To address the issue, we propose a unique multiple instance graph (MIG) learning framework for WSOD in RSIs. The motivation of this work is twofold: 1) a spatial graph-based vote (SGV) mechanism is proposed to find high-quality objects by collecting the top-ranking votes with highly spatial overlap and 2) an appearance graph-based instance mining (AGIM) model is further constructed to exploit all possible instances with the same class by propagating the label information according to the apparent similarity. It is noted that the formulated MIG framework that collaborates SGV and AGIM is independent of extra hyperparameters or annotations. Experimental results reported for two well-known benchmarks, i.e., NWPU VHR-10.v2 and DIOR, testify to the superiority of the proposed framework by 55.9% and 25.11% mAPs.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Multiple Instance Graph Learning for Weakly Supervised Remote Sensing Object Detection
    Wang, Binglu
    Zhao, Yongqiang
    Li, Xuelong
    [J]. IEEE Transactions on Geoscience and Remote Sensing, 2022, 60
  • [2] Discrepant multiple instance learning for weakly supervised object detection
    Gao, Wei
    Wan, Fang
    Yue, Jun
    Xu, Songcen
    Ye, Qixiang
    [J]. PATTERN RECOGNITION, 2022, 122
  • [3] Multiple Instance Complementary Detection and Difficulty Evaluation for Weakly Supervised Object Detection in Remote Sensing Images
    Huo, Yu
    Qian, Xiaoliang
    Li, Chao
    Wang, Wei
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [4] Continuation Multiple Instance Learning for Weakly and Fully Supervised Object Detection
    Ye, Qixiang
    Wan, Fang
    Liu, Chang
    Huang, Qingming
    Ji, Xiangyang
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (10) : 5452 - 5466
  • [5] Progressive Contextual Instance Refinement for Weakly Supervised Object Detection in Remote Sensing Images
    Feng, Xiaoxu
    Han, Junwei
    Yao, Xiwen
    Cheng, Gong
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (11): : 8002 - 8012
  • [6] Complete and Invariant Instance Classifier Refinement for Weakly Supervised Object Detection in Remote Sensing Images
    Qian, Xiaoliang
    Wang, Chenhao
    Wang, Wei
    Yao, Xiwen
    Cheng, Gong
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [7] ORIENTED OBJECT DETECTION FOR REMOTE SENSING IMAGES BASED ON WEAKLY SUPERVISED LEARNING
    Sun, Yongqing
    Ran, Jie
    Yang, Feng
    Gao, Chenqiang
    Kurozumi, Takayuki
    Kimata, Hideaki
    Ye, Ziqi
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW), 2021,
  • [8] C-MIL: Continuation Multiple Instance Learning for Weakly Supervised Object Detection
    Wan, Fang
    Liu, Chang
    Ke, Wei
    Ji, Xiangyang
    Jiao, Jianbin
    Ye, Qixiang
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 2194 - 2203
  • [9] Object Instance Mining for Weakly Supervised Object Detection
    Lin, Chenhao
    Wang, Siwen
    Xu, Dongqi
    Lu, Yu
    Zhang, Wayne
    [J]. THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 11482 - 11489
  • [10] Weakly Supervised Object Detection for Remote Sensing Images: A Survey
    Fasana, Corrado
    Pasini, Samuele
    Milani, Federico
    Fraternali, Piero
    [J]. REMOTE SENSING, 2022, 14 (21)