An Optimized Deep Neural Network Detecting Small and Narrow Rectangular Objects in Google Earth Images

被引:28
|
作者
Jiang, Shenlu [1 ]
Yao, Wei [2 ]
Wong, Man Sing [2 ]
Li, Gen [1 ]
Hong, Zhonghua [3 ,4 ]
Kuc, Tae-Yong [1 ]
Tong, Xiaohua [5 ]
机构
[1] Sungkyunkwan Univ, Coll Informat & Commun Engn, Suwon 440746, South Korea
[2] Hongkong Polytech Univ, Dept Land Surveying & Geoinformat, Hong Kong, Peoples R China
[3] Shanghai Ocean Univ, Coll Informat Technol, Shanghai 201306, Peoples R China
[4] Shanghai Tuyao Informat Sci & Technol Co Ltd, Shanghai 201306, Peoples R China
[5] Tongji Univ, Coll Surveying & Geoinformat, Shanghai 200092, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Neural networks; Object detection; Feature extraction; Remote sensing; Task analysis; Training; Earth; Artificial intelligence; object detection; optical image processing; VEHICLE DETECTION; AERIAL IMAGES;
D O I
10.1109/JSTARS.2020.2975606
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Object detection is an important task for rapidly localizing target objects using high-resolution satellite imagery (HRSI). Although deep learning has been shown an efficient means of detection, object detection in HRSI remains problematic due to variations in object scale and size. In this article, we present a novel deep neural network (DNN) that combines double-shot neural network with misplaced localization strategy that adapts to object detection tasks in satellite images. This novel architecture optimizes the localization of small and narrow rectangular objects, which frequently appear in HRSI images, without accuracy loss on other size and width/height ratio objects. This method outperforms other state-of-art methods. We evaluated our proposed method on the NWPU VHR-10 public dataset and a new benchmark dataset (seven classes of small and narrow rectangular objects, SNRO-7). The NWPU VHR-10 dataset built a dataset for multiclass object detection; however, most labels are assigned in normal size and width/height ratios. SNRO-7 focuses on multiscale and multisize object detection and includes many small-size and narrow rectangular objects. We also evaluated the accuracy difference on DNN training and testing between gray scale and RGB datasets. The results of the experiment on object detection reveal that the mean average precision (MaP) of our method is 82.6% in NWPU VHR-10 and 79.3% in SNRO-7, which exceeds the MaPs of other state-of-the-art object detection neural networks. The model trained with the RGB dataset can achieve similar accuracy (around 79.0% MIoU) testing in both RGB and gray scale datasets. When training the model by mixing RGB and gray scale datasets in different ratios, the accuracy in the RGB channel significantly decreases with increasing gray scale images, but this does not influence the accuracy in the gray scale dataset.
引用
收藏
页码:1068 / 1081
页数:14
相关论文
共 50 条
  • [41] Detection of Small Ships in Remote Sensing Images based on Deep Convolutional Neural Network
    Shi, Tingchao
    Liu, Mingyong
    Niu, Yun
    You, Lianggen
    Xuan, Liwei
    Wang, Cong
    GLOBAL OCEANS 2020: SINGAPORE - U.S. GULF COAST, 2020,
  • [42] Fitting objects with implicit polynomials by deep neural network
    Liu, Jingyi
    Yu, Lina
    Sun, Linjun
    Tong, Yuerong
    Wu, Min
    Li, Weijun
    OPTOELECTRONICS LETTERS, 2023, 19 (01) : 60 - 64
  • [43] Fitting objects with implicit polynomials by deep neural network
    LIU Jingyi
    YU Lina
    SUN Linjun
    TONG Yuerong
    WU Min
    LI Weijun
    OptoelectronicsLetters, 2023, 19 (01) : 60 - 64
  • [44] Fitting objects with implicit polynomials by deep neural network
    Jingyi Liu
    Lina Yu
    Linjun Sun
    Yuerong Tong
    Min Wu
    Weijun Li
    Optoelectronics Letters, 2023, 19 : 60 - 64
  • [45] Underwater objects classification method in high-resolution sonar images using deep neural network
    Zhu, Keqing
    Tian, Jie
    Huang, Haining
    Shengxue Xuebao/Acta Acustica, 2019, 44 (04): : 595 - 603
  • [46] Underwater objects classification method in high-resolution sonar images using deep neural network
    ZHU Keqing
    TIAN Jie
    HUANG Haining
    ChineseJournalofAcoustics, 2020, 39 (04) : 454 - 467
  • [47] WOANet: Whale optimized deep neural network for the classification of COVID-19 from radiography images
    Murugan, R.
    Goel, Tripti
    Mirjalili, Seyedali
    Chakrabartty, Deba Kumar
    BIOCYBERNETICS AND BIOMEDICAL ENGINEERING, 2021, 41 (04) : 1702 - 1718
  • [48] A hybrid spectral prediction model for printed images based on whale-optimized deep neural network
    Tian, Dongwen
    Ge, Jinghuan
    Su, Na
    FRONTIERS IN PHYSICS, 2024, 12
  • [49] Optimized network for detecting burr-breakage in images of milling workpieces
    del Castillo, Virginia Riego
    Sanchez-Gonzalez, Lidia
    Strisciuglio, Nicola
    LOGIC JOURNAL OF THE IGPL, 2024, 32 (04) : 624 - 633
  • [50] Detecting Computer Generated Images with Deep Convolutional Neural Networks
    de Rezende, Edmar R. S.
    Ruppert, Guilherme C. S.
    Carvalho, Tiago
    2017 30TH SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI), 2017, : 71 - 78