An Optimized Deep Neural Network Detecting Small and Narrow Rectangular Objects in Google Earth Images

被引:28
|
作者
Jiang, Shenlu [1 ]
Yao, Wei [2 ]
Wong, Man Sing [2 ]
Li, Gen [1 ]
Hong, Zhonghua [3 ,4 ]
Kuc, Tae-Yong [1 ]
Tong, Xiaohua [5 ]
机构
[1] Sungkyunkwan Univ, Coll Informat & Commun Engn, Suwon 440746, South Korea
[2] Hongkong Polytech Univ, Dept Land Surveying & Geoinformat, Hong Kong, Peoples R China
[3] Shanghai Ocean Univ, Coll Informat Technol, Shanghai 201306, Peoples R China
[4] Shanghai Tuyao Informat Sci & Technol Co Ltd, Shanghai 201306, Peoples R China
[5] Tongji Univ, Coll Surveying & Geoinformat, Shanghai 200092, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Neural networks; Object detection; Feature extraction; Remote sensing; Task analysis; Training; Earth; Artificial intelligence; object detection; optical image processing; VEHICLE DETECTION; AERIAL IMAGES;
D O I
10.1109/JSTARS.2020.2975606
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Object detection is an important task for rapidly localizing target objects using high-resolution satellite imagery (HRSI). Although deep learning has been shown an efficient means of detection, object detection in HRSI remains problematic due to variations in object scale and size. In this article, we present a novel deep neural network (DNN) that combines double-shot neural network with misplaced localization strategy that adapts to object detection tasks in satellite images. This novel architecture optimizes the localization of small and narrow rectangular objects, which frequently appear in HRSI images, without accuracy loss on other size and width/height ratio objects. This method outperforms other state-of-art methods. We evaluated our proposed method on the NWPU VHR-10 public dataset and a new benchmark dataset (seven classes of small and narrow rectangular objects, SNRO-7). The NWPU VHR-10 dataset built a dataset for multiclass object detection; however, most labels are assigned in normal size and width/height ratios. SNRO-7 focuses on multiscale and multisize object detection and includes many small-size and narrow rectangular objects. We also evaluated the accuracy difference on DNN training and testing between gray scale and RGB datasets. The results of the experiment on object detection reveal that the mean average precision (MaP) of our method is 82.6% in NWPU VHR-10 and 79.3% in SNRO-7, which exceeds the MaPs of other state-of-the-art object detection neural networks. The model trained with the RGB dataset can achieve similar accuracy (around 79.0% MIoU) testing in both RGB and gray scale datasets. When training the model by mixing RGB and gray scale datasets in different ratios, the accuracy in the RGB channel significantly decreases with increasing gray scale images, but this does not influence the accuracy in the gray scale dataset.
引用
收藏
页码:1068 / 1081
页数:14
相关论文
共 50 条
  • [31] Mapping agricultural plastic greenhouses using Google Earth images and deep learning
    Chen, Wei
    Xu, Yameng
    Zhang, Zhe
    Yang, Lan
    Pan, Xubin
    Jia, Zhe
    COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2021, 191 (191)
  • [32] MONOCULAR DEPTH ESTIMATION OF GOOGLE EARTH IMAGES USING CONVOLUTIONAL NEURAL NETWORKS
    Najaf, M.
    Arefi, H.
    Amirkolaee, H. Amini
    Farajelahi, B.
    ISPRS GEOSPATIAL CONFERENCE 2022, JOINT 6TH SENSORS AND MODELS IN PHOTOGRAMMETRY AND REMOTE SENSING, SMPR/4TH GEOSPATIAL INFORMATION RESEARCH, GIRESEARCH CONFERENCES, VOL. 10-4, 2023, : 589 - 594
  • [33] Neural Network Method for Detecting Blur in Histological Images
    Nazarenko, G. S.
    Krylov, A. S.
    PROGRAMMING AND COMPUTER SOFTWARE, 2024, 50 (03) : 224 - 230
  • [34] Detecting objects using Rolling Convolution and Recurrent Neural Network
    Huang, WenQing
    Huang, MingZhu
    Wang, YaMing
    INTERNATIONAL JOURNAL OF ELECTRONICS AND TELECOMMUNICATIONS, 2019, 65 (02) : 293 - 301
  • [35] Detecting Position of Multi-objects Based on Neural Network
    Hou, Junyi
    DCABES 2008 PROCEEDINGS, VOLS I AND II, 2008, : 243 - 246
  • [36] Convolutional Neural Network for Detecting Deepfake Palmprint Images
    Min-Jen, Tsai
    Cheng-Tao, Chang
    IEEE ACCESS, 2024, 12 : 103405 - 103418
  • [37] Automatic Building Extraction from Google Earth Images under Complex Backgrounds Based on Deep Instance Segmentation Network
    Wen, Qi
    Jiang, Kaiyu
    Wang, Wei
    Liu, Qingjie
    Guo, Qing
    Li, Lingling
    Wang, Ping
    SENSORS, 2019, 19 (02)
  • [38] Identifying the vegetation type in Google Earth images using a convolutional neural network: a case study for Japanese bamboo forests
    Watanabe, Shuntaro
    Sumi, Kazuaki
    Ise, Takeshi
    BMC ECOLOGY, 2020, 20 (01)
  • [39] OLCN: An Optimized Low Coupling Network for Small Objects Detection
    Yuan, Yuan
    Zhang, Yuanlin
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [40] DETECTING SMALL OBJECTS IN HIGH RESOLUTION IMAGES WITH INTEGRAL FISHER SCORE
    Leyva, Roberto
    Sanchez, Victor
    Li, Chang-Tsun
    2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 316 - 320