An Optimized Deep Neural Network Detecting Small and Narrow Rectangular Objects in Google Earth Images

被引:28
|
作者
Jiang, Shenlu [1 ]
Yao, Wei [2 ]
Wong, Man Sing [2 ]
Li, Gen [1 ]
Hong, Zhonghua [3 ,4 ]
Kuc, Tae-Yong [1 ]
Tong, Xiaohua [5 ]
机构
[1] Sungkyunkwan Univ, Coll Informat & Commun Engn, Suwon 440746, South Korea
[2] Hongkong Polytech Univ, Dept Land Surveying & Geoinformat, Hong Kong, Peoples R China
[3] Shanghai Ocean Univ, Coll Informat Technol, Shanghai 201306, Peoples R China
[4] Shanghai Tuyao Informat Sci & Technol Co Ltd, Shanghai 201306, Peoples R China
[5] Tongji Univ, Coll Surveying & Geoinformat, Shanghai 200092, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Neural networks; Object detection; Feature extraction; Remote sensing; Task analysis; Training; Earth; Artificial intelligence; object detection; optical image processing; VEHICLE DETECTION; AERIAL IMAGES;
D O I
10.1109/JSTARS.2020.2975606
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Object detection is an important task for rapidly localizing target objects using high-resolution satellite imagery (HRSI). Although deep learning has been shown an efficient means of detection, object detection in HRSI remains problematic due to variations in object scale and size. In this article, we present a novel deep neural network (DNN) that combines double-shot neural network with misplaced localization strategy that adapts to object detection tasks in satellite images. This novel architecture optimizes the localization of small and narrow rectangular objects, which frequently appear in HRSI images, without accuracy loss on other size and width/height ratio objects. This method outperforms other state-of-art methods. We evaluated our proposed method on the NWPU VHR-10 public dataset and a new benchmark dataset (seven classes of small and narrow rectangular objects, SNRO-7). The NWPU VHR-10 dataset built a dataset for multiclass object detection; however, most labels are assigned in normal size and width/height ratios. SNRO-7 focuses on multiscale and multisize object detection and includes many small-size and narrow rectangular objects. We also evaluated the accuracy difference on DNN training and testing between gray scale and RGB datasets. The results of the experiment on object detection reveal that the mean average precision (MaP) of our method is 82.6% in NWPU VHR-10 and 79.3% in SNRO-7, which exceeds the MaPs of other state-of-the-art object detection neural networks. The model trained with the RGB dataset can achieve similar accuracy (around 79.0% MIoU) testing in both RGB and gray scale datasets. When training the model by mixing RGB and gray scale datasets in different ratios, the accuracy in the RGB channel significantly decreases with increasing gray scale images, but this does not influence the accuracy in the gray scale dataset.
引用
收藏
页码:1068 / 1081
页数:14
相关论文
共 50 条
  • [1] Detecting and mapping tree crowns based on convolutional neural network and Google Earth images
    Yang, Mingxia
    Mou, Yuling
    Liu, Shan
    Meng, Yanrong
    Liu, Zelin
    Li, Peng
    Xiang, Wenhua
    Zhou, Xiaolu
    Peng, Changhui
    INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2022, 108
  • [2] Detecting and classifying small objects in thermal imagery using a deep neural network
    Hemstrom, Fredrik
    Nasstrom, Fredrik
    Karlholm, Jorgen
    ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING IN DEFENSE APPLICATIONS, 2019, 11169
  • [3] A neural-network-based approach to detecting rectangular objects
    Su, Mu-Chun
    Hung, Chao-Hsin
    NEUROCOMPUTING, 2007, 71 (1-3) : 270 - 283
  • [4] An Efficient Deep Neural Network to Classify Large 3D Images With Small Objects
    Park, Jungkyu
    Chledowski, Jakub
    Jastrzebski, Stanislaw
    Witowski, Jan
    Xu, Yanqi
    Du, Linda
    Gaddam, Sushma
    Kim, Eric
    Lewin, Alana
    Parikh, Ujas
    Plaunova, Anastasia
    Chen, Sardius
    Millet, Alexandra
    Park, James
    Pysarenko, Kristine
    Patel, Shalin
    Goldberg, Julia
    Wegener, Melanie
    Moy, Linda
    Heacock, Laura
    Reig, Beatriu
    Geras, Krzysztof J.
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2024, 43 (01) : 351 - 365
  • [5] Neural network algorithm for detecting the boundaries of objects in images in the presence of noise
    Serpeninov, OV
    Samoilin, EA
    AUTOMATIC CONTROL AND COMPUTER SCIENCES, 2003, 37 (05) : 17 - 21
  • [6] Small underwater objects classification in multi-view sonar images using the deep neural network
    Zhu K.
    Tian J.
    Huang H.
    Yi Qi Yi Biao Xue Bao/Chinese Journal of Scientific Instrument, 2020, 41 (01): : 206 - 214
  • [7] Village Detection Based on Deep Semantic Segmentation Network in Google Earth Satellite Images
    Liu, Jiange
    Mu, Dejun
    He, Jian
    TENTH INTERNATIONAL CONFERENCE ON DIGITAL IMAGE PROCESSING (ICDIP 2018), 2018, 10806
  • [8] Deep neural network approaches for detecting gastric polyps in endoscopic images
    Durak, Serdar
    Bayram, Bulent
    Bakirman, Tolga
    Erkut, Murat
    Dogan, Metehan
    Gurturk, Mert
    Akpinar, Burak
    MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING, 2021, 59 (7-8) : 1563 - 1574
  • [9] Deep neural network approaches for detecting gastric polyps in endoscopic images
    Serdar Durak
    Bülent Bayram
    Tolga Bakırman
    Murat Erkut
    Metehan Doğan
    Mert Gürtürk
    Burak Akpınar
    Medical & Biological Engineering & Computing, 2021, 59 : 1563 - 1574
  • [10] Electronic Nose for Detecting Multilevel Diabetes using Optimized Deep Neural Network
    Sarno, Riyanarto
    Sabilla, Shoffi Izza
    Wijaya, Dedy Rahman
    Hariyanto
    ENGINEERING LETTERS, 2020, 28 (01) : 31 - 42