Weakly Supervised Detection of Marine Animals in High Resolution Aerial Images

被引:10
|
作者
Berg, Paul [1 ]
Maia, Deise Santana [2 ]
Pham, Minh-Tan [1 ]
Lefevre, Sebastien [1 ]
机构
[1] Univ Bretagne Sud, UMR 6074, Inst Rech Informat & Syst Aleatoires IRISA, F-56000 Vannes, France
[2] Univ Lille, UMR 9189, Ctr Rech Informat Signal & Automat Lille CRIStAL, F-59000 Lille, France
关键词
marine animal monitoring; anomaly detection; deep learning; weakly supervised learning; convolutional neural networks; ENERGY;
D O I
10.3390/rs14020339
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Human activities in the sea, such as intensive fishing and exploitation of offshore wind farms, may impact negatively on the marine mega fauna. As an attempt to control such impacts, surveying, and tracking of marine animals are often performed on the sites where those activities take place. Nowadays, thank to high resolution cameras and to the development of machine learning techniques, tracking of wild animals can be performed remotely and the analysis of the acquired images can be automatized using state-of-the-art object detection models. However, most state-of-the-art detection methods require lots of annotated data to provide satisfactory results. Since analyzing thousands of images acquired during a flight survey can be a cumbersome and time consuming task, we focus in this article on the weakly supervised detection of marine animals. We propose a modification of the patch distribution modeling method (PaDiM), which is currently one of the state-of-the-art approaches for anomaly detection and localization for visual industrial inspection. In order to show its effectiveness and suitability for marine animal detection, we conduct a comparative evaluation of the proposed method against the original version, as well as other state-of-the-art approaches on two high-resolution marine animal image datasets. On both tested datasets, the proposed method yielded better F1 and recall scores (75% recall/41% precision, and 57% recall/60% precision, respectively) when trained on images known to contain no object of interest. This shows a great potential of the proposed approach to speed up the marine animal discovery in new flight surveys. Additionally, such a method could be adopted for bounding box proposals to perform faster and cheaper annotation within a fully-supervised detection framework.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] WEAKLY SUPERVISED BUILDING SEGMENTATION FROM AERIAL IMAGES
    Rafique, Muhammad Usman
    Jacobs, Nathan
    [J]. 2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 3955 - 3958
  • [2] Marine Bird Detection Based on Deep Learning using High-Resolution Aerial Images
    Ben Boudaoud, Lynda
    Maussang, Frederic
    Garello, Rene
    Chevallier, Alexis
    [J]. OCEANS 2019 - MARSEILLE, 2019,
  • [3] Uncertainty-Aware Forward Correction for Weakly Supervised Solar Panel Mapping From High-Resolution Aerial Images
    Zhang, Jue
    Jia, Xiuping
    Hu, Jiankun
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [4] Cap-Count Guided Weakly Supervised Insulator Cap Missing Detection in Aerial Images
    Shi, Chunxue
    Huang, Yaping
    [J]. IEEE SENSORS JOURNAL, 2021, 21 (01) : 685 - 691
  • [5] Point-Based Weakly Supervised Learning for Object Detection in High Spatial Resolution Remote Sensing Images
    Li, Youyou
    He, Binbin
    Melgani, Farid
    Long, Teng
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 : 5361 - 5371
  • [6] ANALYSIS OF HIGH-RESOLUTION AERIAL IMAGES FOR OBJECT DETECTION
    TRIVEDI, MM
    BOKIL, AG
    TAKLA, MB
    MAKSYMONKO, GB
    BROACH, JT
    [J]. ADVANCES IN IMAGE COMPRESSION AND AUTOMATIC TARGET RECOGNITION, 1989, 1099 : 58 - 65
  • [7] Automated Kauri Trees Detection in High Resolution Aerial Images
    Han, L. T.
    Merry, M.
    Gee, T.
    Gastelum Strozzi, A.
    Delmas, P.
    Gimel'farb, G.
    [J]. 2017 INTERNATIONAL CONFERENCE ON IMAGE AND VISION COMPUTING NEW ZEALAND (IVCNZ), 2017,
  • [8] DETECTION OF OBJECTS IN HIGH-RESOLUTION MULTISPECTRAL AERIAL IMAGES
    TRIVEDI, MM
    HARLOW, CA
    CRESS, DH
    CHEN, C
    [J]. PROCEEDINGS OF THE SOCIETY OF PHOTO-OPTICAL INSTRUMENTATION ENGINEERS, 1985, 548 : 258 - 262
  • [9] Semantic Annotation of High-Resolution Satellite Images via Weakly Supervised Learning
    Yao, Xiwen
    Han, Junwei
    Cheng, Gong
    Qian, Xueming
    Guo, Lei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2016, 54 (06): : 3660 - 3671
  • [10] Weakly Supervised Change Detection Based on Edge Mapping and SDAE Network in High-Resolution Remote Sensing Images
    Lu, Ning
    Chen, Can
    Shi, Wenbo
    Zhang, Junwei
    Ma, Jianfeng
    [J]. REMOTE SENSING, 2020, 12 (23) : 1 - 26