SealNet 2.0: Human-Level Fully-Automated Pack-Ice Seal Detection in Very-High-Resolution Satellite Imagery with CNN Model Ensembles

被引:5
|
作者
Goncalves, Bento C. [1 ,2 ]
Wethington, Michael [1 ]
Lynch, Heather J. [1 ,2 ]
机构
[1] SUNY Stony Brook, Dept Ecol & Evolut, Stony Brook, NY 11794 USA
[2] SUNY Stony Brook, Inst Adv Computat Sci, Stony Brook, NY 11794 USA
基金
美国国家航空航天局; 美国国家科学基金会;
关键词
pack-ice seal; remote sensing; Worldview-3; Antarctica; computer vision; deep learning; instance segmentation; U-Net; KRILL; ABUNDANCE; TRENDS; LAND;
D O I
10.3390/rs14225655
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Pack-ice seals are key indicator species in the Southern Ocean. Their large size (2-4 m) and continent-wide distribution make them ideal candidates for monitoring programs via very-high-resolution satellite imagery. The sheer volume of imagery required, however, hampers our ability to rely on manual annotation alone. Here, we present SealNet 2.0, a fully automated approach to seal detection that couples a sea ice segmentation model to find potential seal habitats with an ensemble of semantic segmentation convolutional neural network models for seal detection. Our best ensemble attains 0.806 precision and 0.640 recall on an out-of-sample test dataset, surpassing two trained human observers. Built upon the original SealNet, it outperforms its predecessor by using annotation datasets focused on sea ice only, a comprehensive hyperparameter study leveraging substantial high-performance computing resources, and post-processing through regression head outputs and segmentation head logits at predicted seal locations. Even with a simplified version of our ensemble model, using AI predictions as a guide dramatically boosted the precision and recall of two human experts, showing potential as a training device for novice seal annotators. Like human observers, the performance of our automated approach deteriorates with terrain ruggedness, highlighting the need for statistical treatment to draw global population estimates from AI output.
引用
收藏
页数:17
相关论文
共 1 条
  • [1] SealNet: A fully-automated pack-ice seal detection pipeline for sub-meter satellite imagery
    Goncalves, B. C.
    Spitzbart, B.
    Lynch, H. J.
    [J]. REMOTE SENSING OF ENVIRONMENT, 2020, 239