Long-Tailed Metrics and Object Detection in Camera Trap Datasets

被引:2
|
作者
He, Wentong [1 ,2 ]
Luo, Ze [1 ]
Tong, Xinyu [1 ,2 ]
Hu, Xiaoyi [1 ,2 ]
Chen, Can [1 ]
Shu, Zufei [3 ]
机构
[1] Chinese Acad Sci, Comp Network Informat Ctr, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] Guangdong Chebaling Natl Nat Reserve, Shaoguan 512528, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2023年 / 13卷 / 10期
关键词
camera trap; long-tailed metrics; class imbalance; object/box-level scale imbalance; deep learning; object detection; sample relationship; IMAGES;
D O I
10.3390/app13106029
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
With their advantages in wildlife surveys and biodiversity monitoring, camera traps are widely used, and have been used to gather massive amounts of animal images and videos. The application of deep learning techniques has greatly promoted the analysis and utilization of camera trap data in biodiversity management and conservation. However, the long-tailed distribution of the camera trap dataset can degrade the deep learning performance. In this study, for the first time, we quantified the long-tailedness of class and object/box-level scale imbalance of camera trap datasets. In the camera trap dataset, the imbalance problem is prevalent and severe, in terms of class and object/box-level scale. The camera trap dataset has worse object/box-level scale imbalance, and too few samples of small objects, making deep learning more challenging. Furthermore, we used the BatchFormer module to exploit sample relationships, and improved the performance of the general object detection model, DINO, by up to 2.9% and up to 3.3% in terms of class imbalance and object/box-level scale imbalance. The experimental results showed that the sample relationship was simple and effective, improving detection performance in terms of class and object/box-level scale imbalance, but that it could not make up for the low number of small objects in the camera trap dataset.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] Image-Level or Object-Level? A Tale of Two Resampling Strategies for Long-Tailed Detection
    Chang, Nadine
    Yu, Zhiding
    Wang, Yu-Xiong
    Anandkumar, Anima
    Fidler, Sanja
    Alvarez, Jose M.
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139
  • [32] Dyadic response facilitation of object play in Balinese long-tailed macaques
    Sciaky, Lilah
    Gunst, Noelle
    Wandia, I. Nengah
    Leca, Jean-Baptiste
    BEHAVIOURAL PROCESSES, 2022, 203
  • [33] Long-Tailed Object Mining Based on CLIP Model for Autonomous Driving
    Yang, Guorun
    Qiao, Yu
    Shi, Jianping
    Wang, Zhe
    2022 4TH INTERNATIONAL CONFERENCE ON CONTROL AND ROBOTICS, ICCR, 2022, : 348 - 352
  • [34] Equalization Loss v2: A New Gradient Balance Approach for Long-tailed Object Detection
    Tan, Jingru
    Lu, Xin
    Zhang, Gang
    Yin, Changqing
    Li, Quanquan
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 1685 - 1694
  • [35] EAT: Towards Long-Tailed Out-of-Distribution Detection
    Wei, Tong
    Wang, Bo-Lin
    Zhang, Min-Ling
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 14, 2024, : 15787 - 15795
  • [36] Trustworthy Long-Tailed Classification
    Li, Bolian
    Han, Zongbo
    Li, Haining
    Fu, Huazhu
    Zhang, Changqing
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 6960 - 6969
  • [37] The long-tailed field mouse
    不详
    AMERICAN NATURALIST, 1901, 35 : 683 - 683
  • [38] Long-Tailed Food Classification
    He, Jiangpeng
    Lin, Luotao
    Eicher-Miller, Heather A.
    Zhu, Fengqing
    NUTRIENTS, 2023, 15 (12)
  • [39] ASYMMETRIC LONG-TAILED PAIR
    HART, BL
    WIRELESS WORLD, 1971, 77 (1432): : 484 - &
  • [40] Improving Pedestrian Detection from a Long-tailed Domain Perspective
    Ding, Mengyuan
    Zhang, Shanshan
    Yang, Jian
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 2918 - 2926