Depth alignment interaction network for camouflaged object detection

被引:3
|
作者
Bi, Hongbo [1 ,3 ,4 ]
Tong, Yuyu [3 ]
Zhang, Jiayuan [3 ]
Zhang, Cong [3 ]
Tong, Jinghui [3 ]
Jin, Wei [2 ]
机构
[1] Northeast Petr Univ, Sanya Offshore Oil & Gas Res Inst, Daqing 163319, Peoples R China
[2] Natl Univ Def Technol, Coll Elect Countermeasures, Hefei 230037, Peoples R China
[3] Northeast Petr Univ, Sch Elect Informat Engn, Daqing 163319, Peoples R China
[4] Guizhou Univ, State Key Lab Publ Big Data, Guiyang 550025, Peoples R China
关键词
Camouflaged object detection; Depth alignment index; Expanded pyramid interaction; Deep learning; FEATURES;
D O I
10.1007/s00530-023-01250-3
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Many animals actively change their own characteristics, such as color and texture, through camouflage, a natural defense mechanism, making them difficult to be detected in the natural environment, which makes the task of camouflaged object detection extremely challenging. Biological research shows that the eyes of animals have three-dimensional perception ability, and the obtained depth information can provide useful object positioning clues for finding camouflaged objects. However, almost all the current studies for camouflaged object detection do not combine depth maps with RGB images. Therefore, combining depth maps with traditional unimodal RGB images is of great research significance to improve the accuracy of camouflaged object detection. In this paper, we propose a depth alignment interaction network for camouflaged object detection in which the depth maps used are generated from existing monocular depth estimation networks. To address the problem that the quality of the generated depth maps varies, we propose a depth alignment index method to evaluate the quality of the depth maps. The method dynamically assigns the proportion of depth maps in the fusion process to depth maps of different quality according to their alignment with RGB images. Then, to fully extract the fused artifact features, we design an expanded pyramid interaction module, which first expands the receptive field of the features in each layer. Then, the features at the higher levels interacted with the features at the lower levels by connecting them step-by-step to further refine the predicted camouflaged area. Extensive experiments on 4 camouflaged object detection datasets demonstrate the effectiveness of our solution for camouflaged object detection.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Depth alignment interaction network for camouflaged object detection
    Hongbo Bi
    Yuyu Tong
    Jiayuan Zhang
    Cong Zhang
    Jinghui Tong
    Wei Jin
    Multimedia Systems, 2024, 30
  • [2] Depth context aggregation network for camouflaged object detection
    Liu, Xiaogang
    Song, Shuang
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (31) : 75689 - 75708
  • [3] Depth-aided Camouflaged Object Detection
    Wang, Qingwei
    Yang, Jinyu
    Yu, Xiaosheng
    Wang, Fangyi
    Chen, Peng
    Zheng, Feng
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 3297 - 3306
  • [4] AFINet: Camouflaged object detection via Attention Fusion and Interaction Network
    Zhang, Qing
    Yan, Weiqi
    Zhao, Yilin
    Jin, Qi
    Zhang, Yu
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2024, 102
  • [5] Camouflaged object detection network based on global context interaction fusion
    Ge, Bin
    Chen, Ning-Jie
    Xia, Chen-Xing
    Zheng, Hai-Jun
    Wu, Tao-Lin
    Kongzhi yu Juece/Control and Decision, 2024, 39 (10): : 3347 - 3356
  • [6] Camouflaged object detection via cross-level refinement and interaction network
    Ge, Yanliang
    Ren, Junchao
    Zhang, Qiao
    He, Min
    Bi, Hongbo
    Zhang, Cong
    IMAGE AND VISION COMPUTING, 2024, 144
  • [7] Attention-induced semantic and boundary interaction network for camouflaged object detection
    Zhang, Qiao
    Sun, Xiaoxiao
    Chen, Yurui
    Ge, Yanliang
    Bi, Hongbo
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2023, 233
  • [8] Frequency Perception Network for Camouflaged Object Detection
    Cong, Runmin
    Sun, Mengyao
    Zhang, Sanyi
    Zhou, Xiaofei
    Zhang, Wei
    Zhao, Yao
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 1179 - 1189
  • [9] Search and recovery network for camouflaged object detection
    Liu, Guangrui
    Wu, Wei
    IMAGE AND VISION COMPUTING, 2024, 151
  • [10] Decoupling and Integration Network for Camouflaged Object Detection
    Zhou, Xiaofei
    Wu, Zhicong
    Cong, Runmin
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 7114 - 7129