Defocus blur detection via adaptive cross-level feature fusion and refinement

被引:1
|
作者
Zhao, Zijian [1 ,2 ]
Yang, Hang [1 ]
Liu, Peiyu [3 ]
Nie, Haitao [1 ]
Zhang, Zhongbo [4 ]
Li, Chunyu [1 ]
机构
[1] Chinese Acad Sci, Changchun Inst Opt Fine Mech & Phys, Changchun 130033, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] AVIC Shenyang Aircraft Design & Res Inst, Shenyang 110087, Peoples R China
[4] Jilin Univ, Changchun 130012, Peoples R China
来源
VISUAL COMPUTER | 2024年 / 40卷 / 11期
关键词
Defocus blur detection; Homogeneous region; Adaptive cross-level feature fusion;
D O I
10.1007/s00371-023-03229-7
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Convolutional neural networks have achieved competitive performance in defocus blur detection (DBD). However, due to the different receptive fields of different convolutional layers, there are distinct differences in the features generated by these layers, and the complementary information between cross-level features cannot be fully utilized. Besides, there are still challenges to be solved in homogeneous regions. To tackle the above issues, we focus on both homogeneous region dataset augmentation and model design to propose a novel DBD model based on adaptive cross-level feature fusion and refinement. Specifically, in terms of homogeneous region dataset enhancement, a Laplace filter is used to extract the homogeneous region image patch of the training image to realize homogeneous region image augmentation, which improves the robustness of the model for DBD in the homogeneous region; in terms of model design, we propose an adaptive fusion mechanism with self-learning weights and design the adaptive cross-level feature fusion module, which adaptively discriminates between different levels of features and fuses them step-by-step. In addition, we design the cross-level feature refinement module and embed it into the network, which captures the complementary information of the cross-level features, and refines cross-level feature information from coarse to fine in the decoder stage. Experimental results on two commonly used datasets show that the proposed method outperforms 13 state-of-the-art approaches.
引用
收藏
页码:8141 / 8153
页数:13
相关论文
共 50 条
  • [21] Object Detection via Multimodal Adaptive Feature Fusion
    Gao Xiaoqiang
    Chang Kan
    Ling Mingyang
    Yin Mengyu
    LASER & OPTOELECTRONICS PROGRESS, 2023, 60 (24)
  • [22] Context-aware Cross-level Fusion Network for Camouflaged Object Detection
    Sun, Yujia
    Chen, Geng
    Zhou, Tao
    Zhang, Yi
    Liu, Nian
    PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 1025 - 1031
  • [23] Defocus Blur Detection via Boosting Diversity of Deep Ensemble Networks
    Zhao, Wenda
    Hou, Xueqing
    He, You
    Lu, Huchuan
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 5426 - 5438
  • [24] United Defocus Blur Detection and Deblurring via Adversarial Promoting Learning
    Zhao, Wenda
    Wei, Fei
    He, You
    Lu, Huchuan
    COMPUTER VISION - ECCV 2022, PT XXX, 2022, 13690 : 569 - 586
  • [25] Multi-scale Adaptive Dual Attention for Image Defocus Blur Detection
    Li, Yue
    Han, Xuechun
    Wang, Wei
    2022 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS 22), 2022, : 2328 - 2332
  • [26] MC-Net: Multi-Scale Feature Fusion and Cross-Level Information Interaction Network for Traffic Sign Detection
    Yu, Zhongyi
    Cheng, Debo
    Zhang, Wenzhen
    Chen, Jing
    Zhang, Shichao
    2023 IEEE 35TH INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE, ICTAI, 2023, : 841 - 848
  • [27] Enhancing Diversity of Defocus Blur Detectors via Cross-Ensemble Network
    Zhao, Wenda
    Zheng, Bowen
    Lin, Qiuhua
    Lu, Huchuan
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 8897 - 8905
  • [28] Full-Scene Defocus Blur Detection With DeFBD plus via Multi-Level Distillation Learning
    Zhao, Wenda
    Wei, Fei
    Wang, Haipeng
    He, You
    Lu, Huchuan
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 9228 - 9240
  • [29] Cross-level Feature Aggregation Network for Polyp Segmentation
    Zhou, Tao
    Zhou, Yi
    He, Kelei
    Gong, Chen
    Yang, Jian
    Fu, Huazhu
    Shen, Dinggang
    PATTERN RECOGNITION, 2023, 140
  • [30] Progressive cross-level fusion network for RGB-D salient object detection
    Li, Jianbao
    Pan, Chen
    Zheng, Yilin
    Zhang, Dongping
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2024, 104