Multi-Attention Convolutional Neural Network for Video Deblurring

被引:14
|
作者
Zhang, Xiaoqin [1 ]
Wang, Tao [1 ]
Jiang, Runhua [1 ]
Zhao, Li [1 ]
Xu, Yuewang [1 ]
机构
[1] Wenzhou Univ, Coll Comp Sci & Artificial Intelligence, Wenzhou 325035, Peoples R China
基金
中国国家自然科学基金;
关键词
Task analysis; Image restoration; Feature extraction; Deep learning; Convolution; Indexes; Computer vision; Video deblurring; MACNN; multi-attention;
D O I
10.1109/TCSVT.2021.3093928
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Video deblurring, which aims at restoring the sharp video from blurry video, is drawing increasing attention in the field of computer vision. In this paper, a method called Multi-Attention Convolutional Neural Network (MACNN) consisting of the temporal-spatial attention module, the frame channel attention module, and the feature extraction-reconstruction module is proposed. First, we use the temporal-spatial attention module and the frame channel attention module to capture features with temporal and spatial information existing across neighboring frames. Then, these captured features are fused and reconstructed to restore the sharp frame. Last but not least, we train MACNN together with a content loss and a perceptual loss in an end-to-end manner to recover realistic video details. Both quantitative and qualitative evaluation results on standard benchmarks demonstrate the proposed MACNN is superior to the state-of-the-art methods in terms of accuracy, efficiency, and visual effect.
引用
收藏
页码:1986 / 1997
页数:12
相关论文
共 50 条
  • [1] Electromyographic hand gesture recognition using convolutional neural network with multi-attention
    Zhang, Zhen
    Shen, Quming
    Wang, Yanyu
    [J]. BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 91
  • [2] Adaptive Multi-Attention Convolutional Neural Network for Fine-Grained Image Recognition
    Li, Ang
    Chen, Jianxin
    Kang, Bin
    Zhuang, Wenqin
    Zhang, Xuguang
    [J]. 2019 IEEE GLOBECOM WORKSHOPS (GC WKSHPS), 2019,
  • [3] Learning Multi-Attention Convolutional Neural Network for Fine-Grained Image Recognition
    Zheng, Heliang
    Fu, Jianlong
    Mei, Tao
    Luo, Jiebo
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 5219 - 5227
  • [4] Bearing Fault Diagnosis Using Convolutional Neural Network Based on a Multi-Attention Mechanism
    Kang, Tao
    Duan, Rongkai
    Yang, Lei
    Xue, Jiutao
    Liao, Yuhe
    [J]. Hsi-An Chiao Tung Ta Hsueh/Journal of Xi'an Jiaotong University, 2022, 56 (12): : 68 - 77
  • [5] Multi-Attention Network for Unsupervised Video Object Segmentation
    Zhang, Guifang
    Wong, Hon-Cheng
    Lo, Sio-Long
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2021, 28 : 71 - 75
  • [6] MAIN: Multi-Attention Instance Network for video segmentation
    Alcazar, Juan Leon
    Bravo, Maria A.
    Jeanneret, Guillaume
    Thabet, Ali K.
    Brox, Thomas
    Arbelaez, Pablo
    Ghanem, Bernard
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2021, 210
  • [7] Multi-Attention Network for Compressed Video Referring Object Segmentation
    Chen, Weidong
    Hong, Dexiang
    Qi, Yuankai
    Han, Zhenjun
    Wang, Shuhui
    Qing, Laiyun
    Huang, Qingming
    Li, Guorong
    [J]. PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 4416 - 4425
  • [8] Multi-Attention Integrated Convolutional Network for Anomaly Detection of Time Series
    Zhang, Jing
    Wang, Chao
    Zhang, Xianbo
    Li, Zezhou
    [J]. 2022 14TH INTERNATIONAL CONFERENCE ON COMPUTER AND AUTOMATION ENGINEERING (ICCAE 2022), 2022, : 91 - 96
  • [9] Diagnose Chest Pathology in X-ray Images by Learning Multi-Attention Convolutional Neural Network
    Huang, Zhicheng
    Fu, Dongmei
    [J]. PROCEEDINGS OF 2019 IEEE 8TH JOINT INTERNATIONAL INFORMATION TECHNOLOGY AND ARTIFICIAL INTELLIGENCE CONFERENCE (ITAIC 2019), 2019, : 294 - 299
  • [10] Rema-Net: An efficient multi-attention convolutional neural network for rapid skin lesion segmentation
    Yang, Litao
    Fan, Chao
    Lin, Hao
    Qiu, Yingying
    [J]. COMPUTERS IN BIOLOGY AND MEDICINE, 2023, 159