STADNet: Spatial-Temporal Attention-Guided Dual-Path Network for cardiac cine MRI super-resolution

被引:0
|
作者
Lyu, Jun [1 ]
Wang, Shuo [2 ]
Tian, Yapeng [3 ]
Zou, Jing [4 ]
Dong, Shunjie [5 ]
Wang, Chengyan [6 ]
Aviles-Rivero, Angelica I. [7 ]
Qin, Jing [4 ]
机构
[1] Yantai Univ, Sch Comp & Control Engn, Yantai, Peoples R China
[2] Fudan Univ, Sch Basic Med Sci, Shanghai, Peoples R China
[3] Univ Texas Dallas, Dept Comp Sci, Richardson, TX USA
[4] Hong Kong Polytech Univ, Ctr Smart Hlth, Sch Nursing, Hong Kong, Peoples R China
[5] Zhejiang Univ, Coll Informat Sci & Elect Engn, Hangzhou, Peoples R China
[6] Fudan Univ, Human Phenome Inst, Shanghai, Peoples R China
[7] Univ Cambridge, Dept Appl Math & Theoret Phys, Cambridge, England
基金
中国国家自然科学基金;
关键词
Cine cardiac MRI; Super resolution; Position-weighted; Flow-enhanced; Non-local attention; RECONSTRUCTION;
D O I
10.1016/j.media.2024.103142
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Cardiac cine magnetic resonance imaging (MRI) is a commonly used clinical tool for evaluating cardiac function and morphology. However, its diagnostic accuracy may be compromised by the low spatial resolution. Current methods for cine MRI super-resolution reconstruction still have limitations. They typically rely on 3D convolutional neural networks or recurrent neural networks, which may not effectively capture long-range or non-local features due to their limited receptive fields. Optical flow estimators are also commonly used to align neighboring frames, which may cause information loss and inaccurate motion estimation. Additionally, pre-warping strategies may involve interpolation, leading to potential loss of texture details and complicated anatomical structures. To overcome these challenges, we propose a novel Spatial-Temporal Attention-Guided Dual-Path Network (STADNet) for cardiac cine MRI super-resolution. We utilize transformers to model longrange dependencies in cardiac cine MR images and design a cross-frame attention module in the location-aware spatial path, which enhances the spatial details of the current frame by using complementary information from neighboring frames. We also introduce a recurrent flow-enhanced attention module in the motion-aware temporal path that exploits the correlation between cine MRI frames and extracts the motion information of the heart. Experimental results demonstrate that STADNet outperforms SOTA approaches and has significant potential for clinical practice.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Dual-path attention network for single image super-resolution
    Huang, Zhiyong
    Li, Wenbin
    Li, Jinxin
    Zhou, Dengwen
    EXPERT SYSTEMS WITH APPLICATIONS, 2021, 169
  • [2] Attention-guided video super-resolution with recurrent multi-scale spatial-temporal transformer
    Sun, Wei
    Kong, Xianguang
    Zhang, Yanning
    COMPLEX & INTELLIGENT SYSTEMS, 2023, 9 (04) : 3989 - 4002
  • [3] Lightweight Attention-Guided Network for Image Super-Resolution
    Ding, Zixuan
    Juan, Zhang
    Xiang, Li
    Wang, Xinyu
    LASER & OPTOELECTRONICS PROGRESS, 2023, 60 (14)
  • [4] Dual-Path Recurrent Network for Image Super-Resolution
    Li, Xinyao
    Zhang, Dongyang
    Shao, Jie
    NEURAL INFORMATION PROCESSING, ICONIP 2019, PT V, 2019, 1143 : 99 - 108
  • [5] AIDAN: An Attention-Guided Dual-Path Network for Pediatric Echocardiography Segmentation
    Hu, Yujin
    Xia, Bei
    Mao, Muyi
    Jin, Zelong
    Du, Jie
    Guo, Libao
    Frangi, Alejandro F.
    Lei, Baiying
    Wang, Tianfu
    IEEE ACCESS, 2020, 8 : 29176 - 29187
  • [6] Dual contrastive attention-guided deformable convolutional network for single image super-resolution
    Qiao, Fengjuan
    Zhu, Yonggui
    Li, Guofang
    Li, Bin
    Journal of Visual Communication and Image Representation, 2024, 100
  • [7] Dual contrastive attention-guided deformable convolutional network for single image super-resolution
    Qiao, Fengjuan
    Zhub, Yonggui
    Li, Guofang
    Li, Bin
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2024, 100
  • [8] Attention-guided video super-resolution with recurrent multi-scale spatial–temporal transformer
    Wei Sun
    Xianguang Kong
    Yanning Zhang
    Complex & Intelligent Systems, 2023, 9 : 3989 - 4002
  • [9] Deformable Spatial-Temporal Attention for Lightweight Video Super-Resolution
    Xue, Tong
    Huang, Xinyi
    Li, Dengshi
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT X, 2024, 14434 : 482 - 493
  • [10] DAFNet: A dual attention-guided fuzzy network for cardiac MRI segmentation
    Luo, Yuxin
    Fang, Yu
    Zeng, Guofei
    Lv, Yibin
    Du, Li
    Nie, Lisha
    Wu, Pu-Yeh
    Zhang, Dechuan
    Fan, Longling
    AIMS MATHEMATICS, 2024, 9 (04): : 8814 - 8833