Flexible Alignment Super-Resolution Network for Multi-Contrast Magnetic Resonance Imaging

被引:5
|
作者
Liu, Yiming [1 ]
Zhang, Mengxi [2 ]
Jiang, Bo [3 ]
Hou, Bo [3 ]
Liu, Dan [3 ]
Chen, Jie [4 ]
Lian, Heqing [1 ]
机构
[1] Xiao Ying AI Lab, Beijing 100085, Peoples R China
[2] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[3] Peking Union Med Coll Hosp, Beijing 100730, Peoples R China
[4] Peking Univ, Sch Elect Engn & Comp Sci, Beijing 100871, Peoples R China
关键词
Superresolution; Magnetic resonance imaging; Semantics; Feature extraction; Hafnium; Task analysis; Image reconstruction; Feature alignment; feature fusion; magnetic resonance imaging; reference-based image super-resolution; MRI; SINGLE;
D O I
10.1109/TMM.2023.3330085
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Super-resolution is essential in improving the image quality of Magnetic Resonance Imaging (MRI). Existing MRI Super-Resolution methods leverage multi-contrast MRI and achieve satisfied effects. However, these methods perform alignment by calculating the similarity of single-scale semantic features between reference images and low-resolution images, which causes misalignment and limits the performance of MRI Super-Resolution. To tackle this problem, we propose the Flexible Alignment Super-resolution Network (FASR-Net) for multi-contrast MRI Super-resolution, which explores the interaction of multi-scale features. To this end, we first use the feature extractor to generate multi-scale features, including hierarchical features and semantic pyramid features. Subsequently, we introduce the Hierarchical-Feature Alignment (HF) module and the Semantic-Pyramid-Feature Alignment (SF) module to align hierarchical features and semantic pyramid features, respectively. Finally, the Cross-Hierarchical Progressive Fusion (CHPF) module fuses these aligned features at different scales, which further improves the model's performance. Extensive experiments on FastMRI and IXI datasets show that FASR-net achieves the most competitive results over state-of-the-art approaches.
引用
收藏
页码:5159 / 5169
页数:11
相关论文
共 50 条
  • [21] Multi-scale Super-Resolution Magnetic Resonance Spectroscopic Imaging with Adjustable Sharpness
    Dong, Siyuan
    Hangel, Gilbert
    Bogner, Wolfgang
    Widhalm, Georg
    Roessler, Karl
    Trattnig, Siegfried
    You, Chenyu
    de Graaf, Robin
    Onofrey, John A.
    Duncan, James S.
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2022, PT VI, 2022, 13436 : 410 - 420
  • [22] DisC-Diff: Disentangled Conditional Diffusion Model for Multi-contrast MRI Super-Resolution
    Mao, Ye
    Jiang, Lan
    Chen, Xi
    Li, Chao
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT X, 2023, 14229 : 387 - 397
  • [23] Multi-Contrast Brain MRI Image Super-Resolution With Gradient-Guided Edge Enhancement
    Zheng, Hong
    Zeng, Kun
    Guo, Di
    Ying, Jiaxi
    Yang, Yu
    Peng, Xi
    Huang, Feng
    Chen, Zhong
    Qu, Xiaobo
    IEEE ACCESS, 2018, 6 : 57856 - 57867
  • [24] Single-subject Multi-contrast MRI Super-resolution via Implicit Neural Representations
    McGinnis, Julian
    Shit, Suprosanna
    Li, Hongwei Bran
    Sideri-Lampretsa, Vasiliki
    Graf, Robert
    Dannecker, Maik
    Pan, Jiazhen
    Stolt-Anso, Nil
    Muehlau, Mark
    Kirschke, Jan S.
    Rueckert, Daniel
    Wiestler, Benedikt
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT VIII, 2023, 14227 : 173 - 183
  • [25] WavTrans: Synergizing Wavelet and Cross-Attention Transformer for Multi-contrast MRI Super-Resolution
    Li, Guangyuan
    Lyu, Jun
    Wang, Chengyan
    Dou, Qi
    Qin, Jing
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2022, PT VI, 2022, 13436 : 463 - 473
  • [26] MULTI-STAGE FEATURE ALIGNMENT NETWORK FOR VIDEO SUPER-RESOLUTION
    Suzuki, Keito
    Ikehara, Masaaki
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 2001 - 2005
  • [27] Multi-Contrast Magnetic Resonance Image Reconstruction
    Liu, Meng
    Chen, Yunmei
    Zhang, Hao
    Huang, Feng
    MEDICAL IMAGING 2015: IMAGE PROCESSING, 2015, 9413
  • [28] A Two-Stage Multi-loss Super-Resolution Network for Arterial Spin Labeling Magnetic Resonance Imaging
    Li, Zheng
    Liu, Qingping
    Li, Yiran
    Ge, Qiu
    Shang, Yuanqi
    Song, Donghui
    Wang, Ze
    Shi, Jun
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT III, 2019, 11766 : 12 - 20
  • [29] Multi kernel cross sparse graph attention convolutional neural network for brain magnetic resonance imaging super-resolution
    Hua, Xin
    Du, Zhijiang
    Ma, Jixin
    Yu, Hongjian
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 96
  • [30] Transformer-empowered Multi-scale Contextual Matching and Aggregation for Multi-contrast MRI Super-resolution
    Li, Guangyuan
    Lv, Jun
    Tian, Yapeng
    Dou, Qi
    Wang, Chengyan
    Xu, Chenliang
    Qin, Jing
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 20604 - 20613