Flexible Alignment Super-Resolution Network for Multi-Contrast Magnetic Resonance Imaging

被引:5
|
作者
Liu, Yiming [1 ]
Zhang, Mengxi [2 ]
Jiang, Bo [3 ]
Hou, Bo [3 ]
Liu, Dan [3 ]
Chen, Jie [4 ]
Lian, Heqing [1 ]
机构
[1] Xiao Ying AI Lab, Beijing 100085, Peoples R China
[2] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[3] Peking Union Med Coll Hosp, Beijing 100730, Peoples R China
[4] Peking Univ, Sch Elect Engn & Comp Sci, Beijing 100871, Peoples R China
关键词
Superresolution; Magnetic resonance imaging; Semantics; Feature extraction; Hafnium; Task analysis; Image reconstruction; Feature alignment; feature fusion; magnetic resonance imaging; reference-based image super-resolution; MRI; SINGLE;
D O I
10.1109/TMM.2023.3330085
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Super-resolution is essential in improving the image quality of Magnetic Resonance Imaging (MRI). Existing MRI Super-Resolution methods leverage multi-contrast MRI and achieve satisfied effects. However, these methods perform alignment by calculating the similarity of single-scale semantic features between reference images and low-resolution images, which causes misalignment and limits the performance of MRI Super-Resolution. To tackle this problem, we propose the Flexible Alignment Super-resolution Network (FASR-Net) for multi-contrast MRI Super-resolution, which explores the interaction of multi-scale features. To this end, we first use the feature extractor to generate multi-scale features, including hierarchical features and semantic pyramid features. Subsequently, we introduce the Hierarchical-Feature Alignment (HF) module and the Semantic-Pyramid-Feature Alignment (SF) module to align hierarchical features and semantic pyramid features, respectively. Finally, the Cross-Hierarchical Progressive Fusion (CHPF) module fuses these aligned features at different scales, which further improves the model's performance. Extensive experiments on FastMRI and IXI datasets show that FASR-net achieves the most competitive results over state-of-the-art approaches.
引用
收藏
页码:5159 / 5169
页数:11
相关论文
共 50 条
  • [1] Multi-Contrast Super-Resolution MRI Through a Progressive Network
    Lyu, Qing
    Shan, Hongming
    Steber, Cole
    Helis, Corbin
    Whitlow, Chris
    Chan, Michael
    Wang, Ge
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2020, 39 (09) : 2738 - 2749
  • [2] Multi-contrast brain magnetic resonance image super-resolution using the local weight similarity
    Hong Zheng
    Xiaobo Qu
    Zhengjian Bai
    Yunsong Liu
    Di Guo
    Jiyang Dong
    Xi Peng
    Zhong Chen
    BMC Medical Imaging, 17
  • [3] Multi-contrast brain magnetic resonance image super-resolution using the local weight similarity
    Zheng, Hong
    Qu, Xiaobo
    Bai, Zhengjian
    Liu, Yunsong
    Guo, Di
    Dong, Jiyang
    Peng, Xi
    Chen, Zhong
    BMC MEDICAL IMAGING, 2017, 17
  • [4] Multi-contrast MRI Super-Resolution via a Multi-stage Integration Network
    Feng, Chun-Mei
    Fu, Huazhu
    Yuan, Shuhao
    Xu, Yong
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT VI, 2021, 12906 : 140 - 149
  • [5] MGDUN: An interpretable network for multi-contrast MRI image super-resolution reconstruction
    Yang, Gang
    Zhang, Li
    Liu, Aiping
    Fu, Xueyang
    Chen, Xun
    Wang, Rujing
    COMPUTERS IN BIOLOGY AND MEDICINE, 2023, 167
  • [6] Decomposition-Based Variational Network for Multi-Contrast MRI Super-Resolution and Reconstruction
    Lei, Pengcheng
    Fang, Faming
    Zhang, Guixu
    Zeng, Tieyong
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 21239 - 21249
  • [7] Dual Arbitrary Scale Super-Resolution for Multi-contrast MRI
    Zhang, Jiamiao
    Chi, Yichen
    Lyu, Jun
    Yang, Wenming
    Tian, Yapeng
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT X, 2023, 14229 : 282 - 292
  • [8] Model-Guided Multi-Contrast Deep Unfolding Network for MRI Super-resolution Reconstruction
    Yang, Gang
    Zhang, Li
    Zhou, Man
    Liu, Aiping
    Chen, Xun
    Xiong, Zhiwei
    Wu, Feng
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 3974 - 3982
  • [9] Exploring Separable Attention for Multi-Contrast MR Image Super-Resolution
    Feng, Chun-Mei
    Yan, Yunlu
    Yu, Kai
    Xu, Yong
    Fu, Huazhu
    Yang, Jian
    Shao, Ling
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (09) : 12251 - 12262
  • [10] Feedback attention network for cardiac magnetic resonance imaging super-resolution
    Zhu, Dongmei
    He, Hongxu
    Wang, Dongbo
    COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2023, 231