Spatial attention-based implicit neural representation for arbitrary reduction of MRI slice spacing

被引:1
|
作者
Wang, Xin [1 ]
Wang, Sheng [1 ]
Xiong, Honglin [2 ,3 ]
Xuan, Kai [4 ]
Zhuang, Zixu [1 ]
Liu, Mengjun [1 ]
Shen, Zhenrong [1 ]
Zhao, Xiangyu [1 ]
Zhang, Lichi [1 ,6 ]
Wang, Qian [2 ,3 ,5 ,7 ]
机构
[1] Shanghai Jiao Tong Univ, Sch Biomed Engn, Shanghai 200030, Peoples R China
[2] ShanghaiTech Univ, Sch Biomed Engn, Shanghai 201210, Peoples R China
[3] ShanghaiTech Univ, State Key Lab Adv Med Mat & Devices, Shanghai 201210, Peoples R China
[4] Nanjing Univ Informat Sci & Technol, Sch Artificial Intelligence, Nanjing 210044, Peoples R China
[5] Shanghai Clin Res & Trial Ctr, Shanghai 201210, Peoples R China
[6] Shanghai Jiao Tong Univ, Dept Automat, Teaching Bldg 3,154 Huashan Rd, Shanghai, Peoples R China
[7] ShanghaiTech Univ, Bldg Biomed Engn, 393 Huaxia Middle Rd, Shanghai, Peoples R China
基金
中国国家自然科学基金;
关键词
Magnetic resonance imaging; Arbitrary-scale super-resolution; Implicit representation; DEEP; RECONSTRUCTION; NETWORK;
D O I
10.1016/j.media.2024.103158
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Magnetic resonance (MR) images collected in 2D clinical protocols typically have large inter -slice spacing, resulting in high in -plane resolution and reduced through -plane resolution. Super -resolution technique can enhance the through -plane resolution of MR images to facilitate downstream visualization and computer -aided diagnosis. However, most existing works train the super -resolution network at a fixed scaling factor, which is not friendly to clinical scenes of varying inter -slice spacing in MR scanning. Inspired by the recent progress in implicit neural representation, we propose a Spatial Attention -based Implicit Neural Representation (SA-INR) network for arbitrary reduction of MR inter -slice spacing. The SA-INR aims to represent an MR image as a continuous implicit function of 3D coordinates. In this way, the SA-INR can reconstruct the MR image with arbitrary inter -slice spacing by continuously sampling the coordinates in 3D space. In particular, a local -aware spatial attention operation is introduced to model nearby voxels and their affinity more accurately in a larger receptive field. Meanwhile, to improve the computational efficiency, a gradient -guided gating mask is proposed for applying the local -aware spatial attention to selected areas only. We evaluate our method on the public HCP-1200 dataset and the clinical knee MR dataset to demonstrate its superiority over other existing methods.
引用
收藏
页数:12
相关论文
共 50 条
  • [41] Weakly supervised detection with decoupled attention-based deep representation
    Wenhui Jiang
    Zhicheng Zhao
    Fei Su
    Multimedia Tools and Applications, 2018, 77 : 3261 - 3277
  • [42] Attention-based full slice brain CT image diagnosis with explanations q
    Fu, Guanghui
    Li, Jianqiang
    Wang, Ruiqian
    Ma, Yue
    Chen, Yueda
    NEUROCOMPUTING, 2021, 452 : 263 - 274
  • [43] Attention-Based Convolutional Neural Network for Ingredients Identification
    Chen, Shi
    Li, Ruixue
    Wang, Chao
    Liang, Jiakai
    Yue, Keqiang
    Li, Wenjun
    Li, Yilin
    ENTROPY, 2023, 25 (02)
  • [44] Attention-based neural network for polarimetric image denoising
    Liu, Hedong
    Zhang, Yizhu
    Cheng, Zhenzhou
    Zhai, Jingsheng
    Hu, Haofeng
    OPTICS LETTERS, 2022, 47 (11) : 2726 - 2729
  • [45] Causal Discovery with Attention-Based Convolutional Neural Networks
    Nauta, Meike
    Bucur, Doina
    Seifert, Christin
    MACHINE LEARNING AND KNOWLEDGE EXTRACTION, 2019, 1 (01):
  • [46] Scattering Representation and Attention-Based Residual Learning for Image Classification
    Kaur, Manjeet
    Ahmad, M. Omair
    Swamy, M. N. S.
    2024 IEEE 67TH INTERNATIONAL MIDWEST SYMPOSIUM ON CIRCUITS AND SYSTEMS, MWSCAS 2024, 2024, : 724 - 728
  • [47] Retweet Prediction with Attention-based Deep Neural Network
    Zhang, Qi
    Gong, Yeyun
    Wu, Jindou
    Huang, Haoran
    Huang, Xuanjing
    CIKM'16: PROCEEDINGS OF THE 2016 ACM CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, 2016, : 75 - 84
  • [48] Attention-based Neural Network for Traffic Sign Detection
    Zhang, Jing
    Hui, Le
    Lu, Jianfeng
    Zhu, Yuhua
    2018 24TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2018, : 1839 - 1844
  • [49] Attention-Based Graph Neural Network for News Recommendation
    Ji, Zhenyan
    Wu, Mengdan
    Liu, Jirui
    Armendariz Inigo, Jose Enrique
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [50] Attention-Based Recurrent Neural Network for Multicriteria Recommendations
    Bougteb, Yahya
    Frikh, Bouchra
    Ouhbi, Brahim
    Zemmouri, El Moukhtar
    INTELLIGENT SYSTEMS AND APPLICATIONS, VOL 2, INTELLISYS 2023, 2024, 823 : 264 - 274