Style Transfer and Self-Supervised Learning Powered Myocardium Infarction Super-Resolution Segmentation

被引:0
|
作者
Wang, Lichao [1 ]
Huang, Jiahao [1 ]
Xing, Xiaodan [1 ]
Wu, Yinzhe [1 ]
Rajakulasingam, Ramyah [1 ]
Scott, Andrew D. [1 ]
Ferreira, Pedro F. [1 ]
De Silva, Ranil [1 ]
Nielles-Vallespin, Sonia [1 ]
Yang, Guang [1 ]
机构
[1] Imperial Coll London, London, England
关键词
Diffusion tensor imaging; late gadolinium enhancement; myocardium infarction segmentation; style transfer; self-supervised learning;
D O I
10.1109/SIPAIM56729.2023.10373454
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
This study proposes a pipeline that incorporates a novel style transfer model and a simultaneous super-resolution and segmentation model. The proposed pipeline aims to enhance diffusion tensor imaging (DTI) images by translating them into the late gadolinium enhancement (LGE) domain, which offers a larger amount of data with high-resolution and distinct highlighting of myocardium infarction (MI) areas. Subsequently, the segmentation task is performed on the LGE style image. An end-to-end super-resolution segmentation model is introduced to generate high-resolution mask from low-resolution LGE style DTI image. Further, to enhance the performance of the model, a multi-task self-supervised learning strategy is employed to pre-train the super-resolution segmentation model, allowing it to acquire more representative knowledge and improve its segmentation performance after fine-tuning. https: github.com/wlc2424762917/Med Img
引用
收藏
页数:5
相关论文
共 50 条
  • [1] Self-Supervised Burst Super-Resolution
    Bhat, Goutam
    Gharbi, Michael
    Chen, Jiawen
    Van Gool, Luc
    Xia, Zhihao
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 10571 - 10580
  • [2] Self-Supervised Learning for Rolling Shutter Temporal Super-Resolution
    Fan, Bin
    Guo, Ying
    Dai, Yuchao
    Xu, Chao
    Shi, Boxin
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2025, 35 (01) : 769 - 782
  • [3] Self-supervised memory learning for scene text image super-resolution
    Guo, Kehua
    Zhu, Xiangyuan
    Schaefer, Gerald
    Ding, Rui
    Fang, Hui
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 258
  • [4] Self-supervised CT super-resolution with hybrid model
    Zhang, Zhicheng
    Yu, Shaode
    Qin, Wenjian
    Liang, Xiaokun
    Xie, Yaoqin
    Cao, Guohua
    COMPUTERS IN BIOLOGY AND MEDICINE, 2021, 138
  • [5] Self-Supervised Deep Blind Video Super-Resolution
    Bai, Haoran
    Pan, Jinshan
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (07) : 4641 - 4653
  • [6] STRESS: Super-Resolution for Dynamic Fetal MRI Using Self-supervised Learning
    Xu, Junshen
    Turk, Esra Abaci
    Grant, P. Ellen
    Golland, Polina
    Adalsteinsson, Elfar
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT VII, 2021, 12907 : 197 - 206
  • [7] Toward extreme face super-resolution in the wild: A self-supervised learning approach
    Sidiya, Ahmed Cheikh
    Li, Xin
    FRONTIERS IN COMPUTER SCIENCE, 2022, 4
  • [8] Learning Mutual Modulation for Self-supervised Cross-Modal Super-Resolution
    Dong, Xiaoyu
    Yokoya, Naoto
    Wang, Longguang
    Uezato, Tatsumi
    COMPUTER VISION, ECCV 2022, PT XIX, 2022, 13679 : 1 - 18
  • [9] NormToRaw: A Style Transfer Based Self-supervised Learning Approach for Nuclei Segmentation
    Chen, Xianlai
    Zhong, Xuantong
    Li, Taixiang
    An, Ying
    Mo, Long
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [10] SelfS2: Self-Supervised Transfer Learning for Sentinel-2 Multispectral Image Super-Resolution
    Qian, Xiao
    Jiang, Tai-Xiang
    Zhao, Xi-Le
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 215 - 227