MedEdit: Counterfactual Diffusion-Based Image Editing on Brain MRI

被引:0
|
作者
Ben Alaya, Malek [1 ]
Lang, Daniel M. [1 ,2 ]
Wiestler, Benedikt [1 ,3 ]
Schnabel, Julia A. [1 ,2 ,4 ]
Bercea, Cosmin I. [1 ,2 ]
机构
[1] Tech Univ Munich, Munich, Germany
[2] Helmholtz AI & Helmholtz Munich, Munich, Germany
[3] Klinikum Rechts Der Isar, Munich, Germany
[4] Kings Coll London, London, England
关键词
Conditional Multimodal Learning; Biomedical imaging;
D O I
10.1007/978-3-031-73281-2_16
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Denoising diffusion probabilistic models enable high-fidelity image synthesis and editing. In biomedicine, these models facilitate counterfactual image editing, producing pairs of images where one is edited to simulate hypothetical conditions. For example, they can model the progression of specific diseases, such as stroke lesions. However, current image editing techniques often fail to generate realistic biomedical counterfactuals, either by inadequately modeling indirect pathological effects like brain atrophy or by excessively altering the scan, which disrupts correspondence to the original images. Here, we propose MedEdit, a conditional diffusion model for medical image editing. MedEdit induces pathology in specific areas while balancing the modeling of disease effects and preserving the original scan's integrity. We evaluated MedEdit on the Atlas v2.0 stroke dataset using Frechet Inception Distance and Dice scores, outperforming state-of-the-art diffusion-based methods such as Palette (by 45%) and SDEdit (by 61%). Additionally, clinical evaluations by a board-certified neuroradiologist confirmed that MedEdit generated realistic stroke scans indistinguishable from real ones. We believe this work will enable counterfactual image editing research to further advance the development of realistic and clinically useful imaging tools.
引用
收藏
页码:167 / 176
页数:10
相关论文
共 50 条
  • [1] Towards Efficient Diffusion-Based Image Editing with Instant Attention Masks
    Zou, Siyu
    Tang, Jiji
    Zhou, Yiyi
    He, Jing
    Zhao, Chaoyi
    Zhang, Rongsheng
    Hu, Zhipeng
    Sun, Xiaoshuai
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 7, 2024, : 7864 - 7872
  • [2] WAVELET-GUIDED ACCELERATION OF TEXT INVERSION IN DIFFUSION-BASED IMAGE EDITING
    Koo, Gwanhyeong
    Yoon, Sunjae
    Yoo, Chang D.
    2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024, 2024, : 4380 - 4384
  • [3] GroupDiff: Diffusion-Based Group Portrait Editing
    Jiang, Yuming
    Zhao, Nanxuan
    Liu, Qing
    Singh, Krishna Kumar
    Yang, Shuai
    Loy, Chen Change
    Liu, Ziwei
    COMPUTER VISION - ECCV 2024, PT XXXIV, 2025, 15092 : 221 - 239
  • [4] TexSliders: Diffusion-Based Texture Editing in CLIP Space
    Guerrero-Viu, Julia
    Hasan, Milos
    Roullier, Arthur
    Harikumar, Midhun
    Hu, Yiwei
    Guerrero, Paul
    Gutierrez, Diego
    Masia, Belen
    Deschaintre, Valentin
    PROCEEDINGS OF SIGGRAPH 2024 CONFERENCE PAPERS, 2024,
  • [5] Diffusion-Based Image Compression in Steganography
    Mainberger, Markus
    Schmaltz, Christian
    Berg, Matthias
    Weickert, Joachim
    Backes, Michael
    ADVANCES IN VISUAL COMPUTING, ISVC 2012, PT II, 2012, 7432 : 219 - 228
  • [6] Diffusion-Based Visual Counterfactual Explanations - Towards Systematic Quantitative Evaluation
    Vaeth, Philipp
    Fruehwald, Alexander M.
    Paassen, Benjamin
    Gregorova, Magda
    MACHINE LEARNING AND PRINCIPLES AND PRACTICE OF KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2023, PT III, 2025, 2135 : 120 - 135
  • [7] Distraction is All You Need: Memory-Efficient Image Immunization against Diffusion-Based Image Editing
    Lo, Ling
    Yeo, Cheng Yu
    Shuai, Hong-Han
    Cheng, Wen-Huang
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 24462 - 24471
  • [8] Denoising diffusion-based MRI to CT image translation enables automated spinal segmentation
    Graf, Robert
    Schmitt, Joachim
    Schlaeger, Sarah
    Moeller, Hendrik Kristian
    Sideri-Lampretsa, Vasiliki
    Sekuboyina, Anjany
    Krieg, Sandro Manuel
    Wiestler, Benedikt
    Menze, Bjoern
    Rueckert, Daniel
    Kirschke, Jan Stefan
    EUROPEAN RADIOLOGY EXPERIMENTAL, 2023, 7 (01)
  • [9] Denoising diffusion-based MRI to CT image translation enables automated spinal segmentation
    Robert Graf
    Joachim Schmitt
    Sarah Schlaeger
    Hendrik Kristian Möller
    Vasiliki Sideri-Lampretsa
    Anjany Sekuboyina
    Sandro Manuel Krieg
    Benedikt Wiestler
    Bjoern Menze
    Daniel Rueckert
    Jan Stefan Kirschke
    European Radiology Experimental, 7
  • [10] Diffusion-based image inpainting with internal learning
    Cherel, Nicolas
    Almansa, Andres
    Gousseau, Yann
    Newson, Alasdair
    32ND EUROPEAN SIGNAL PROCESSING CONFERENCE, EUSIPCO 2024, 2024, : 446 - 450