MedEdit: Counterfactual Diffusion-Based Image Editing on Brain MRI

被引:0
|
作者
Ben Alaya, Malek [1 ]
Lang, Daniel M. [1 ,2 ]
Wiestler, Benedikt [1 ,3 ]
Schnabel, Julia A. [1 ,2 ,4 ]
Bercea, Cosmin I. [1 ,2 ]
机构
[1] Tech Univ Munich, Munich, Germany
[2] Helmholtz AI & Helmholtz Munich, Munich, Germany
[3] Klinikum Rechts Der Isar, Munich, Germany
[4] Kings Coll London, London, England
关键词
Conditional Multimodal Learning; Biomedical imaging;
D O I
10.1007/978-3-031-73281-2_16
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Denoising diffusion probabilistic models enable high-fidelity image synthesis and editing. In biomedicine, these models facilitate counterfactual image editing, producing pairs of images where one is edited to simulate hypothetical conditions. For example, they can model the progression of specific diseases, such as stroke lesions. However, current image editing techniques often fail to generate realistic biomedical counterfactuals, either by inadequately modeling indirect pathological effects like brain atrophy or by excessively altering the scan, which disrupts correspondence to the original images. Here, we propose MedEdit, a conditional diffusion model for medical image editing. MedEdit induces pathology in specific areas while balancing the modeling of disease effects and preserving the original scan's integrity. We evaluated MedEdit on the Atlas v2.0 stroke dataset using Frechet Inception Distance and Dice scores, outperforming state-of-the-art diffusion-based methods such as Palette (by 45%) and SDEdit (by 61%). Additionally, clinical evaluations by a board-certified neuroradiologist confirmed that MedEdit generated realistic stroke scans indistinguishable from real ones. We believe this work will enable counterfactual image editing research to further advance the development of realistic and clinically useful imaging tools.
引用
收藏
页码:167 / 176
页数:10
相关论文
共 50 条
  • [41] ERSegDiff: a diffusion-based model for edge reshaping in medical image segmentation
    Chen, Baijing
    Wang, Junxia
    Zheng, Yuanjie
    PHYSICS IN MEDICINE AND BIOLOGY, 2024, 69 (11):
  • [42] Enhanced Diffusion-Based Analysis for Fast Defect Detection in ECPT Image
    Liang, Yiping
    Bai, Libing
    Tian, Lulu
    Zhang, Xu
    Ren, Chao
    Shao, Dan
    Ma, Zhenzhong
    Sun, Mosi
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2024, 20 (02) : 2884 - 2896
  • [43] Curvature-driven diffusion-based mathematical image registration models
    Akinlar, Mehmet Ali
    Kurulay, Muhammet
    Secer, Aydin
    Celenk, Mehmet
    ADVANCES IN DIFFERENCE EQUATIONS, 2012,
  • [44] Diffusion-Based Hybrid Level Set Method for Complex Image Segmentation
    Wang, Xiao-Feng
    Zou, Le
    Lv, Gang
    ADVANCED INTELLIGENT COMPUTING THEORIES AND APPLICATIONS, ICIC 2015, PT III, 2015, 9227 : 331 - 337
  • [45] Hybrid diffusion-based visual image encryption for secure cloud storage
    Zhang, Yan
    Tong, Yaonan
    Li, Chunlai
    Peng, Yuexi
    Tan, Fei
    NONLINEAR DYNAMICS, 2024, : 7259 - 7276
  • [46] Improving Diffusion-Based Image Restoration with Error Contraction and Error Correction
    Bao, Qiqi
    Hui, Zheng
    Zhu, Rui
    Ren, Peiran
    Xie, Xuansong
    Yang, Wenming
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 2, 2024, : 756 - 764
  • [47] Remote Sensing Image Completion Using a Diffusion-Based Propagation Algorithm
    Rolland, Iain
    Selvakumaran, Sivasakthy
    Marinoni, Andrea
    IMAGE AND SIGNAL PROCESSING FOR REMOTE SENSING XXIX, 2023, 12733
  • [48] Characteristics of the diffusion-based brain connectivity among multiple sclerosis phenotypes
    Martinez-Heras, E.
    Solana, E.
    Vivo, F.
    Lopez-Soley, E.
    Alba-Arbalat, S.
    Schoonheim, M.
    Strijbis, E.
    Vrenken, H.
    Barkhof, F.
    Rocca, M. A.
    Filippi, M.
    Groppa, S.
    Fleischer, V.
    Dineen, R.
    Bellenberg, B.
    Carsten, L.
    Pareto, D.
    Rovira, A.
    Sastre-Garriga, J.
    Collorone, S.
    Prados, F.
    Toosy, A.
    Ciccarelli, O.
    Saiz, A.
    Blanco, Y.
    Llufriu, S.
    MULTIPLE SCLEROSIS JOURNAL, 2022, 28 (3_SUPPL) : 533 - 534
  • [49] Towards clinical applicability of the diffusion-based DT-MRI visualization algorithm
    Strachota, Pavel
    Benes, Michal
    Tintera, Jaroslav
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2012, 23 (02) : 387 - 396
  • [50] Counterfactual condition diffusion with continuous prior adaptive correction for anomaly detection in multimodal brain MRI
    Chen, Xue
    Peng, Yanjun
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 254