MIND THE GAP: SCANNER-INDUCED DOMAIN SHIFTS POSE CHALLENGES FOR REPRESENTATION LEARNING IN HISTOPATHOLOGY

被引:0
|
作者
Wilm, Frauke [1 ,2 ]
Fragoso, Marco [3 ]
Bertram, Christof A. [4 ]
Stathonikos, Nikolas [5 ]
Oettl, Mathias [1 ]
Qiu, Jingna [2 ]
Klopfleisch, Robert [3 ]
Maier, Andreas [1 ]
Aubreville, Marc [6 ]
Breininger, Katharina [2 ]
机构
[1] Friedrich Alexander Univ Erlangen Nurnberg, Pattern Recognit Lab, Erlangen, Germany
[2] Friedrich Alexander Univ Erlangen Nurnberg, Dept AIBE, Erlangen, Germany
[3] Free Univ Berlin, Inst Vet Pathol, Berlin, Germany
[4] Univ Vet Med, Inst Pathol, Vienna, Austria
[5] Univ Med Ctr Utrecht, Dept Pathol, Utrecht, Netherlands
[6] Tech Hsch Ingolstadt, Ingolstadt, Germany
关键词
Histopathology; Domain Shift; Representation Learning; Barlow Twins;
D O I
10.1109/ISBI53787.2023.10230458
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Computer-aided systems in histopathology are often challenged by various sources of domain shift that impact the performance of these algorithms considerably. We investigated the potential of using self-supervised pre-training to overcome scanner-induced domain shifts for the downstream task of tumor segmentation. For this, we present the Barlow Triplets to learn scanner-invariant representations from a multi-scanner dataset with local image correspondences. We show that self-supervised pre-training successfully aligned different scanner representations, which, interestingly only results in a limited benefit for our downstream task. We thereby provide insights into the influence of scanner characteristics for downstream applications and contribute to a better understanding of why established self-supervised methods have not yet shown the same success on histopathology data as they have for natural images.
引用
收藏
页数:5
相关论文
共 9 条
  • [1] Mind the gap: challenges of deep learning approaches to Theory of Mind
    Aru, Jaan
    Labash, Aqeel
    Corcoll, Oriol
    Vicente, Raul
    [J]. ARTIFICIAL INTELLIGENCE REVIEW, 2023, 56 (09) : 9141 - 9156
  • [2] Mind the gap: challenges of deep learning approaches to Theory of Mind
    Jaan Aru
    Aqeel Labash
    Oriol Corcoll
    Raul Vicente
    [J]. Artificial Intelligence Review, 2023, 56 : 9141 - 9156
  • [3] Assessment of Scanner Domain Shifts in Deep Multiple Instance Learning
    Ganz, Jonathan
    Puget, Chloe
    Ammeling, Jonas
    Parlak, Eda
    Kiupel, Matti
    Bertram, Christof A.
    Breininger, Katharina
    Klopfleisch, Robert
    Aubreville, Marc
    [J]. BILDVERARBEITUNG FUR DIE MEDIZIN 2024, 2024, : 137 - 142
  • [4] Supervision and Source Domain Impact on Representation Learning: A Histopathology Case Study
    Sikaroudi, Milad
    Safarpoor, Amir
    Ghojogh, Benyamin
    Shafiei, Sobhan
    Crowley, Mark
    Tizhoosh, H. R.
    [J]. 42ND ANNUAL INTERNATIONAL CONFERENCES OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY: ENABLING INNOVATIVE TECHNOLOGIES FOR GLOBAL HEALTHCARE EMBC'20, 2020, : 1400 - 1403
  • [5] Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation Learning
    Liang, Weixin
    Zhang, Yuhui
    Kwon, Yongchan
    Yeung, Serena
    Zou, James
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [6] Representation learning-based unsupervised domain adaptation for classification of breast cancer histopathology images
    Alirezazadeh, Pendar
    Hejrati, Behzad
    Monsef-Esfahani, Alireza
    Fathi, Abdolhossein
    [J]. BIOCYBERNETICS AND BIOMEDICAL ENGINEERING, 2018, 38 (03) : 671 - 683
  • [7] Learning Causal Representation for Training Cross-Domain Pose Estimator via Generative Interventions
    Zhang, Xiheng
    Wong, Yongkang
    Wu, Xiaofei
    Lu, Juwei
    Kankanhalli, Mohan
    Li, Xiangdong
    Geng, Weidong
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 11250 - 11260
  • [8] Robust multi-task learning and online refinement for spacecraft pose estimation across domain gap
    Park, Tae Ha
    D'Amico, Simone
    [J]. ADVANCES IN SPACE RESEARCH, 2024, 73 (11) : 5726 - 5740
  • [9] Model-Induced Generalization Error Bound for Information-Theoretic Representation Learning in Source-Data-Free Unsupervised Domain Adaptation
    Yang, Baoyao
    Yeh, Hao-Wei
    Harada, Tatsuya
    Yuen, Pong C.
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 419 - 432