VOLTA: an enVironment-aware cOntrastive ceLl represenTation leArning for histopathology

被引:0
|
作者
Nakhli, Ramin [1 ]
Rich, Katherine [2 ]
Zhang, Allen [3 ]
Darbandsari, Amirali [4 ]
Shenasa, Elahe [3 ]
Hadjifaradji, Amir [1 ]
Thiessen, Sidney [5 ]
Milne, Katy [5 ]
Jones, Steven J. M. [6 ,7 ]
Mcalpine, Jessica N. [8 ]
Nelson, Brad H. [5 ]
Gilks, C. Blake [3 ]
Farahani, Hossein [1 ]
Bashashati, Ali [1 ,3 ,6 ]
机构
[1] Univ British Columbia, Sch Biomed Engn, Vancouver, BC, Canada
[2] Univ British Columbia, Bioinformat Grad Program, Vancouver, BC, Canada
[3] Univ British Columbia, Dept Pathol & Lab Med, Vancouver, BC, Canada
[4] Univ British Columbia, Dept Elect & Comp Engn, Vancouver, BC, Canada
[5] BC Canc Agcy, Deeley Res Ctr, Victoria, BC, Canada
[6] BC Canc Res Inst, Canadas Michael Smith Genome Sci Ctr, Vancouver, BC, Canada
[7] Univ British Columbia, Dept Med Genet, Vancouver, BC, Canada
[8] Univ British Columbia, Dept Obstet & Gynecol, Vancouver, BC, Canada
基金
加拿大自然科学与工程研究理事会; 加拿大创新基金会;
关键词
TUMOR; MICROENVIRONMENT; HETEROGENEITY; NORMALIZATION;
D O I
10.1038/s41467-024-48062-1
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
In clinical oncology, many diagnostic tasks rely on the identification of cells in histopathology images. While supervised machine learning techniques necessitate the need for labels, providing manual cell annotations is time-consuming. In this paper, we propose a self-supervised framework (enVironment-aware cOntrastive cell represenTation learning: VOLTA) for cell representation learning in histopathology images using a technique that accounts for the cell's mutual relationship with its environment. We subject our model to extensive experiments on data collected from multiple institutions comprising over 800,000 cells and six cancer types. To showcase the potential of our proposed framework, we apply VOLTA to ovarian and endometrial cancers and demonstrate that our cell representations can be utilized to identify the known histotypes of ovarian cancer and provide insights that link histopathology and molecular subtypes of endometrial cancer. Unlike supervised models, we provide a framework that can empower discoveries without any annotation data, even in situations where sample sizes are limited. While machine learning platforms can improve the assessment of Hematoxylin & Eosin (H&E) stained-tumour tissue images, current models typically require manual cell-type annotations in training. Here, the authors develop VOLTA, a self-supervised machine learning framework to improve cell representation learning in H&E images based on the cells environment
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Lesion-Aware Contrastive Representation Learning for Histopathology Whole Slide Images Analysis
    Li, Jun
    Zheng, Yushan
    Wu, Kun
    Shi, Jun
    Xie, Fengying
    Jiang, Zhiguo
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2022, PT II, 2022, 13432 : 273 - 282
  • [2] Environment-aware Sensor Fusion using Deep Learning
    Silva, Caio Fischer
    Borges, Paulo V. K.
    Castanho, Jose E. C.
    [J]. ICINCO: PROCEEDINGS OF THE 16TH INTERNATIONAL CONFERENCE ON INFORMATICS IN CONTROL, AUTOMATION AND ROBOTICS, VOL 2, 2019, : 88 - 96
  • [3] Optimizing Environment-aware VANET Clustering using Machine Learning
    Yasmine Fahmy
    Ghada Alsuhli
    Ahmed Khattab
    [J]. International Journal of Intelligent Transportation Systems Research, 2023, 21 : 394 - 408
  • [4] Optimizing Environment-aware VANET Clustering using Machine Learning
    Fahmy, Yasmine
    Alsuhli, Ghada
    Khattab, Ahmed
    [J]. INTERNATIONAL JOURNAL OF INTELLIGENT TRANSPORTATION SYSTEMS RESEARCH, 2023, 21 (03) : 394 - 408
  • [5] Playing FPS Games With Environment-Aware Hierarchical Reinforcement Learning
    Song, Shihong
    Weng, Jiayi
    Su, Hang
    Yan, Dong
    Zou, Haosheng
    Zhu, Jun
    [J]. PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2019, : 3475 - 3482
  • [6] A platform for environment-aware applications
    van der Meer, S
    Arbanowski, S
    Popescu-Zeletin, R
    [J]. HANDHELD AND UBIQUITOUS COMPUTING, PROCEEDINGS, 1999, 1707 : 368 - 370
  • [7] Route Optimization via Environment-Aware Deep Network and Reinforcement Learning
    Guo, Pengzhan
    Xiao, Keli
    Ye, Zeyang
    Zhu, Wei
    [J]. ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2021, 12 (06)
  • [8] ENVIRONMENT-AWARE RECONFIGURABLE NOISE SUPPRESSION
    Yang, Jun
    Bingham, Joshua
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 3042 - 3046
  • [9] Environment-Aware Dynamic Graph Learning for Out-of-Distribution Generalization
    Yuan, Haonan
    Sun, Qingyun
    Fu, Xingcheng
    Zhang, Ziwei
    Ji, Cheng
    Peng, Hao
    Li, Jianxin
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [10] Local structure-aware graph contrastive representation learning
    Yang, Kai
    Liu, Yuan
    Zhao, Zijuan
    Ding, Peijin
    Zhao, Wenqian
    [J]. NEURAL NETWORKS, 2024, 172