Enriching AI-based Predictive Models from Retinal Imaging by Multi-Modal Contrastive Pre-training

被引：0
|
作者：
Sukei, Emese [1 ]
Riedl, Sophie [1 ]
Rumetshofer, Elisabeth [2 ]
Schmidinger, Niklas [2 ]
Mayr, Andreas [2 ]
Schmidt-Erfurth, Ursula [1 ]
Klambauer, Guenter [2 ]
Bogunovic, Hrvoje [1 ]
机构：
[1] Med Univ Wien, Dept Ophthalmol, Vienna, Austria
[2] Johannes Kepler Univ Linz, Inst Machine Learning, Linz, Austria
来源：
INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE | 2024年 / 65卷 / 07期
基金：
奥地利科学基金会;
关键词：
D O I：
暂无
中图分类号：
R77 [眼科学];
学科分类号：
100212 ;
摘要：
450
引用
收藏
页数：4
相关论文
共 50 条
  • [1] Multi-Modal Contrastive Pre-training for Recommendation
    Liu, Zhuang
    Ma, Yunpu
    Schubert, Matthias
    Ouyang, Yuanxin
    Xiong, Zhang
    PROCEEDINGS OF THE 2022 INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, ICMR 2022, 2022, : 99 - 108
  • [2] Advancing Fundus-Based Retinal Representations Through Multi-Modal Contrastive Pre-training for Detection of Glaucoma-Related Diseases
    Guo, Yawen
    Ng, Michelle
    Yan, Xu
    Hung, Calvin
    Lam, Alexander
    Leung, Christopher Kai-Shun
    INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2024, 65 (07)
  • [3] CLAP: Contrastive Language-Audio Pre-training Model for Multi-modal Sentiment Analysis
    Zhao, Tianqi
    Kong, Ming
    Liang, Tian
    Zhu, Qiang
    Kuang, Kun
    Wu, Fei
    PROCEEDINGS OF THE 2023 ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, ICMR 2023, 2023, : 622 - 626
  • [4] MMCPP: A MULTI-MODAL CONTRASTIVE PRE-TRAINING MODEL FOR PLACE REPRESENTATION BASED ON THE SPATIO-TEMPORAL FRAMEWORK
    Chen, Y.
    Yu, X. S.
    Qin, K.
    GEOSPATIAL WEEK 2023, VOL. 10-1, 2023, : 303 - 310
  • [5] MULTI-MODAL PRE-TRAINING FOR AUTOMATED SPEECH RECOGNITION
    Chan, David M.
    Ghosh, Shalini
    Chakrabarty, Debmalya
    Hoffmeister, Bjorn
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 246 - 250
  • [6] Real-time Emotion Pre-Recognition in Conversations with Contrastive Multi-modal Dialogue Pre-training
    Ju, Xincheng
    Zhang, Dong
    Zhu, Suyang
    Li, Junhui
    Li, Shoushan
    Zhou, Guodong
    PROCEEDINGS OF THE 32ND ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2023, 2023, : 1045 - 1055
  • [7] TableVLM: Multi-modal Pre-training for Table Structure Recognition
    Chen, Leiyuan
    Huang, Chengsong
    Zheng, Xiaoqing
    Lin, Jinshu
    Huang, Xuanjing
    PROCEEDINGS OF THE 61ST ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL 2023, VOL 1, 2023, : 2437 - 2449
  • [8] MGeo: Multi-Modal Geographic Language Model Pre-Training
    Ding, Ruixue
    Chen, Boli
    Xie, Pengjun
    Huang, Fei
    Li, Xin
    Zhang, Qiang
    Xu, Yao
    PROCEEDINGS OF THE 46TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, SIGIR 2023, 2023, : 185 - 194
  • [9] Efficient Multi-modal Human-Centric Contrastive Pre-training with a Pseudo Body-Structured Prior
    Meng, Yihang
    Cheng, Hao
    Wang, Zihua
    Zhu, Hongyuan
    Lao, Xiuxian
    Zhang, Yu
    PATTERN RECOGNITION AND COMPUTER VISION, PT V, PRCV 2024, 2025, 15035 : 114 - 128
  • [10] StEP: Style-based Encoder Pre-training for Multi-modal Image Synthesis
    Meshry, Moustafa
    Ren, Yixuan
    Davis, Larry S.
    Shrivastava, Abhinav
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 3711 - 3720
12345