Adapting Large Multimodal Models to Distribution Shifts: The Role of In-Context Learning

被引:0
|
作者
University of New South Wales, Australia [1 ]
不详 [2 ]
不详 [3 ]
不详 [4 ]
不详 [5 ]
不详 [6 ]
不详 [7 ]
机构
来源
关键词
Compilation and indexing terms; Copyright 2024 Elsevier Inc;
D O I
暂无
中图分类号
学科分类号
摘要
Context learning - Domain specific - Fine tuning - In contexts - Language model - Learning methods - Multimodal models - Natural distribution - Parameter spaces - Specific adaptations
引用
收藏
相关论文
共 43 条
  • [1] In-context learning enables multimodal large language models to classify cancer pathology images
    Dyke Ferber
    Georg Wölflein
    Isabella C. Wiest
    Marta Ligero
    Srividhya Sainath
    Narmin Ghaffari Laleh
    Omar S. M. El Nahhas
    Gustav Müller-Franzes
    Dirk Jäger
    Daniel Truhn
    Jakob Nikolas Kather
    Nature Communications, 15 (1)
  • [2] Adaptive In-Context Learning with Large Language Models for Bundle
    Sun, Zhu
    Feng, Kaidong
    Yang, Jie
    Qu, Xinghua
    Fang, Hui
    Ong, Yew-Soon
    Liu, Wenyuan
    PROCEEDINGS OF THE 47TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, SIGIR 2024, 2024, : 966 - 976
  • [3] In-Context Learning Unlocked for Diffusion Models
    Wang, Zhendong
    Jiang, Yifan
    Lu, Yadong
    Shen, Yelong
    He, Pengcheng
    Chen, Weizhu
    Wang, Zhangyang
    Zhou, Mingyuan
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [4] Meta In-Context Learning: Harnessing Large Language Models for Electrical Data Classification
    Zhou, Mi
    Li, Fusheng
    Zhang, Fan
    Zheng, Junhao
    Ma, Qianli
    ENERGIES, 2023, 16 (18)
  • [5] Large Language Models Are Latent Variable Models: Explaining and Finding Good Demonstrations for In-Context Learning
    Wang, Xinyi
    Zhu, Wanrong
    Saxon, Michael
    Steyvers, Mark
    Wang, William Yang
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [6] From System Models to Class Models: An In-Context Learning Paradigm
    Forgione, Marco
    Pura, Filippo
    Piga, Dario
    IEEE CONTROL SYSTEMS LETTERS, 2023, 7 : 3513 - 3518
  • [7] Query-focused Submodular Demonstration Selection for In-context Learning in Large Language Models
    Trust, Paul
    Minghim, Rosane
    2023 31ST IRISH CONFERENCE ON ARTIFICIAL INTELLIGENCE AND COGNITIVE SCIENCE, AICS, 2023,
  • [8] Automatic smart contract comment generation via large language models and in-context learning
    Zhao, Junjie
    Chen, Xiang
    Yang, Guang
    Shen, Yiheng
    INFORMATION AND SOFTWARE TECHNOLOGY, 2024, 168
  • [9] Structured State Space Models for In-Context Reinforcement Learning
    Lu, Chris
    Schroecker, Yannick
    Gu, Albert
    Parisotto, Emilio
    Foerster, Jakob
    Singh, Satinder
    Behbahani, Feryal
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [10] In-Context Impersonation Reveals Large Language Models' Strengths and Biases
    Salewski, Leonard
    Alaniz, Stephan
    Rio-Torto, Isabel
    Schulz, Eric
    Akata, Zeynep
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,