Multimodal large language models for inclusive collaboration learning tasks

被引:0
|
作者
Lewis, Armanda [1 ]
机构
[1] New York Univ, 726 Broadway, New York, NY 10003 USA
关键词
CORPUS;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This PhD project leverages advancements in multimodal large language models to build an inclusive collaboration feedback loop, in order to facilitate the automated detection, modeling, and feedback for participants developing general collaboration skills. This topic is important given the role of collaboration as an essential 21st century skill, the potential to ground large language models within learning theory and real-world practice, and the expressive potential of transformer models to support equity and inclusion. We address some concerns of integrating advances in natural language processing into downstream tasks such as the learning analytics feedback loop.
引用
收藏
页码:202 / 210
页数:9
相关论文
共 50 条
  • [1] Understanding Naturalistic Facial Expressions with Deep Learning and Multimodal Large Language Models
    Bian, Yifan
    Kuester, Dennis
    Liu, Hui
    Krumhuber, Eva G.
    [J]. SENSORS, 2024, 24 (01)
  • [2] From Large Language Models to Large Multimodal Models: A Literature Review
    Huang, Dawei
    Yan, Chuan
    Li, Qing
    Peng, Xiaojiang
    [J]. APPLIED SCIENCES-BASEL, 2024, 14 (12):
  • [3] The application of multimodal large language models in medicine
    Qiu, Jianing
    Yuan, Wu
    Lam, Kyle
    [J]. LANCET REGIONAL HEALTH-WESTERN PACIFIC, 2024, 45
  • [4] Multimodal large language models for bioimage analysis
    Zhang, Shanghang
    Dai, Gaole
    Huang, Tiejun
    Chen, Jianxu
    [J]. NATURE METHODS, 2024, 21 (08) : 1390 - 1393
  • [5] Evolution and Prospects of Foundation Models: From Large Language Models to Large Multimodal Models
    Chen, Zheyi
    Xu, Liuchang
    Zheng, Hongting
    Chen, Luyao
    Tolba, Amr
    Zhao, Liang
    Yu, Keping
    Feng, Hailin
    [J]. CMC-COMPUTERS MATERIALS & CONTINUA, 2024, 80 (02): : 1753 - 1808
  • [6] Large language models and multimodal foundation models for precision oncology
    Truhn, Daniel
    Eckardt, Jan-Niklas
    Ferber, Dyke
    Kather, Jakob Nikolas
    [J]. NPJ PRECISION ONCOLOGY, 2024, 8 (01)
  • [7] Navigating WebAI: Training Agents to CompleteWeb Tasks with Large Language Models and Reinforcement Learning
    Thil, Lucas-Andrei
    Popa, Mirela
    Spanakis, Gerasimos
    [J]. 39TH ANNUAL ACM SYMPOSIUM ON APPLIED COMPUTING, SAC 2024, 2024, : 866 - 874
  • [8] Large language models and multimodal foundation models for precision oncology
    Daniel Truhn
    Jan-Niklas Eckardt
    Dyke Ferber
    Jakob Nikolas Kather
    [J]. npj Precision Oncology, 8
  • [9] Implications of Multimodal Learning Models for foreign language teaching and learning
    Farias, Miguel
    Obilinovic, Katica
    Orrego, Roxana
    [J]. COLOMBIAN APPLIED LINGUISTICS JOURNAL, 2007, 9 : 174 - 199
  • [10] Contextual Object Detection with Multimodal Large Language Models
    Zang, Yuhang
    Li, Wei
    Han, Jun
    Zhou, Kaiyang
    Loy, Chen Change
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2024,