Exploring the Benefits of Training Expert Language Models over Instruction Tuning

被引：0
|
作者：
Jang, Joel [1 ]
Kim, Seungone [1 ]
Ye, Seonghyeon [1 ]
Kim, Doyoung [1 ]
Logeswaran, Lajanugen [2 ]
Lee, Moontae [2 ,3 ]
Lee, Kyungjae [2 ]
Seo, Minjoon [1 ]
机构：
[1] KAIST, Korea, Republic of
[2] LG AI Research, Korea, Republic of
[3] University of Illinois, Chicago, United States
来源：
Proceedings of Machine Learning Research | 2023年 / 202卷
关键词：
Compilation and indexing terms; Copyright 2024 Elsevier Inc;
D O I：
暂无
中图分类号：
学科分类号：
摘要：
Computational linguistics
引用
收藏
页码：14702 / 14729
相关论文
共 50 条
  • [31] Distributed Inference and Fine-tuning of Large Language Models Over The Internet
    Borzunov, Alexander
    Ryabinin, Max
    Chumachenko, Artem
    Baranchuk, Dmitry
    Dettmers, Tim
    Belkada, Younes
    Samygin, Pavel
    Raffel, Colin
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [32] TOWARD PSYCHOLINGUISTIC MODELS OF LANGUAGE INSTRUCTION
    POLITZER, RL
    TESOL QUARTERLY, 1968, 2 (03) : 151 - 157
  • [33] InstructGraph: Boosting Large Language Models via Graph-centric Instruction Tuning and Preference Alignment
    Wang, Jianing
    Wu, Junda
    Hon, Yupeng
    Liu, Yao
    Gao, Ming
    McAuley, Julian
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: ACL 2024, 2024, : 13492 - 13510
  • [34] Enhancing Visual Information Extraction with Large Language Models Through Layout-Aware Instruction Tuning
    Li, Teng
    Wang, Jiapeng
    Jin, Lianwen
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2024, PT VII, 2025, 15037 : 276 - 289
  • [35] Exploring a Conceptual Framework for Expert Noticing During Literacy Instruction
    Ross, Pamela
    Gibson, Sharan A.
    LITERACY RESEARCH AND INSTRUCTION, 2010, 49 (02) : 175 - 193
  • [36] Mobile Devices in English Language Instruction: Facilitation and Benefits
    Chwo, Gloria Shu Mei
    15TH IEEE INTERNATIONAL CONFERENCE ON ADVANCED LEARNING TECHNOLOGIES (ICALT 2015), 2015, : 99 - 101
  • [37] SmartEdit: Exploring Complex Instruction-based Image Editing with Multimodal Large Language Models
    Huang, Yuzhou
    Xie, Liangbin
    Wang, Xintao
    Yuan, Ziyang
    Cun, Xiaodong
    Ge, Yixiao
    Zhou, Jiantao
    Dong, Chao
    Huang, Rui
    Zhang, Ruimao
    Shan, Ying
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2024, 2024, : 8362 - 8371
  • [38] Exploring the role of Large Language Models in haematology: A focused review of applications, benefits and limitations
    Mudrik, Aya
    Nadkarni, Girish N.
    Efros, Orly
    Glicksberg, Benjamin S.
    Klang, Eyal
    Soffer, Shelly
    BRITISH JOURNAL OF HAEMATOLOGY, 2024, 205 (05) : 1685 - 1698
  • [39] Fine Tuning of large language Models for Arabic Language
    Tamer, Ahmed
    Hassan, Al-Amir
    Ali, Asmaa
    Salah, Nada
    Medhat, Walaa
    2023 20TH ACS/IEEE INTERNATIONAL CONFERENCE ON COMPUTER SYSTEMS AND APPLICATIONS, AICCSA, 2023,
  • [40] EcomGPT: Instruction-Tuning Large Language Models with Chain-of-Task Tasks for E-commerce
    Li, Yangning
    Ma, Shirong
    Wang, Xiaobin
    Huang, Shen
    Jiang, Chengyue
    Zheng, Hai-Tao
    Xie, Pengjun
    Huang, Fei
    Jiang, Yong
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 17, 2024, : 18582 - 18590
12345