Fine-Tuning via Mask Language Model Enhanced Representations Based Contrastive Learning and Application

被引：0
|
作者：
Zhang, Dechi [1 ]
Wan, Weibing [1 ]
机构：
[1] School of Electrical and Electronic Engineering, Shanghai University of Engineering Science, Shanghai,200000, China
来源：
Computer Engineering and Applications | 2024年 / 60卷 / 17期
关键词：
35;
D O I：
10.3778/j.issn.1002-8331.2306-0190
中图分类号：
学科分类号：
摘要：
引用
收藏
页码：129 / 138
相关论文
共 50 条
  • [1] NoRefER: a Referenceless Quality Metric for Automatic Speech Recognition via Semi-Supervised Language Model Fine-Tuning with Contrastive Learning
    Yuksel, Kamer Ali
    Ferreira, Thiago Castro
    Javadi, Golara
    Al-Badrashiny, Mohamed
    Gunduz, Ahmet
    [J]. INTERSPEECH 2023, 2023, : 466 - 470
  • [2] Efficient Index Learning via Model Reuse and Fine-tuning
    Liu, Guanli
    Qi, Jianzhong
    Kulik, Lars
    Soga, Kazuya
    Borovica-Gajic, Renata
    Rubinstein, Benjamin I. P.
    [J]. 2023 IEEE 39TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING WORKSHOPS, ICDEW, 2023, : 60 - 66
  • [3] MediBioDeBERTa: Biomedical Language Model With Continuous Learning and Intermediate Fine-Tuning
    Kim, Eunhui
    Jeong, Yuna
    Choi, Myung-Seok
    [J]. IEEE ACCESS, 2023, 11 : 141036 - 141044
  • [4] Transfer Learning Gaussian Anomaly Detection by Fine-tuning Representations
    Rippel, Oliver
    Chavan, Arnav
    Lei, Chucai
    Merhof, Dorit
    [J]. IMPROVE: PROCEEDINGS OF THE 2ND INTERNATIONAL CONFERENCE ON IMAGE PROCESSING AND VISION ENGINEERING, 2022, : 45 - 56
  • [5] How fine can fine-tuning be? Learning efficient language models
    Radiya-Dixit, Evani
    Wang, Xin
    [J]. INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 108, 2020, 108 : 2435 - 2442
  • [6] Patent classification by fine-tuning BERT language model
    Lee, Jieh-Sheng
    Hsiang, Jieh
    [J]. WORLD PATENT INFORMATION, 2020, 61
  • [7] Comprehensive Review of Large Language Model Fine-Tuning
    Zhang, Qintong
    Wang, Yuchao
    Wang, Hexi
    Wang, Junxin
    Chen, Hai
    [J]. Computer Engineering and Applications, 2024, 60 (17) : 17 - 33
  • [8] Knowledge Graph Fusion for Language Model Fine-Tuning
    Bhana, Nimesh
    van Zyl, Terence L.
    [J]. 2022 9TH INTERNATIONAL CONFERENCE ON SOFT COMPUTING & MACHINE INTELLIGENCE, ISCMI, 2022, : 167 - 172
  • [9] Universal Language Model Fine-tuning for Text Classification
    Howard, Jeremy
    Ruder, Sebastian
    [J]. PROCEEDINGS OF THE 56TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL), VOL 1, 2018, : 328 - 339
  • [10] A multilingual offensive language detection method based on transfer learning from transformer fine-tuning model
    El-Alami, Fatima-zahra
    Alaoui, Said Ouatik El
    Nahnahi, Noureddine En
    [J]. JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2022, 34 (08) : 6048 - 6056
12345