Automated Scoring of Translations with BERT Models: Chinese and English Language Case Study

被引:0
|
作者
Cui, Yizhuo [1 ]
Liang, Maocheng [2 ]
机构
[1] North China Univ Technol, Sch Humanities & Law, Beijing 100144, Peoples R China
[2] Beihang Univ, Sch Foreign Languages, Beijing 100191, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2024年 / 14卷 / 05期
关键词
large language model; BERT; automated scoring of translations; large-scale translation contest;
D O I
10.3390/app14051925
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
With the wide application of artificial intelligence represented by deep learning in natural language-processing tasks, the automated scoring of translations has also advanced and improved. This study aims to determine if the BERT-assist system can reliably assess translation quality and identify high-quality translations for potential recognition. It takes the Han Suyin International Translation Contest as a case study, which is a large-scale and influential translation contest in China, with a history of over 30 years. The experimental results show that the BERT-assist system is a reliable second rater for massive translations in terms of translation quality, as it can effectively sift out high-quality translations with a reliability of r = 0.9 or higher. Thus, the automated translation scoring system based on BERT can satisfactorily predict the ranking of translations according to translation quality and sift out high-quality translations potentially shortlisted for prizes.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Automated Scoring of Students' English-to-Chinese Translations of Three Text Types
    Jiang, Jinlin
    Jiang, Lihua
    Lu, Xiaofei
    JOURNAL OF QUANTITATIVE LINGUISTICS, 2018, 25 (03) : 238 - 255
  • [2] Leveraging Large Language Models for Automated Chinese Essay Scoring
    Feng, Haiyue
    Du, Sixuan
    Zhu, Gaoxia
    Zou, Yan
    Poh Boon Phua
    Feng, Yuhong
    Zhong, Haoming
    Shen, Zhiqi
    Liu, Siyuan
    ARTIFICIAL INTELLIGENCE IN EDUCATION, PT I, AIED 2024, 2024, 14829 : 454 - 467
  • [3] Automatic Scoring for Translations Based on Language Models
    Wu, Diming
    Wang, Mingke
    Li, Xiaomin
    COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022
  • [4] Automatic Scoring for Translations Based on Language Models
    Wu, Diming
    Wang, Mingke
    Li, Xiaomin
    COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022
  • [5] Large language models and automated essay scoring of English language learner writing: Insights into validity and reliability
    Pack A.
    Barrett A.
    Escalante J.
    Computers and Education: Artificial Intelligence, 2024, 6
  • [6] Automated scoring of Chinese engineering students' english essays
    Liu M.
    Wang Y.
    Xu W.
    Liu L.
    1600, IGI Global (15): : 52 - 68
  • [7] Language models in automated essay scoring: Insights for the Turkish language
    Firoozi, Tahereh
    Bulut, Okan
    Gierl, Mark J.
    INTERNATIONAL JOURNAL OF ASSESSMENT TOOLS IN EDUCATION, 2023, 10 : 148 - 162
  • [8] English language learners and automated scoring of essays: Critical considerations
    Weigle, Sara Cushing
    ASSESSING WRITING, 2013, 18 (01) : 85 - 99
  • [9] The English translations of relic descriptions in Chinese museums: a comparative case study of jade descriptions
    Zhou, Tingting
    ASIA PACIFIC TRANSLATION AND INTERCULTURAL STUDIES, 2019, 6 (01) : 64 - 78
  • [10] Exploring Multilingual Word Embedding Alignments in BERT Models: A Case Study of English and Norwegian
    Aaby, Pernille
    Biermann, Daniel
    Yazidi, Anis
    Mello, Gustavo Borges Moreno e
    Palumbo, Fabrizio
    ARTIFICIAL INTELLIGENCE XL, AI 2023, 2023, 14381 : 47 - 58