Automated Scoring of Translations with BERT Models: Chinese and English Language Case Study

被引:0
|
作者
Cui, Yizhuo [1 ]
Liang, Maocheng [2 ]
机构
[1] North China Univ Technol, Sch Humanities & Law, Beijing 100144, Peoples R China
[2] Beihang Univ, Sch Foreign Languages, Beijing 100191, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2024年 / 14卷 / 05期
关键词
large language model; BERT; automated scoring of translations; large-scale translation contest;
D O I
10.3390/app14051925
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
With the wide application of artificial intelligence represented by deep learning in natural language-processing tasks, the automated scoring of translations has also advanced and improved. This study aims to determine if the BERT-assist system can reliably assess translation quality and identify high-quality translations for potential recognition. It takes the Han Suyin International Translation Contest as a case study, which is a large-scale and influential translation contest in China, with a history of over 30 years. The experimental results show that the BERT-assist system is a reliable second rater for massive translations in terms of translation quality, as it can effectively sift out high-quality translations with a reliability of r = 0.9 or higher. Thus, the automated translation scoring system based on BERT can satisfactorily predict the ranking of translations according to translation quality and sift out high-quality translations potentially shortlisted for prizes.
引用
收藏
页数:17
相关论文
共 50 条
  • [21] Lexical Semantics with Large Language Models: A Case Study of English break
    Petersen, Erika
    Potts, Christopher
    17TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EACL 2023, 2023, : 490 - 511
  • [22] Computer or human: a comparative study of automated evaluation scoring and instructors' feedback on Chinese college students' English writing
    Chen, Huimei
    Pan, Jie
    ASIAN-PACIFIC JOURNAL OF SECOND AND FOREIGN LANGUAGE EDUCATION, 2022, 7 (01)
  • [23] Computer or human: a comparative study of automated evaluation scoring and instructors’ feedback on Chinese college students’ English writing
    Huimei Chen
    Jie Pan
    Asian-Pacific Journal of Second and Foreign Language Education, 7
  • [24] Retranslation hypotheses revisited: A case study of two English translations of Sanguo Yanyi - the first Chinese novel
    Feng, Lei
    STELLENBOSCH PAPERS IN LINGUISTICS PLUS-SPIL PLUS, 2014, 43 : 69 - 86
  • [25] Advancing Automated and Adaptive Educational Resources Through Semantic Analysis with BERT and GRU in English Language Learning
    Jayakumar, V. Moses
    Rajakumari, R.
    Sarwar, Sana
    Syed, Darakhshan Mazhar
    Prema, S.
    Boddupalli, Santhosh
    El-Ebiary, Yousef A. Baker
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2024, 15 (04) : 869 - 880
  • [26] Translations of Sovietisms: A Comparative Case Study of English Translations of Bulgakov's The Master and Margarita
    Vid, Natalia Kaloh
    META, 2017, 62 (01) : 178 - 200
  • [27] Evaluating BERT for natural language inference: A case study on the CommitmentBank
    Jiang, Nanjiang
    de Marneffe, Marie-Catherine
    2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019): PROCEEDINGS OF THE CONFERENCE, 2019, : 6086 - 6091
  • [28] Micro Language Planning for Sustainable Early English Language Education: A Case Study on Chinese Educators' Agency
    Liang, Luyao
    Li, Hui
    Chik, Alice
    SUSTAINABILITY, 2022, 14 (21)
  • [29] A Comparative Study of Shifts in English Translations of The Quran: A Case Study on "Yusuf"
    Rezvani, Reza
    Nouraey, Peyman
    KHAZAR JOURNAL OF HUMANITIES AND SOCIAL SCIENCES, 2014, 17 (01): : 70 - 87
  • [30] The trace of translators' ideology: A case study of English translations of the Qur'an
    Mohaghegh, Ameneh
    Pirnajmuddin, Hossein
    3L-LANGUAGE LINGUISTICS LITERATURE-THE SOUTHEAST ASIAN JOURNAL OF ENGLISH LANGUAGE STUDIES, 2013, 19 (01): : 51 - 64