Evaluating an NLG System using Post-Editing

被引：0

作者：

Sripada, Somayajulu G. ^{[1
]}

Reiter, Ehud ^{[1
]}

Hawizy, Lezan ^{[1
]}

机构：

[1] Univ Aberdeen, Dept Comp Sci, Aberdeen AB24 3UE, Scotland

来源：

19TH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE (IJCAI-05) | 2005年

关键词：

D O I：

暂无

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

Computer-generated texts, whether from Natural Language Generation (NLG) or Machine Translation (MT) systems, are often post-edited by humans before being released to users. The frequency and type of post-edits is a measure of how well the system works, and can be used for evaluation. We describe how we have used post-edit data to evaluate SUMTIME-MOUSAM, an NLG system that produces weather forecasts.

引用

页码：1700 / 1701

页数：2

共 50 条

[31] Post-editing through approximation and global correction
Taghva, K
Borsack, J
Bullard, B
Condit, A
INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 1995, 9 (06) : 911 - 923
[32] An Exploration of Post-Editing Effectiveness in Text Summarization
Lai, Vivian
Smith-Renner, Alison
Zhang, Ke
Cheng, Ruijia
Zhang, Wenjuan
Tetreault, Joel
Jaimes, Alejandro
NAACL 2022: THE 2022 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES, 2022, : 502 - +
[33] Post-editing of machine translation: processes and applications
Garcia, Ignacio
TRANSLATOR, 2015, 21 (01): : 110 - 114
[34] Analysis of Edit Operations for Post-editing Systems
Jozef Kapusta
Ľubomír Benko
Dasa Munkova
Michal Munk
International Journal of Computational Intelligence Systems, 14
[35] Post-editing of Machine Translation: Processes and Applications
Folaron, Debbie
MACHINE TRANSLATION, 2015, 29 (01) : 69 - 76
[36] Post-editing for Professional Translators: Cheer or Fear?
Vidal, Sergi Alvarez
Oliver, Antoni
Badia, Toni
TRADUMATICA-TRADUCCIO I TECNOLOGIES DE LA INFORMACIO I LA COMUNICACIO, 2020, (18): : 49 - 69
[37] Post-editing through approximation and global correction
Univ. Nevada, information sci. res. inst., Las Vegas NV
Int J Pattern Recognit Artif Intell, 6 (911-923):
[38] POST-EDITING PRACTICE IN SPECIALIZED TRANSLATION TRAINING
Alvarez Garcia, Carmen
CARACTERES-ESTUDIOS CULTURALES Y CRITICOS DE LA ESFERA DIGITAL, 2019, 8 (02): : 67 - 91
[39] Can Automatic Post-Editing Improve NMT?
Chollampatt, Shamil
Susanto, Raymond Hendy
Tan, Liling
Szymanska, Ewa
PROCEEDINGS OF THE 2020 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP), 2020, : 2736 - 2746
[40] Does training in post-editing affect creativity?
Guerberof-Arenas, Ana
Valdez, Susana
Dorst, Aletta G.
JOURNAL OF SPECIALISED TRANSLATION, 2024, (41): : 74 - 97

← 1 2 3 4 5 →