Evaluating an NLG System using Post-Editing

被引:0
|
作者
Sripada, Somayajulu G. [1 ]
Reiter, Ehud [1 ]
Hawizy, Lezan [1 ]
机构
[1] Univ Aberdeen, Dept Comp Sci, Aberdeen AB24 3UE, Scotland
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Computer-generated texts, whether from Natural Language Generation (NLG) or Machine Translation (MT) systems, are often post-edited by humans before being released to users. The frequency and type of post-edits is a measure of how well the system works, and can be used for evaluation. We describe how we have used post-edit data to evaluate SUMTIME-MOUSAM, an NLG system that produces weather forecasts.
引用
收藏
页码:1700 / 1701
页数:2
相关论文
共 50 条
  • [1] Evaluating the Effects of Interactivity in a Post-Editing Workbench
    Underwood, Nancy
    Mesa-Lao, Bartolome
    Martinez, Mercedes Garcia
    Carl, Michael
    Alabau, Vicent
    Gonzalez-Rubio, Jesus
    Leiva, Luis A.
    Sanchis-Trilles, German
    Ortiz-Martinez, Daniel
    Casacuberta, Francisco
    LREC 2014 - NINTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, 2014, : 553 - 559
  • [2] Evaluating the Impact of Light Post-Editing on Usability
    Castilho, Sheila
    O'Brien, Sharon
    LREC 2016 - TENTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, 2016, : 310 - 316
  • [3] Performance Improvement of Machine Translation System using LID and Post-editing
    Mrinalini, K.
    Sangavi, G.
    Vijayalakshmi, P.
    PROCEEDINGS OF THE 2016 IEEE REGION 10 CONFERENCE (TENCON), 2016, : 2134 - 2137
  • [4] USING POST-EDITING IN TRANSLATION AND LSP COURSES
    Udina, Natalia
    PROCEEDINGS OF INTCESS 2019- 6TH INTERNATIONAL CONFERENCE ON EDUCATION AND SOCIAL SCIENCES, 2019, : 1097 - 1101
  • [5] POST-EDITING FOR THE KAZAKH LANGUAGE USING OPENNMT
    Rakhimova, D. R.
    Zhunussova, A. Z.
    JOURNAL OF MATHEMATICS MECHANICS AND COMPUTER SCIENCE, 2022, 113 (01): : 118 - 123
  • [6] Is machine translation post-editing worth the effort? A survey of research into post-editing and effort
    Koponen, Maarit
    JOURNAL OF SPECIALISED TRANSLATION, 2016, (25): : 131 - 148
  • [7] System for speech transcription and post-editing in Microsoft Word
    Salimbajevs, Askars
    Ikauniece, Indra
    18TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2017), VOLS 1-6: SITUATED INTERACTION, 2017, : 825 - 826
  • [8] A short guide to post-editing
    Hoyte-West, Antony
    CADERNOS DE TRADUCAO, 2023, 43 (01):
  • [9] Catalogue of post-editing tools
    Florez, Silvia
    TRADUMATICA-TRADUCCIO I TECNOLOGIES DE LA INFORMACIO I LA COMUNICACIO, 2012, (10): : 219 - 229
  • [10] Word Embeddings at Post-Editing
    Inacio, Marcio Lima
    Caseli, Helena de Medeiros
    COMPUTATIONAL PROCESSING OF THE PORTUGUESE LANGUAGE, PROPOR 2020, 2020, 12037 : 323 - 334