Building a Task-oriented Dialog System for languages with no training data: the Case for Basque

被引:0
|
作者
Lopez de Lacalle, Maddalen [1 ]
Saralegi, Xabier [1 ]
San Vicente, Inaki [1 ]
机构
[1] Elhuyar Fdn, Osinalde Ind Dea 3, Usurbil 20170, Spain
关键词
Dialog Systems; Neural language representation models; Less-resourced languages;
D O I
暂无
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
This paper presents an approach for developing a task-oriented dialog system for less-resourced languages in scenarios where no training data is available. Both intent classification and slot filling are tackled. We project the existing annotations in rich-resource languages by means of Neural Machine Translation (NMT) and posterior word alignments. We then compare training on the projected monolingual data with direct model transfer alternatives. Intent Classifiers and slot filling sequence taggers are implemented using a BiLSTM architecture or by fine-tuning BERT transformer models. Models learnt exclusively from Basque projected data provide better accuracies for slot filling. Combining Basque projected train data with rich-resource languages data outperforms consistently models trained solely on projected data for intent classification. At any rate, we achieve competitive performance in both tasks, with accuracies of 81% for intent classification and 77% for slot filling.
引用
收藏
页码:2796 / 2802
页数:7
相关论文
共 50 条
  • [1] Incremental Dialog Processing in a Task-Oriented Dialog
    Ghigi, Fabrizio
    Eskenazi, Maxine
    Ines Torres, M.
    Lee, Sungjin
    [J]. 15TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2014), VOLS 1-4, 2014, : 308 - 312
  • [2] Unified Dialog Model Pre-training for Task-Oriented Dialog Understanding and Generation
    He, Wanwei
    Dai, Yinpei
    Yang, Min
    Sun, Jian
    Huang, Fei
    Si, Luo
    Li, Yongbin
    [J]. PROCEEDINGS OF THE 45TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '22), 2022, : 187 - 200
  • [3] Conversation Learner - A Machine Teaching Tool for Building Dialog Managers for Task-Oriented Dialog Systems
    Shukla, Swadheen
    Liden, Lars
    Shayandeh, Shahin
    Kamal, Eslam
    Li, Jinchao
    Mazzola, Matt
    Park, Thomas
    Peng, Baolin
    Gao, Jianfeng
    [J]. 58TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2020): SYSTEM DEMONSTRATIONS, 2020, : 343 - 349
  • [4] Dialog-to-Actions: Building Task-Oriented Dialogue System via Action-Level Generation
    Hua, Yuncheng
    Xi, Xiangyu
    Jiang, Zheng
    Zhang, Guanwei
    Sun, Chaobo
    Wan, Guanglu
    Ye, Wei
    [J]. PROCEEDINGS OF THE 46TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, SIGIR 2023, 2023, : 3255 - 3259
  • [5] Paraphrase Augmented Task-Oriented Dialog Generation
    Gao, Silin
    Zhang, Yichi
    Ou, Zhijian
    Yu, Zhou
    [J]. 58TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2020), 2020, : 639 - 649
  • [6] TamilATIS: Dataset for Task-Oriented Dialog in Tamil
    Ramaneswaran, S.
    Vijay, Sanchit
    Srinivasan, Kathiravan
    [J]. PROCEEDINGS OF THE SECOND WORKSHOP ON SPEECH AND LANGUAGE TECHNOLOGIES FOR DRAVIDIAN LANGUAGES (DRAVIDIANLANGTECH 2022), 2022, : 25 - 32
  • [7] PRAL: A Tailored Pre-Training Model for Task-Oriented Dialog Generation
    Gu, Jing
    Wu, Qingyang
    Wu, Chongruo
    Shi, Weiyan
    Yu, Zhou
    [J]. ACL-IJCNLP 2021: THE 59TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 11TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING, VOL 2, 2021, : 305 - 313
  • [8] Combining Open Domain Question Answering with a Task-Oriented Dialog System
    Nehring, Jan
    Feldhus, Nils
    Ahmed, Akhyar
    Kaur, Harleen
    [J]. 1ST WORKSHOP ON DOCUMENT-GROUNDED DIALOGUE AND CONVERSATIONAL QUESTION ANSWERING (DIALDOC 2021), 2021, : 38 - 45
  • [9] Scheduled Dialog Policy Learning: An Automatic Curriculum Learning Framework for Task-oriented Dialog System
    Liu, Sihong
    Zhang, Jinchao
    He, Keqing
    Xu, Weiran
    Zhou, Jie
    [J]. FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL-IJCNLP 2021, 2021, : 1091 - 1102
  • [10] Building Task-Oriented Visual Dialog Systems Through Alternative Optimization Between Dialog Policy and Language Generation
    Zhou, Mingyang
    Arnold, Josh
    Yu, Zhou
    [J]. 2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019): PROCEEDINGS OF THE CONFERENCE, 2019, : 143 - 153