Knowledge-Aware Meta-learning for Low-Resource Text Classification

被引:0
|
作者
Yao, Huaxiu [1 ]
Wu, Yingxin [2 ]
Al-Shedivat, Maruan [4 ]
Xing, Eric P. [3 ,4 ]
机构
[1] Stanford Univ, Stanford, CA 94305 USA
[2] Univ Sci & Technol China, Hefei, Peoples R China
[3] Mohamed Bin Zayed Univ Artificial Intelligence, Abu Dhabi, U Arab Emirates
[4] Carnegie Mellon Univ, Pittsburgh, PA 15213 USA
基金
美国国家科学基金会;
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Meta-learning has achieved great success in leveraging the historical learned knowledge to facilitate the learning process of the new task. However, merely learning the knowledge from the historical tasks, adopted by current meta-learning algorithms, may not generalize well to testing tasks when they are not well-supported by training tasks. This paper studies a low-resource text classification problem and bridges the gap between meta-training and meta-testing tasks by leveraging the external knowledge bases. Specifically, we propose KGML to introduce additional representation for each sentence learned from the extracted sentence-specific knowledge graph. The extensive experiments on three datasets demonstrate the effectiveness of KGML under both supervised adaptation and unsupervised adaptation settings.
引用
收藏
页码:1814 / 1821
页数:8
相关论文
共 50 条
  • [1] Low-resource extraction with knowledge-aware pairwise prototype learning
    Deng, Shumin
    Zhang, Ningyu
    Chen, Hui
    Tan, Chuanqi
    Huang, Fei
    Xu, Changliang
    Chen, Huajun
    [J]. KNOWLEDGE-BASED SYSTEMS, 2022, 235
  • [2] Improving Meta-learning for Low-resource Text Classification and Generation via Memory Imitation
    Zhao, Yingxiu
    Tian, Zhiliang
    Yao, Huaxiu
    Zheng, Yinhe
    Lee, Dongkyu
    Song, Yiping
    Sun, Jian
    Zhang, Nevin L.
    [J]. PROCEEDINGS OF THE 60TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2022), VOL 1: (LONG PAPERS), 2022, : 583 - 595
  • [3] META-LEARNING FOR LOW-RESOURCE SPEECH EMOTION RECOGNITION
    Chopra, Suransh
    Mathur, Puneet
    Sawhney, Ramit
    Shah, Rajiv Ratn
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 6259 - 6263
  • [4] Lightweight Meta-Learning for Low-Resource Abstractive Summarization
    Huh, Taehun
    Ko, Youngjoong
    [J]. PROCEEDINGS OF THE 45TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '22), 2022, : 2629 - 2633
  • [5] Meta-Learning for Low-Resource Neural Machine Translation
    Gu, Jiatao
    Wang, Yong
    Chen, Yun
    Cho, Kyunghyun
    Li, Victor O. K.
    [J]. 2018 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2018), 2018, : 3622 - 3631
  • [6] Language-Agnostic Meta-Learning for Low-Resource Text-to-Speech with Articulatory Features
    Lux, Florian
    Vu, Ngoc Thang
    [J]. PROCEEDINGS OF THE 60TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2022), VOL 1: (LONG PAPERS), 2022, : 6858 - 6868
  • [7] Robust Speech Recognition using Meta-learning for Low-resource Accents
    Eledath, Dhanya
    Baby, Arun
    Singh, Shatrughan
    [J]. 2024 NATIONAL CONFERENCE ON COMMUNICATIONS, NCC, 2024,
  • [8] Meta-learning of Text Classification Tasks
    Madrid, Jorge G.
    Jair Escalante, Hugo
    [J]. PROGRESS IN PATTERN RECOGNITION, IMAGE ANALYSIS, COMPUTER VISION, AND APPLICATIONS (CIARP 2019), 2019, 11896 : 107 - 119
  • [9] Graph-Evolving Meta-Learning for Low-Resource Medical Dialogue Generation
    Lin, Shuai
    Zhou, Pan
    Liang, Xiaodan
    Tang, Jianheng
    Zhao, Ruihui
    Chen, Ziliang
    Lin, Liang
    [J]. THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 13362 - 13370
  • [10] Towards Low-Resource Semi-Supervised Dialogue Generation with Meta-Learning
    Huang, Yi
    Feng, Junlan
    Ma, Shuo
    Du, Xiaoyu
    Wu, Xiaoting
    [J]. FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EMNLP 2020, 2020, : 4123 - 4128