Knowledge-Aware Meta-learning for Low-Resource Text Classification

被引:0
|
作者
Yao, Huaxiu [1 ]
Wu, Yingxin [2 ]
Al-Shedivat, Maruan [4 ]
Xing, Eric P. [3 ,4 ]
机构
[1] Stanford Univ, Stanford, CA 94305 USA
[2] Univ Sci & Technol China, Hefei, Peoples R China
[3] Mohamed Bin Zayed Univ Artificial Intelligence, Abu Dhabi, U Arab Emirates
[4] Carnegie Mellon Univ, Pittsburgh, PA 15213 USA
基金
美国国家科学基金会;
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Meta-learning has achieved great success in leveraging the historical learned knowledge to facilitate the learning process of the new task. However, merely learning the knowledge from the historical tasks, adopted by current meta-learning algorithms, may not generalize well to testing tasks when they are not well-supported by training tasks. This paper studies a low-resource text classification problem and bridges the gap between meta-training and meta-testing tasks by leveraging the external knowledge bases. Specifically, we propose KGML to introduce additional representation for each sentence learned from the extracted sentence-specific knowledge graph. The extensive experiments on three datasets demonstrate the effectiveness of KGML under both supervised adaptation and unsupervised adaptation settings.
引用
收藏
页码:1814 / 1821
页数:8
相关论文
共 50 条
  • [31] Out-of-Domain Detection for Low-Resource Text Classification Tasks
    Tan, Ming
    Yu, Yang
    Wang, Haoyu
    Wang, Dakuo
    Potdar, Saloni
    Chang, Shiyu
    Yu, Mo
    [J]. 2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019): PROCEEDINGS OF THE CONFERENCE, 2019, : 3566 - 3572
  • [32] HierClasSArt: Knowledge-Aware Hierarchical Classification of Scholarly Articles
    Alam, Mehwish
    Biswas, Russa
    Chen, Yiyi
    Dessi, Danilo
    Gesese, Genet Asefa
    Hoppe, Fabian
    Sack, Harald
    [J]. WEB CONFERENCE 2021: COMPANION OF THE WORLD WIDE WEB CONFERENCE (WWW 2021), 2021, : 436 - 440
  • [33] When Low Resource NLP Meets Unsupervised Language Model: Meta-Pretraining then Meta-Learning for Few-Shot Text Classification (Student Abstract)
    Deng, Shumin
    Zhang, Ningyu
    Sun, Zhanlin
    Chen, Jiaoyan
    Chen, Huajun
    [J]. THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 13773 - 13774
  • [34] Knowledge-Aware Group Representation Learning for Group Recommendation
    Deng, Zhiyi
    Li, Changyu
    Liu, Shujin
    Ali, Waqar
    Shao, Jie
    [J]. 2021 IEEE 37TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2021), 2021, : 1571 - 1582
  • [35] External Knowledge Enhancing Meta-learning Framework for Few-Shot Text Classification via Contrastive Learning and Adversarial Network
    Sun, Xin
    Yang, Yan
    Liu, Yong
    [J]. WEB AND BIG DATA, APWEB-WAIM 2024, PT I, 2024, 14961 : 46 - 58
  • [36] Meta adversarial learning improves low-resource speech recognition
    Chen, Yaqi
    Yang, Xukui
    Zhang, Hao
    Zhang, Wenlin
    Qu, Dan
    Chen, Cong
    [J]. COMPUTER SPEECH AND LANGUAGE, 2024, 84
  • [37] Meta Auxiliary Learning for Low-resource Spoken Language Understanding
    Gao, Yingying
    Feng, Junlan
    Deng, Chao
    Zhang, Shilei
    [J]. INTERSPEECH 2022, 2022, : 2703 - 2707
  • [38] Meta-Transfer Learning for Low-Resource Abstractive Summarization
    Chen, Yi-Syuan
    Shuai, Hong-Han
    [J]. THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 12692 - 12700
  • [39] Hypernymy Detection for Low-Resource Languages via Meta Learning
    Yu, Changlong
    Hang, Jialong
    Zhang, Haisong
    Ng, Wilfred
    [J]. 58TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2020), 2020, : 3651 - 3656
  • [40] Sequential-Knowledge-Aware Next POI Recommendation: A Meta-Learning Approach
    Cui, Yue
    Sun, Hao
    Zhao, Yan
    Yin, Hongzhi
    Zheng, Kai
    [J]. ACM TRANSACTIONS ON INFORMATION SYSTEMS, 2022, 40 (02)