Knowledge-Aware Meta-learning for Low-Resource Text Classification

被引:0
|
作者
Yao, Huaxiu [1 ]
Wu, Yingxin [2 ]
Al-Shedivat, Maruan [4 ]
Xing, Eric P. [3 ,4 ]
机构
[1] Stanford Univ, Stanford, CA 94305 USA
[2] Univ Sci & Technol China, Hefei, Peoples R China
[3] Mohamed Bin Zayed Univ Artificial Intelligence, Abu Dhabi, U Arab Emirates
[4] Carnegie Mellon Univ, Pittsburgh, PA 15213 USA
基金
美国国家科学基金会;
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Meta-learning has achieved great success in leveraging the historical learned knowledge to facilitate the learning process of the new task. However, merely learning the knowledge from the historical tasks, adopted by current meta-learning algorithms, may not generalize well to testing tasks when they are not well-supported by training tasks. This paper studies a low-resource text classification problem and bridges the gap between meta-training and meta-testing tasks by leveraging the external knowledge bases. Specifically, we propose KGML to introduce additional representation for each sentence learned from the extracted sentence-specific knowledge graph. The extensive experiments on three datasets demonstrate the effectiveness of KGML under both supervised adaptation and unsupervised adaptation settings.
引用
收藏
页码:1814 / 1821
页数:8
相关论文
共 50 条
  • [21] Meta Learning for Low-Resource Molecular Optimization
    Wang, Jiahao
    Zheng, Shuangjia
    Chen, Jianwen
    Yang, Yuedong
    [J]. JOURNAL OF CHEMICAL INFORMATION AND MODELING, 2021, 61 (04) : 1627 - 1636
  • [22] Knowledge Transfer for Utterance Classification in Low-Resource Languages
    Smirnov, Andrei
    Mendelev, Valentin
    [J]. SPEECH AND COMPUTER, 2016, 9811 : 435 - 442
  • [23] Prompt-based for Low-Resource Tibetan Text Classification
    An, Bo
    [J]. ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING, 2023, 22 (08)
  • [24] Advancing Optical Character Recognition for Low-Resource Scripts: A Siamese Meta-Learning Approach with PSN Framework
    Ghosh, Anirudha
    Barman, Debaditya
    Sufian, Abu
    Hameed, Ibrahim A.
    [J]. IEEE Access, 2024, 12 : 189651 - 189666
  • [25] Transfer Learning for Low-Resource Multilingual Relation Classification
    Nag, Arijit
    Samanta, Bidisha
    Mukherjee, Animesh
    Ganguly, Niloy
    Chakrabarti, Soumen
    [J]. ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING, 2023, 22 (02)
  • [26] Finer-grained Modeling units-based Meta-Learning for Low-resource Tibetan Speech Recognition
    Qin, Siqing
    Wang, Longbiao
    Li, Sheng
    Lin, Yuqin
    Dang, Jianwu
    [J]. INTERSPEECH 2022, 2022, : 2133 - 2137
  • [27] Knowledge-aware representation learning for diagnosis prediction
    Li, Weihua
    Li, Hang
    Yang, Bei
    Zhou, Lihua
    Yang, Xianming
    Zhang, Miao
    Wang, Bingyi
    [J]. EXPERT SYSTEMS, 2023, 40 (03)
  • [28] Knowledge-aware Complementary Product Representation Learning
    Xu, Da
    Ruan, Chuanwei
    Cho, Jason
    Korpeoglu, Evren
    Kumar, Sushant
    Achan, Kannan
    [J]. PROCEEDINGS OF THE 13TH INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING (WSDM '20), 2020, : 681 - 689
  • [29] Improving Semi-Supervised Text Classification with Dual Meta-Learning
    Li, Shujie
    Yuan, Guanghu
    Yang, Min
    Shen, Ying
    Li, Chengming
    Xu, Ruifeng
    Zhao, Xiaoyan
    [J]. ACM TRANSACTIONS ON INFORMATION SYSTEMS, 2024, 42 (04)
  • [30] Prompt Tuning on Graph-Augmented Low-Resource Text Classification
    Wen, Zhihao
    Fang, Yuan
    [J]. IEEE Transactions on Knowledge and Data Engineering, 2024, 36 (12) : 9080 - 9095