Decoupled Two-Phase Framework for Class-Incremental Few-Shot Named Entity Recognition

被引:2
|
作者
Chen, Yifan [1 ]
Huang, Zhen [1 ]
Hu, Minghao [2 ]
Li, Dongsheng [1 ]
Wang, Changjian [1 ]
Liu, Feng [1 ]
Lu, Xicheng [1 ]
机构
[1] Natl Univ Def Technol, Coll Comp, Changsha 410073, Peoples R China
[2] PLA Acad Mil Sci, Informat Res Ctr Mil Sci, Beijing 100091, Peoples R China
来源
TSINGHUA SCIENCE AND TECHNOLOGY | 2023年 / 28卷 / 05期
基金
中国国家自然科学基金;
关键词
named entity recognition; deep learning; class-incremental learning; few-shot learning;
D O I
10.26599/TST.2022.9010043
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Class-Incremental Few-Shot Named Entity Recognition (CIFNER) aims to identify entity categories that have appeared with only a few newly added (novel) class examples. However, existing class-incremental methods typically introduce new parameters to adapt to new classes and treat all information equally, resulting in poor generalization. Meanwhile, few-shot methods necessitate samples for all observed classes, making them difficult to transfer into a class-incremental setting. Thus, a decoupled two-phase framework method for the CIFNER task is proposed to address the above issues. The whole task is converted to two separate tasks named Entity Span Detection (ESD) and Entity Class Discrimination (ECD) that leverage parameter-cloning and label-fusion to learn different levels of knowledge separately, such as class-generic knowledge and class-specific knowledge. Moreover, different variants, such as the Conditional Random Field-based (CRF-based), word-pair-based methods in ESD module, and add-based, Natural Language Inference-based (NLI-based) and prompt-based methods in ECD module, are investigated to demonstrate the generalizability of the decoupled framework. Extensive experiments on the three Named Entity Recognition (NER) datasets reveal that our method achieves the state-of-the-art performance in the CIFNER setting.
引用
收藏
页码:976 / 987
页数:12
相关论文
共 50 条
  • [41] Improving Few-Shot Named Entity Recognition with Causal Interventions
    Yang, Zhen
    Liu, Yongbin
    Ouyang, Chunping
    Zhao, Shu
    Zhu, Chi
    BIG DATA MINING AND ANALYTICS, 2024, 7 (04): : 1421 - 1421
  • [42] Few-Shot Named Entity Recognition with the Integration of Spatial Features
    LIU Zhiwei
    HUANG Bo
    XIA Chunming
    XIONG Yujie
    ZANG Zhensen
    ZHANG Yongqiang
    Wuhan University Journal of Natural Sciences, 2024, 29 (02) : 125 - 133
  • [43] LeArNER: Few-shot Legal Argument Named Entity Recognition
    Lee, Shao-Man
    Tan, Yu-Hsiang
    Yu, Han-Ting
    PROCEEDINGS OF THE 19TH INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND LAW, ICAIL 2023, 2023, : 422 - 426
  • [44] Meta-Learning for Few-Shot Named Entity Recognition
    de Lichy, Cyprien
    Glaude, Hadrien
    Campbell, William
    1ST WORKSHOP ON META LEARNING AND ITS APPLICATIONS TO NATURAL LANGUAGE PROCESSING (METANLP 2021), 2021, : 44 - 58
  • [45] Few-Shot Named Entity Recognition: An Empirical Baseline Study
    Huang, Jiaxin
    Lie, Chunyuan
    Subudhi, Krishan
    Jose, Damien
    Balakrishnan, Shobana
    Chen, Weizhu
    Peng, Baolin
    Gao, Jianfeng
    Han, Jiawei
    2021 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2021), 2021, : 10408 - 10423
  • [46] Prompt-Based Data Augmentation Framework for Few-Shot Named Entity Recognition
    Wang, Moyao
    Gao, Hui
    Zhang, Peng
    Zhang, Jing
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT III, ICIC 2024, 2024, 14877 : 451 - 462
  • [47] Few-Shot Class-Incremental Learning with Meta-Learned Class Structures
    Zheng, Guangtao
    Zhang, Aidong
    21ST IEEE INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOPS ICDMW 2021, 2021, : 421 - 430
  • [48] Rethinking Self-Supervision for Few-Shot Class-Incremental Learning
    Zhao, Linglan
    Lu, Jing
    Cheng, Zhanzhan
    Liu, Duo
    Fang, Xiangzhong
    2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 726 - 731
  • [49] Knowledge Representation by Generic Models for Few-Shot Class-Incremental Learning
    Chen, Xiaodong
    Jiang, Weijie
    Huang, Zhiyong
    Su, Jiangwen
    Yu, Yuanlong
    ADVANCES IN NATURAL COMPUTATION, FUZZY SYSTEMS AND KNOWLEDGE DISCOVERY, ICNC-FSKD 2022, 2023, 153 : 1237 - 1247
  • [50] A Few-Shot Class-Incremental Learning Method for Network Intrusion Detection
    Du, Lei
    Gu, Zhaoquan
    Wang, Ye
    Wang, Le
    Jia, Yan
    IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2024, 21 (02): : 2389 - 2401