Decoupled Two-Phase Framework for Class-Incremental Few-Shot Named Entity Recognition

被引:2
|
作者
Chen, Yifan [1 ]
Huang, Zhen [1 ]
Hu, Minghao [2 ]
Li, Dongsheng [1 ]
Wang, Changjian [1 ]
Liu, Feng [1 ]
Lu, Xicheng [1 ]
机构
[1] Natl Univ Def Technol, Coll Comp, Changsha 410073, Peoples R China
[2] PLA Acad Mil Sci, Informat Res Ctr Mil Sci, Beijing 100091, Peoples R China
来源
TSINGHUA SCIENCE AND TECHNOLOGY | 2023年 / 28卷 / 05期
基金
中国国家自然科学基金;
关键词
named entity recognition; deep learning; class-incremental learning; few-shot learning;
D O I
10.26599/TST.2022.9010043
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Class-Incremental Few-Shot Named Entity Recognition (CIFNER) aims to identify entity categories that have appeared with only a few newly added (novel) class examples. However, existing class-incremental methods typically introduce new parameters to adapt to new classes and treat all information equally, resulting in poor generalization. Meanwhile, few-shot methods necessitate samples for all observed classes, making them difficult to transfer into a class-incremental setting. Thus, a decoupled two-phase framework method for the CIFNER task is proposed to address the above issues. The whole task is converted to two separate tasks named Entity Span Detection (ESD) and Entity Class Discrimination (ECD) that leverage parameter-cloning and label-fusion to learn different levels of knowledge separately, such as class-generic knowledge and class-specific knowledge. Moreover, different variants, such as the Conditional Random Field-based (CRF-based), word-pair-based methods in ESD module, and add-based, Natural Language Inference-based (NLI-based) and prompt-based methods in ECD module, are investigated to demonstrate the generalizability of the decoupled framework. Extensive experiments on the three Named Entity Recognition (NER) datasets reveal that our method achieves the state-of-the-art performance in the CIFNER setting.
引用
收藏
页码:976 / 987
页数:12
相关论文
共 50 条
  • [1] Few-Shot Class-Incremental Learning for Named Entity Recognition
    Wang, Rui
    Yu, Tong
    Zhao, Handong
    Kim, Sungchul
    Mitra, Subrata
    Zhang, Ruiyi
    Henao, Ricardo
    PROCEEDINGS OF THE 60TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2022), VOL 1: (LONG PAPERS), 2022, : 571 - 582
  • [2] Similarity-Driven Adaptive Prototypical Network for Class-incremental Few-shot Named Entity Recognition
    Chen, Yifan
    Huang, Zhan
    Hu, Minghao
    Li, Dongsheng
    Wang, Changjian
    Wang, Ankun
    Wang, Boyang
    Lu, Xicheng
    2022 IEEE 34TH INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE, ICTAI, 2022, : 219 - 227
  • [3] A Forward and Backward Compatible Framework for Few-Shot Class-Incremental Pill Recognition
    Zhang, Jinghua
    Liu, Li
    Gao, Kai
    Hu, Dewen
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024,
  • [4] AutoDes: Few-Shot Named Entity Recognition with Class Descriptions
    Lu, Ting
    Hu, Yichun
    Liu, Guohua
    Huang, Qiubo
    Guo, Wenjing
    Chang, Shan
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [5] A survey on few-shot class-incremental learning
    Tian, Songsong
    Li, Lusi
    Li, Weijun
    Ran, Hang
    Ning, Xin
    Tiwari, Prayag
    NEURAL NETWORKS, 2024, 169 : 307 - 324
  • [6] Decoupled Self-Supervised Subspace Classifier for Few-Shot Class-Incremental SAR Target Recognition
    Zhao, Yan
    Zhao, Lingjun
    Zhang, Siqian
    Liu, Li
    Ji, Kefeng
    Kuang, Gangyao
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 15845 - 15861
  • [7] A survey on few-shot class-incremental learning
    Tian, Songsong
    Li, Lusi
    Li, Weijun
    Ran, Hang
    Ning, Xin
    Tiwari, Prayag
    Neural Networks, 2024, 169 : 307 - 324
  • [8] Graph Few-shot Class-incremental Learning
    Tan, Zhen
    Ding, Kaize
    Guo, Ruocheng
    Liu, Huan
    WSDM'22: PROCEEDINGS OF THE FIFTEENTH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING, 2022, : 987 - 996
  • [9] Constrained Few-shot Class-incremental Learning
    Hersche, Michael
    Karunaratne, Geethan
    Cherubini, Giovanni
    Benini, Luca
    Sebastian, Abu
    Rahimi, Abbas
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 9047 - 9057
  • [10] Attending to Entity Class Attributes for Named Entity Recognition with Few-Shot Learning
    Patel, Raj Nath
    Dutta, Sourav
    Assem, Haytham
    INTELLIGENT SYSTEMS AND APPLICATIONS, VOL 3, INTELLISYS 2023, 2024, 824 : 859 - 870