Decoupled Two-Phase Framework for Class-Incremental Few-Shot Named Entity Recognition

被引:2
|
作者
Chen, Yifan [1 ]
Huang, Zhen [1 ]
Hu, Minghao [2 ]
Li, Dongsheng [1 ]
Wang, Changjian [1 ]
Liu, Feng [1 ]
Lu, Xicheng [1 ]
机构
[1] Natl Univ Def Technol, Coll Comp, Changsha 410073, Peoples R China
[2] PLA Acad Mil Sci, Informat Res Ctr Mil Sci, Beijing 100091, Peoples R China
来源
TSINGHUA SCIENCE AND TECHNOLOGY | 2023年 / 28卷 / 05期
基金
中国国家自然科学基金;
关键词
named entity recognition; deep learning; class-incremental learning; few-shot learning;
D O I
10.26599/TST.2022.9010043
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Class-Incremental Few-Shot Named Entity Recognition (CIFNER) aims to identify entity categories that have appeared with only a few newly added (novel) class examples. However, existing class-incremental methods typically introduce new parameters to adapt to new classes and treat all information equally, resulting in poor generalization. Meanwhile, few-shot methods necessitate samples for all observed classes, making them difficult to transfer into a class-incremental setting. Thus, a decoupled two-phase framework method for the CIFNER task is proposed to address the above issues. The whole task is converted to two separate tasks named Entity Span Detection (ESD) and Entity Class Discrimination (ECD) that leverage parameter-cloning and label-fusion to learn different levels of knowledge separately, such as class-generic knowledge and class-specific knowledge. Moreover, different variants, such as the Conditional Random Field-based (CRF-based), word-pair-based methods in ESD module, and add-based, Natural Language Inference-based (NLI-based) and prompt-based methods in ECD module, are investigated to demonstrate the generalizability of the decoupled framework. Extensive experiments on the three Named Entity Recognition (NER) datasets reveal that our method achieves the state-of-the-art performance in the CIFNER setting.
引用
收藏
页码:976 / 987
页数:12
相关论文
共 50 条
  • [31] Jointly Optimized Classifiers for Few-Shot Class-Incremental Learning
    Fu, Sichao
    Peng, Qinmu
    Wang, Xiaorui
    He, Yang
    Qiu, Wenhao
    Zou, Bin
    Xu, Duanquan
    Jing, Xiao-Yuan
    You, Xinge
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024, 8 (05): : 1 - 11
  • [32] Few-shot class-incremental learning based on representation enhancement
    Yao, Guangle
    Zhu, Juntao
    Zhou, Wenlong
    Li, Jun
    JOURNAL OF ELECTRONIC IMAGING, 2022, 31 (04)
  • [33] Few-Shot Class-Incremental SAR Target Recognition via Cosine Prototype Learning
    Zhao, Yan
    Zhao, Lingjun
    Ding, Ding
    Hu, Dewen
    Kuang, Gangyao
    Liu, Li
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [34] FEW-NERD: A Few-shot Named Entity Recognition Dataset
    Ding, Ning
    Xu, Guangwei
    Chen, Yulin
    Wang, Xiaobin
    Han, Xu
    Xie, Pengjun
    Zheng, Hai-Tao
    Liu, Zhiyuan
    59TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 11TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (ACL-IJCNLP 2021), VOL 1, 2021, : 3198 - 3213
  • [35] Flexible few-shot class-incremental learning with prototype container
    Xu, Xinlei
    Wang, Zhe
    Fu, Zhiling
    Guo, Wei
    Chi, Ziqiu
    Li, Dongdong
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (15): : 10875 - 10889
  • [36] Decision Boundary Optimization for Few-shot Class-Incremental Learning
    Guo, Chenxu
    Zhao, Qi
    Lyu, Shuchang
    Liu, Binghao
    Wang, Chunlei
    Chen, Lijiang
    Cheng, Guangliang
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS, ICCVW, 2023, : 3493 - 3503
  • [37] Few-Shot Class-Incremental SAR Target Recognition via Orthogonal Distributed Features
    Kong, Lingzhe
    Gao, Fei
    He, Xiaoyu
    Wang, Jun
    Sun, Jinping
    Zhou, Huiyu
    Hussain, Amir
    IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2025, 61 (01) : 325 - 341
  • [38] Memorizing Complementation Network for Few-Shot Class-Incremental Learning
    Ji, Zhong
    Hou, Zhishen
    Liu, Xiyao
    Pang, Yanwei
    Li, Xuelong
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 937 - 948
  • [39] HDCPAA: A few-shot class-incremental learning model for remote sensing image recognition
    Li, Peng
    Feng, Cunqian
    Hu, Xiaowei
    Feng, Weike
    NEUROCOMPUTING, 2025, 636
  • [40] Few-Shot Class-Incremental SAR Target Recognition Based on Hierarchical Embedding and Incremental Evolutionary Network
    Wang, Li
    Yang, Xinyao
    Tan, Haoyue
    Bai, Xueru
    Zhou, Feng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61