MsPrompt: Multi-step prompt learning for debiasing few-shot event detection

被引:6
|
作者
Wang, Siyuan [1 ]
Zheng, Jianming [1 ]
Cai, Fei [1 ]
Song, Chengyu [1 ]
Luo, Xueshan [1 ]
机构
[1] Natl Univ Def Technol, Sci & Technol Informat Syst Engn Lab, Changsha, Hunan, Peoples R China
基金
中国国家自然科学基金;
关键词
Few-shot event detection; Prompt learning; Debiasing;
D O I
10.1016/j.ipm.2023.103509
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Event detection (ED) is aimed to identify the key trigger words in unstructured text and predict the event types accordingly. Traditional ED models are too data-hungry to accommodate real applications with scarce labeled data. Besides, typical ED models are facing the context -bypassing and disabled generalization issues caused by the trigger bias stemming from ED datasets. Therefore, we focus on the true few-shot paradigm targeting to construct a novel training set that accommodates the low-resource scenarios. In particular, we propose a multi-step prompt learning model (MsPrompt) for debiasing few-shot event detection (FSED), consisting of the following two components: a multi-step prompt module equipped with a knowledge-enhanced ontology to leverage the event semantics and latent prior knowledge in the pretrained language models (PLMs) sufficiently for tackling the context-bypassing problem, and a prototypical network module compensating for the weakness of classifying events with sparse data and boost the generalization performance. Experiments on two public datasets ACE-2005 and FewEvent show that MsPrompt can outperform the state-of-the-art models, especially in the strict low-resource scenarios reporting 11.43% improvement in terms of weighted F1-score against the best baseline and achieving an outstanding debiasing performance.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Hierarchical Mutual Prompt for Chinese Few-Shot Event Detection
    Hou, Shuxiang
    Qian, Yurong
    Chen, Jiaying
    Zhao, Jigui
    Lv, Huiyong
    Lu, Yi
    Leng, Hongyong
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT IV, ICIC 2024, 2024, 14878 : 389 - 397
  • [2] MultiPLe: Multilingual Prompt Learning for Relieving Semantic Confusions in Few-shot Event Detection
    Wang, Siyuan
    Zheng, Jianming
    Chen, Wanyu
    Cai, Fei
    Luo, Xueshan
    PROCEEDINGS OF THE 32ND ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2023, 2023, : 2676 - 2685
  • [3] Zero- and Few-Shot Event Detection via Prompt-Based Meta Learning
    Yue, Zhenrui
    Zeng, Huimin
    Lan, Mengfei
    Ji, Heng
    Wang, Dong
    PROCEEDINGS OF THE 61ST ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL 2023, VOL 1, 2023, : 7928 - 7943
  • [4] Active Few-Shot Learning for Sound Event Detection
    Wang, Yu
    Cartwright, Mark
    Bello, Juan Pablo
    INTERSPEECH 2022, 2022, : 1551 - 1555
  • [5] Extensively Matching for Few-shot Learning Event Detection
    Viet Dac Lai
    Dernoncourt, Franck
    Thien Huu Nguyen
    NARRATIVE UNDERSTANDING, STORYLINES, AND EVENTS, 2020, : 38 - 45
  • [6] Multi-step Prompting for Few-shot Emotion-Grounded Conversations
    Firdaus, Mauajama
    Singh, Gopendra Vikram
    Ekbal, Asif
    Bhattacharyya, Pushpak
    PROCEEDINGS OF THE 32ND ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2023, 2023, : 3886 - 3891
  • [7] Hierarchical Prompt Tuning for Few-Shot Multi-Task Learning
    Liu, Jingping
    Chen, Tao
    Liang, Zujie
    Jiang, Haiyun
    Xiao, Yanghua
    Wei, Feng
    Qian, Yuxi
    Hao, Zhenghong
    Han, Bing
    PROCEEDINGS OF THE 32ND ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2023, 2023, : 1556 - 1565
  • [8] FEW-SHOT SOUND EVENT DETECTION
    Wang, Yu
    Salamon, Justin
    Bryan, Nicholas J.
    Bello, Juan Pablo
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 81 - 85
  • [9] Few-shot Incremental Event Detection
    Wang, Hao
    Shi, Hanwen
    Duan, Jianyong
    ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING, 2024, 23 (02)
  • [10] Graph Learning Regularization and Transfer Learning for Few-Shot Event Detection
    Viet Dac Lai
    Minh Van Nguyen
    Thien Huu Nguyen
    Dernoncourt, Franck
    SIGIR '21 - PROCEEDINGS OF THE 44TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2021, : 2172 - 2176