Feature Enhanced Zero-Shot Stance Detection via Contrastive Learning

被引:0
|
作者
Zhao, Xuechen [1 ]
Zou, Jiaying [1 ]
Zhang, Zhong [1 ]
Xie, Feng [1 ]
Zhou, Bin [1 ,2 ]
Tian, Lei [1 ]
机构
[1] Natl Univ Def Technol, Sch Comp, Changsha, Peoples R China
[2] Key Lab Software Engn Complex Syst, Changsha, Peoples R China
基金
中国国家自然科学基金;
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Zero-shot stance detection is challenging because it requires detecting the stance of previously unseen targets in the inference phase. The ability to learn transferable target-invariant features is critical for zero-shot stance detection. In this paper, we propose a stance detection approach that can efficiently adapt to unseen targets, the core of which is to capture target-invariant syntactic expression patterns as transferable knowledge. Specifically, we first augment the data by masking the topic words of sentences, and then feed the augmented data to an unsupervised contrastive learning module to capture transferable features. Besides, to fit a specific target, we encode the raw text as target-specific features. Finally, we adopt an attention mechanism, which combines syntactic expression patterns with target-specific features to obtain enhanced features for predicting previously unseen targets. Experiments demonstrate that our model outperforms competitive baselines on four benchmark datasets.
引用
收藏
页码:900 / 908
页数:9
相关论文
共 50 条
  • [21] A benchmark for Portuguese zero-shot stance detection
    Pavan, Matheus Camasmie
    Paraboni, Ivandré
    Journal of the Brazilian Computer Society, 2024, 30 (01) : 469 - 479
  • [22] Zero-shot stance detection: Paradigms and challenges
    Allaway, Emily
    McKeown, Kathleen
    FRONTIERS IN ARTIFICIAL INTELLIGENCE, 2023, 5
  • [23] Enhancing Zero-Shot Stance Detection via Targeted Background Knowledge
    Zhu, Qinglin
    Liang, Bin
    Sun, Jingyi
    Du, Jiachen
    Zhou, Lanjun
    Xu, Ruifeng
    PROCEEDINGS OF THE 45TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '22), 2022, : 2070 - 2075
  • [24] Contrastive Embedding for Generalized Zero-Shot Learning
    Han, Zongyan
    Fu, Zhenyong
    Chen, Shuo
    Yang, Jian
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 2371 - 2381
  • [25] Boosting Zero-Shot Learning via Contrastive Optimization of Attribute Representations
    Du, Yu
    Shi, Miaojing
    Wei, Fangyun
    Li, Guoqi
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 35 (11) : 1 - 14
  • [26] Boosting Zero-Shot Learning via Contrastive Optimization of Attribute Representations
    Du, Yu
    Shi, Miaojing
    Wei, Fangyun
    Li, Guoqi
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (11) : 16706 - 16719
  • [27] Feature Activation-Driven Zero-Shot NAS: A Contrastive Learning Framework
    Wang, Di
    Xiang, Xunzhi
    Jing, Kun
    Xu, Jungang
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING-ICANN 2024, PT I, 2024, 15016 : 261 - 276
  • [28] Co-GZSL: Feature Contrastive Optimization for Generalized Zero-Shot Learning
    Li, Qun
    Zhan, Zhuxi
    Shen, Yaying
    Bhanu, Bir
    NEURAL PROCESSING LETTERS, 2024, 56 (02)
  • [29] Contrastive embedding-based feature generation for generalized zero-shot learning
    Han Wang
    Tingting Zhang
    Xiaoxuan Zhang
    International Journal of Machine Learning and Cybernetics, 2023, 14 : 1669 - 1681
  • [30] Contrastive embedding-based feature generation for generalized zero-shot learning
    Wang, Han
    Zhang, Tingting
    Zhang, Xiaoxuan
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2023, 14 (05) : 1669 - 1681