Adversarial contrastive representation training with external knowledge injection for zero-shot stance detection

被引:0
|
作者
Ding, Yifan [1 ]
Lei, Ying [1 ]
Wang, Anqi [1 ]
Liu, Xiangrun [1 ]
Zhu, Tuanfei [2 ]
Li, Yizhou [1 ]
机构
[1] Sichuan Univ, Coll Cyber Sci & Engn, Chengdu, Peoples R China
[2] Changsha Univ, Sch Comp Sci & Engn, Changsha, Peoples R China
关键词
Natural language process; Stance detection; Contrastive learning; Zero-shot; Adversarial learning; Large language model;
D O I
10.1016/j.neucom.2024.128849
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Zero-shot stance detection (ZSSD) is a task that involves identifying the author's perspective on specific issues in text, particularly when the target topic has not been encountered during the model training process, to address rapidly evolving topics on social media. This paper introduces a ZSSD framework named KEL-CA. To enable the model to more effectively utilize transferable stance features for representing unseen targets, the framework incorporates a multi-layer contrastive learning and adversarial domain transfer module. Unlike traditional contrastive or adversarial learning, our framework captures both correlations and distinctions between invariant and specific features, as well as between different stance labels, and enhances the generalization ability and robustness of the features. Subsequently, to address the problem of insufficient information about the target context, we designed a dual external knowledge injection module that uses a large language model (LLM) to extract external knowledge from a Wikipedia-based local knowledge base and a Chain-of-Thought (COT) process to ensure the timeliness and relevance of the knowledge to infer the stances of unseen targets. Experimental results demonstrate that our approach outperforms existing models on two benchmark datasets, thereby validating its efficacy in ZSSD tasks.
引用
收藏
页数:12
相关论文
共 50 条
  • [41] Task-Specific Data Augmentation for Zero-shot and Few-shot Stance Detection
    Zhang, Jiarui
    Wu, Shaojuan
    Zhang, Xiaowang
    Feng, Zhiyong
    COMPANION OF THE WORLD WIDE WEB CONFERENCE, WWW 2023, 2023, : 160 - 163
  • [42] Contrastive Training Improves Zero-Shot Classification of Semi-structured Documents
    Khalifa, Muhammad
    Vyas, Yogarshi
    Wang, Shuai
    Horwood, Graham
    Mallya, Sunil
    Ballesteros, Miguel
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2023), 2023, : 7499 - 7508
  • [43] Zero-Shot Stance Detection: A Dataset and Model using Generalized Topic Representations
    Allaway, Emily
    McKeown, Kathleen
    PROCEEDINGS OF THE 2020 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP), 2020, : 8913 - 8931
  • [44] Enhancing zero-shot object detection with external knowledge-guided robust contrast learning
    Duan, Lijuan
    Liu, Guangyuan
    En, Qing
    Liu, Zhaoying
    Gong, Zhi
    Ma, Bian
    PATTERN RECOGNITION LETTERS, 2024, 185 : 152 - 159
  • [45] Zero-Shot Learning for Intrusion Detection via Attribute Representation
    Li, Zhipeng
    Qin, Zheng
    Shen, Pengbo
    Jiang, Liu
    NEURAL INFORMATION PROCESSING (ICONIP 2019), PT I, 2019, 11953 : 352 - 364
  • [46] Zero-Shot Program Representation Learning
    Cui, Nan
    Jiang, Yuze
    Gu, Xiaodong
    Shen, Beijun
    30TH IEEE/ACM INTERNATIONAL CONFERENCE ON PROGRAM COMPREHENSION (ICPC 2022), 2022, : 60 - 70
  • [47] Adversarial strategy for transductive zero-shot learning
    Liu, Youfa
    Du, Bo
    Ni, Fuchuan
    INFORMATION SCIENCES, 2021, 578 : 750 - 761
  • [48] Adversarial Zero-Shot Learning with Semantic Augmentation
    Tong, Bin
    Klinkigt, Martin
    Chen, Junwen
    Cui, Xiankun
    Kong, Quan
    Murakami, Tomokazu
    Kobayashi, Yoshiyuki
    THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 2476 - 2483
  • [49] Zero-Shot Program Representation Learning
    Cui, Nan
    Jiang, Yuze
    Gu, Xiaodong
    Shen, Beijun
    arXiv, 2022,
  • [50] Zero-Shot Learning by Harnessing Adversarial Samples
    Chen, Zhi
    Zhang, Pengfei
    Li, Jingjing
    Wang, Sen
    Huang, Zi
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 4138 - 4146