Zero-shot stance detection via multi-perspective contrastive with unlabeled data

被引:7
|
作者
Jiang, Yan [1 ,2 ]
Gao, Jinhua [1 ]
Shen, Huawei [1 ,2 ]
Cheng, Xueqi [2 ,3 ]
机构
[1] Chinese Acad Sci, Inst Comp Technol, Data Intelligence Syst Res Ctr, Beijing, Peoples R China
[2] Univ Chinese Acad Sci, Beijing, Peoples R China
[3] Chinese Acad Sci, Inst Comp Technol, Key Lab Network Data Sci & Technol, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Stance detection; Contrastive learning; Unlabeled data; Zero-shot;
D O I
10.1016/j.ipm.2023.103361
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Stance detection is to distinguish whether the text's author supports, opposes, or maintains a neutral stance towards a given target. In most real-world scenarios, stance detection needs to work in a zero-shot manner, i.e., predicting stances for unseen targets without labeled data. One critical challenge of zero-shot stance detection is the absence of contextual information on the targets. Current works mostly concentrate on introducing external knowledge to supplement information about targets, but the noisy schema-linking process hinders their performance in practice. To combat this issue, we argue that previous studies have ignored the extensive target -related information inhabited in the unlabeled data during the training phase, and propose a simple yet efficient Multi-Perspective Contrastive Learning Framework for zero-shot stance detection. Our framework is capable of leveraging information not only from labeled data but also from extensive unlabeled data. To this end, we design target-oriented contrastive learning and label-oriented contrastive learning to capture more comprehensive target representation and more distinguishable stance features. We conduct extensive experiments on three widely adopted datasets (from 4870 to 33,090 instances), namely SemEval-2016, WT-WT, and VAST. Our framework achieves 53.6%, 77.1%, and 72.4% macro-average F1 scores on these three datasets, showing 2.71% and 0.25% improvements over state-of-the-art baselines on the SemEval-2016 and WT-WT datasets and comparable results on the more challenging VAST dataset.
引用
收藏
页数:15
相关论文
共 50 条
  • [41] Identifying Unlabeled WiFi Devices with Zero-Shot Learning
    Smith, Logan
    Smith, Nicholas
    Rayborn, Daniel
    Tang, Bo
    Ball, John E.
    Young, Maxwell
    AUTOMATIC TARGET RECOGNITION XXX, 2020, 11394
  • [42] Zero-Shot Stance Detection: A Dataset and Model using Generalized Topic Representations
    Allaway, Emily
    McKeown, Kathleen
    PROCEEDINGS OF THE 2020 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP), 2020, : 8913 - 8931
  • [43] Commonsense-based adversarial learning framework for zero-shot stance detection
    Zhang, Hao
    Li, Yizhou
    Zhu, Tuanfei
    Li, Chuang
    NEUROCOMPUTING, 2024, 563
  • [44] Zero-Shot Anomaly Detection via Batch Normalization
    Li, Aodong
    Qiu, Chen
    Kloft, Marius
    Smyth, Padhraic
    Rudolph, Maja
    Mandt, Stephan
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [45] Semantics Guided Contrastive Learning of Transformers for Zero-shot Temporal Activity Detection
    Nag, Sayak
    Goldstein, Orpaz
    Roy-Chowdhury, Amit K.
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 6232 - 6242
  • [46] Zero-Shot Object Detection
    Bansal, Ankan
    Sikka, Karan
    Sharma, Gaurav
    Chellappa, Rama
    Divakaran, Ajay
    COMPUTER VISION - ECCV 2018, PT I, 2018, 11205 : 397 - 414
  • [47] Zero-Shot Rumor Detection via Meta Multi-Task Prompt Learning
    Shi, Yu
    Yu, Ning
    Sun, Yawei
    Liu, Jianyi
    Beijing Youdian Daxue Xuebao/Journal of Beijing University of Posts and Telecommunications, 2024, 47 (04): : 77 - 82
  • [48] Semantic Contrastive Embedding for Generalized Zero-Shot Learning
    Zongyan Han
    Zhenyong Fu
    Shuo Chen
    Jian Yang
    International Journal of Computer Vision, 2022, 130 : 2606 - 2622
  • [49] A Contrastive Method for Continual Generalized Zero-Shot Learning
    Liang, Chen
    Fan, Wentao
    Liu, Xin
    Peng, Shu-Juan
    ADVANCES AND TRENDS IN ARTIFICIAL INTELLIGENCE. THEORY AND APPLICATIONS, IEA/AIE 2023, PT I, 2023, 13925 : 365 - 376
  • [50] Transferable Contrastive Network for Generalized Zero-Shot Learning
    Jiang, Huajie
    Wang, Ruiping
    Shan, Shiguang
    Chen, Xilin
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 9764 - 9773