EZ-STANCE: A Large Dataset for English Zero-Shot Stance Detection

被引:0
|
作者
Zhao, Chenye [1 ]
Caragea, Cornelia [1 ]
机构
[1] Univ Illinois, Comp Sci, Chicago, IL 60607 USA
基金
美国国家科学基金会;
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Zero-shot stance detection (ZSSD) aims to determine whether the author of a text is in favor, against, or neutral toward a target that is unseen during training. In this paper, we present EZ-STANCE, a large English ZSSD dataset with 47,316 annotated text-target pairs. In contrast to VAST (Allaway and McKeown, 2020), which is the only other large existing ZSSD dataset for English, EZ-STANCE is 2.5 times larger, includes both noun-phrase targets and claim targets that cover a wide range of domains, provides two challenging subtasks for ZSSD: target-based ZSSD and domain-based ZSSD, and contains much harder examples for the neutral class. We evaluate EZ-STANCE using state-of-the-art deep learning models. Furthermore, we propose to transform ZSSD into the NLI task by applying simple yet effective prompts to noun-phrase targets. Our experimental results show that EZ-STANCE is a challenging new benchmark, which provides significant research opportunities on English ZSSD. We publicly release our dataset and code at https://github.com/chenyez/EZ-STANCE.
引用
收藏
页码:15697 / 15714
页数:18
相关论文
共 50 条
  • [21] Adversarial contrastive representation training with external knowledge injection for zero-shot stance detection
    Ding, Yifan
    Lei, Ying
    Wang, Anqi
    Liu, Xiangrun
    Zhu, Tuanfei
    Li, Yizhou
    NEUROCOMPUTING, 2025, 614
  • [22] P-Stance: A Large Dataset for Stance Detection in Political Domain
    Li, Yingjie
    Sosea, Tiberiu
    Sawant, Aditya
    Nair, Ajith Jayaraman
    Inkpen, Diana
    Caragea, Cornelia
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL-IJCNLP 2021, 2021, : 2355 - 2365
  • [23] Target-Phrase Zero-Shot Stance Detection: Where Do We Stand?
    Motyka, Dawid
    Piasecki, Maciej
    COMPUTATIONAL SCIENCE, ICCS 2024, PT II, 2024, 14833 : 34 - 49
  • [24] Adversarial Distillation Adaptation Model with Sentiment Contrastive Learning for Zero-Shot Stance Detection
    Zhang, Yu
    Wang, Chunling
    Wang, Jia
    INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE SYSTEMS, 2023, 16 (01)
  • [25] Zero-shot stance detection based on multi-perspective transferable feature fusion
    Zhao, Xuechen
    Zou, Jiaying
    Miao, Jinfeng
    Tian, Lei
    Gao, Liqun
    Zhou, Bin
    Pang, Shengnan
    INFORMATION FUSION, 2024, 108
  • [26] Meta-learning with topic-agnostic representations for zero-shot stance detection
    Choi, Kyuri
    Ko, Youngjoong
    PATTERN RECOGNITION LETTERS, 2023, 171 : 15 - 20
  • [27] Zero-shot stance detection via multi-perspective contrastive with unlabeled data
    Jiang, Yan
    Gao, Jinhua
    Shen, Huawei
    Cheng, Xueqi
    INFORMATION PROCESSING & MANAGEMENT, 2023, 60 (04)
  • [28] A meta-contrastive learning with data augmentation framework for zero-shot stance detection
    Wang, Chunling
    Zhang, Yijia
    Wang, Shilong
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 250
  • [29] Zero-shot stance detection based on multi-perspective transferable feature fusion
    Zhao, Xuechen
    Zou, Jiaying
    Miao, Jinfeng
    Tian, Lei
    Gao, Liqun
    Zhou, Bin
    Pang, Shengnan
    Information Fusion, 2024, 108
  • [30] Adversarial Distillation Adaptation Model with Sentiment Contrastive Learning for Zero-Shot Stance Detection
    Yu Zhang
    Chunling Wang
    Jia Wang
    International Journal of Computational Intelligence Systems, 16