EZ-STANCE: A Large Dataset for English Zero-Shot Stance Detection

被引:0
|
作者
Zhao, Chenye [1 ]
Caragea, Cornelia [1 ]
机构
[1] Univ Illinois, Comp Sci, Chicago, IL 60607 USA
基金
美国国家科学基金会;
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Zero-shot stance detection (ZSSD) aims to determine whether the author of a text is in favor, against, or neutral toward a target that is unseen during training. In this paper, we present EZ-STANCE, a large English ZSSD dataset with 47,316 annotated text-target pairs. In contrast to VAST (Allaway and McKeown, 2020), which is the only other large existing ZSSD dataset for English, EZ-STANCE is 2.5 times larger, includes both noun-phrase targets and claim targets that cover a wide range of domains, provides two challenging subtasks for ZSSD: target-based ZSSD and domain-based ZSSD, and contains much harder examples for the neutral class. We evaluate EZ-STANCE using state-of-the-art deep learning models. Furthermore, we propose to transform ZSSD into the NLI task by applying simple yet effective prompts to noun-phrase targets. Our experimental results show that EZ-STANCE is a challenging new benchmark, which provides significant research opportunities on English ZSSD. We publicly release our dataset and code at https://github.com/chenyez/EZ-STANCE.
引用
收藏
页码:15697 / 15714
页数:18
相关论文
共 50 条
  • [31] Knowledge-Augmented Interpretable Network for Zero-Shot Stance Detection on Social Media
    Zhang, Bowen
    Ding, Daijun
    Huang, Zhichao
    Li, Ang
    Li, Yangyang
    Zhang, Baoquan
    Huang, Hu
    IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2024, : 1 - 12
  • [32] CONNECTING TARGETS VIA LATENT TOPICS AND CONTRASTIVE LEARNING: A UNIFIED FRAMEWORK FOR ROBUST ZERO-SHOT AND FEW-SHOT STANCE DETECTION
    Liu, Rui
    Lin, Zheng
    Fu, Peng
    Liu, Yuanxin
    Wang, Weiping
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 7812 - 7816
  • [33] A Large-scale Attribute Dataset for Zero-shot Learning
    Zhao, Bo
    Fu, Yanwei
    Liang, Rui
    Wu, Jiahong
    Wang, Yonggang
    Wang, Yizhou
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2019), 2019, : 398 - 407
  • [34] Chain of Stance: Stance Detection with Large Language Models
    Ma, Junxia
    Wang, Changjiang
    Xing, Hanwen
    Zhao, Dongming
    Zhang, Yazhou
    NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING, PT V, NLPCC 2024, 2025, 15363 : 82 - 94
  • [35] Enhancing zero-shot stance detection via multi-task fine-tuning with debate data and knowledge augmentation
    Fan, Qinlong
    Lu, Jicang
    Sun, Yepeng
    Pi, Qiankun
    Shang, Shouxin
    COMPLEX & INTELLIGENT SYSTEMS, 2025, 11 (02)
  • [36] Will-They-Won't-They: A Very Large Dataset for Stance Detection on Twitter
    Conforti, Costanza
    Berndt, Jakob
    Pilehvar, Mohammad Taher
    Giannitsarou, Chryssi
    Toxvaerd, Flavio
    Collier, Nigel
    58TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2020), 2020, : 1715 - 1724
  • [37] Zero-Shot Object Detection
    Bansal, Ankan
    Sikka, Karan
    Sharma, Gaurav
    Chellappa, Rama
    Divakaran, Ajay
    COMPUTER VISION - ECCV 2018, PT I, 2018, 11205 : 397 - 414
  • [38] ClimateMiSt: Climate Change Misinformation and Stance Detection Dataset
    Choi, YeonJung
    Shang, Lanyu
    Wang, Dong
    SOCIAL NETWORKS ANALYSIS AND MINING, ASONAM 2024, PT II, 2025, 15212 : 321 - 330
  • [39] ZERO-SHOT OBJECT DETECTION WITH TRANSFORMERS
    Zheng, Ye
    Cui, Li
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 444 - 448
  • [40] A Survey of Zero-Shot Object Detection
    Cao, Weipeng
    Yao, Xuyang
    Xu, Zhiwu
    Liu, Ye
    Pan, Yinghui
    Ming, Zhong
    BIG DATA MINING AND ANALYTICS, 2025, 8 (03): : 726 - 750