EPiDA: An Easy Plug-in Data Augmentation Framework for High Performance Text Classification

被引:0
|
作者
Zhao, Minyi [1 ,2 ]
Zhang, Lu [1 ,2 ]
Xu, Yi [1 ,2 ]
Ding, Jiandong [3 ]
Guan, Jihong [4 ]
Zhou, Shuigeng [1 ,2 ]
机构
[1] Fudan Univ, Shanghai Key Lab Intelligent Informat Proc, Shanghai, Peoples R China
[2] Fudan Univ, Sch Comp Sci, Shanghai, Peoples R China
[3] Alibaba Grp, Hangzhou, Zhejiang, Peoples R China
[4] Tongji Univ, Shanghai, Peoples R China
基金
国家重点研发计划;
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recent works have empirically shown the effectiveness of data augmentation (DA) for NLP tasks, especially for those suffering from data scarcity. Intuitively, given the size of generated data, their diversity and quality are crucial to the performance of targeted tasks. However, to the best of our knowledge, most existing methods consider only either the diversity or the quality of augmented data, thus cannot fully tap the potential of DA for NLP. In this paper, we present an easy and plug-in data augmentation framework EPiDA to support effective text classification. EPiDA employs two mechanisms: relative entropy maximization (REM) and conditional entropy minimization (CEM) to control data generation, where REM is designed to enhance the diversity of augmented data while CEM is exploited to ensure their semantic consistency. EPiDA can support efficient and continuous data generation for effective classifier training. Extensive experiments show that EPiDA outperforms existing SOTA methods in most cases, though not using any agent network or pre-trained generation network, and it works well with various DA algorithms and classification models. Code is available at https://github.com/zhaominyiz/EPiDA.
引用
收藏
页码:4742 / 4752
页数:11
相关论文
共 50 条
  • [1] EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Tasks
    Wei, Jason
    Zou, Kai
    [J]. 2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019): PROCEEDINGS OF THE CONFERENCE, 2019, : 6382 - 6388
  • [2] A Submodular Optimization Framework for Imbalanced Text Classification With Data Augmentation
    Alemayehu, Eyor
    Fang, Yi
    [J]. IEEE ACCESS, 2023, 11 : 41680 - 41696
  • [3] Persistence of plug-in rule in classification of high dimensional multivariate binary data
    Park, Junyong
    Ghosh, Jayanta K.
    [J]. JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 2007, 137 (11) : 3687 - 3705
  • [4] DivAug: Plug-in Automated Data Augmentation with Explicit Diversity Maximization
    Liu, Zirui
    Jin, Haifeng
    Wang, Ting-Hsiang
    Zhou, Kaixiong
    Hu, Xia
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 4742 - 4750
  • [5] Data Augmentation with Transformers for Text Classification
    Medardo Tapia-Tellez, Jose
    Jair Escalante, Hugo
    [J]. ADVANCES IN COMPUTATIONAL INTELLIGENCE, MICAI 2020, PT II, 2020, 12469 : 247 - 259
  • [6] A Survey on Data Augmentation for Text Classification
    Bayer, Markus
    Kaufhold, Marc-Andre
    Reuter, Christian
    [J]. ACM COMPUTING SURVEYS, 2023, 55 (07)
  • [7] EASY DATA AUGMENTATION METHOD FOR CLASSIFICATION TASKS
    Liu Guohang
    Zhang Shibin
    Tang Haozhe
    Yang Lu
    Lu Jiazhong
    Huang Yuanyuan
    [J]. 2020 17TH INTERNATIONAL COMPUTER CONFERENCE ON WAVELET ACTIVE MEDIA TECHNOLOGY AND INFORMATION PROCESSING (ICCWAMTIP), 2020, : 166 - 169
  • [8] To plug-in or not to plug-in? Geomorphic analysis of rivers using the River Styles Framework in an era of big data acquisition and automation
    Fryhs, Kirstie A.
    Wheaton, Joseph M.
    Bizzi, Simone
    Williams, Richard
    Brierley, Gary J.
    [J]. WILEY INTERDISCIPLINARY REVIEWS-WATER, 2019, 6 (05):
  • [9] PCAE: A framework of plug-in conditional auto-encoder for controllable text generation
    Tu, Haoqin
    Yang, Zhongliang
    Yang, Jinshuai
    Zhang, Siyu
    Huang, Yongfeng
    [J]. KNOWLEDGE-BASED SYSTEMS, 2022, 256
  • [10] On the Construction of EASTWeb Framework - A Plug-in Framework for Processing Earth Observation Data Streams
    Liu, Yi
    Wimberly, Michael C.
    Hu, Jiameng
    [J]. 2014 IEEE INTERNATIONAL CONFERENCE ON ELECTRO/INFORMATION TECHNOLOGY (EIT), 2014, : 463 - 467