EPiDA: An Easy Plug-in Data Augmentation Framework for High Performance Text Classification

被引:0
|
作者
Zhao, Minyi [1 ,2 ]
Zhang, Lu [1 ,2 ]
Xu, Yi [1 ,2 ]
Ding, Jiandong [3 ]
Guan, Jihong [4 ]
Zhou, Shuigeng [1 ,2 ]
机构
[1] Fudan Univ, Shanghai Key Lab Intelligent Informat Proc, Shanghai, Peoples R China
[2] Fudan Univ, Sch Comp Sci, Shanghai, Peoples R China
[3] Alibaba Grp, Hangzhou, Zhejiang, Peoples R China
[4] Tongji Univ, Shanghai, Peoples R China
基金
国家重点研发计划;
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recent works have empirically shown the effectiveness of data augmentation (DA) for NLP tasks, especially for those suffering from data scarcity. Intuitively, given the size of generated data, their diversity and quality are crucial to the performance of targeted tasks. However, to the best of our knowledge, most existing methods consider only either the diversity or the quality of augmented data, thus cannot fully tap the potential of DA for NLP. In this paper, we present an easy and plug-in data augmentation framework EPiDA to support effective text classification. EPiDA employs two mechanisms: relative entropy maximization (REM) and conditional entropy minimization (CEM) to control data generation, where REM is designed to enhance the diversity of augmented data while CEM is exploited to ensure their semantic consistency. EPiDA can support efficient and continuous data generation for effective classifier training. Extensive experiments show that EPiDA outperforms existing SOTA methods in most cases, though not using any agent network or pre-trained generation network, and it works well with various DA algorithms and classification models. Code is available at https://github.com/zhaominyiz/EPiDA.
引用
收藏
页码:4742 / 4752
页数:11
相关论文
共 50 条
  • [21] Data Augmentation Methods for Enhancing Robustness in Text Classification Tasks
    Tang, Huidong
    Kamei, Sayaka
    Morimoto, Yasuhiko
    [J]. ALGORITHMS, 2023, 16 (01)
  • [22] PDA: Data Augmentation with Preposition Words on Chinese text classification
    Yang, Leixin
    Xiong, Haoyu
    Xiang, Yu
    [J]. 2024 2ND ASIA CONFERENCE ON COMPUTER VISION, IMAGE PROCESSING AND PATTERN RECOGNITION, CVIPPR 2024, 2024,
  • [23] Data augmentation and adversary attack on limit resources text classification
    Fernando Sánchez-Vega
    A. Pastor López-Monroy
    Antonio Balderas-Paredes
    Luis Pellegrin
    Alejandro Rosales-Pérez
    [J]. Multimedia Tools and Applications, 2025, 84 (3) : 1317 - 1344
  • [24] TextANN: An Improved Text Classification Model Based on Data Augmentation
    Li, Hong
    Yang, Xiaosheng
    Yang, Guoqing
    Ouyang, Xiaogang
    Chen, Yu
    Wang, Xueqing
    [J]. 2018 INTERNATIONAL CONFERENCE ON CLOUD COMPUTING, BIG DATA AND BLOCKCHAIN (ICCBB 2018), 2018, : 160 - 163
  • [25] Hybrid Model of Data Augmentation Methods for Text Classification Task
    Feng, Jia Hui
    Mohaghegh, Mahsa
    [J]. PROCEEDINGS OF THE 13TH INTERNATIONAL JOINT CONFERENCE ON KNOWLEDGE DISCOVERY, KNOWLEDGE ENGINEERING AND KNOWLEDGE MANAGEMENT (KMIS), VOL 3, 2021, : 194 - 197
  • [26] Modular Plug-in High Performance Integrated Single-Phase Inverter
    Solomon, Adane Kassa
    Castellazzi, Alberto
    [J]. 2016 6TH ELECTRONIC SYSTEM-INTEGRATION TECHNOLOGY CONFERENCE (ESTC), 2016,
  • [27] A Text Data Augmentation Approach for Improving the Performance of CNN
    Abulaish, Muhammad
    Sah, Amit Kumar
    [J]. 2019 11TH INTERNATIONAL CONFERENCE ON COMMUNICATION SYSTEMS & NETWORKS (COMSNETS), 2019, : 660 - 665
  • [28] Comprehensive Performance Optimization of High Pressure Threaded Plug-in Relief Valves
    Chen J.
    Kong X.
    Xu K.
    Ai C.
    [J]. Zhongguo Jixie Gongcheng/China Mechanical Engineering, 2023, 34 (24): : 2909 - 2919
  • [29] Zwift: A Programming Framework for High Performance Text Analytics on Compressed Data
    Zhang, Feng
    Zhai, Jidong
    Shen, Xipeng
    Mutlu, Onur
    Chen, Wenguang
    [J]. INTERNATIONAL CONFERENCE ON SUPERCOMPUTING (ICS 2018), 2018, : 195 - 206
  • [30] High-performance Hybrid Transmission for Future Plug-in Hybrid Drives
    [J]. Müller, Jörg, 1600, Springer Nature (118):