Text Classification Model Based on Graph Attention Networks and Adversarial Training

被引:0
|
作者
Li, Jing [1 ]
Jian, Yumei [1 ]
Xiong, Yujie [1 ]
机构
[1] Shanghai Univ Engn Sci, Sch Elect & Elect Engn, Shanghai 201620, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2024年 / 14卷 / 11期
关键词
Chinese short text classification; graph attention networks; attention mechanism; adversarial training; feature fusion; ALGORITHM;
D O I
10.3390/app14114906
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Featured Application Public Opinion Analysis.Abstract Text information on the internet often has a strong sense of immediacy, constantly reflecting societal dynamics and evolving events. This is especially crucial in the field of news text, where the classification and analysis of these immediate and varied text data become essential. Existing text classification models frequently struggle to effectively represent the semantic and local feature information of texts, limiting their effectiveness. The primary challenge lies in improving the representation of both semantic and local feature information in text classification models, which is critical for capturing the nuanced meanings in rapidly evolving news texts. This paper proposes a deep learning-driven framework designed to enhance the effectiveness of text classification models. The method incorporates noise perturbation during training for adversarial training, thereby enhancing the model's generalization ability on original samples and increasing its robustness. A graph attention network is employed to extract the contextual semantic information of vocabulary from sequential texts. This information is then combined with extracted sentence feature information to enrich the feature representation of the sequence. An attention mechanism is also introduced to extract more critical feature information from the text, thereby deepening the understanding of textual semantic information. Experimental results demonstrate that this method successfully integrates the boundary and semantic information of vocabulary into the classification task. The approach comprehensively and deeply mines the semantic features of the text, leading to improved classification performance.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Domain-Adversarial Graph Neural Networks for Text Classification
    Wu, Man
    Pan, Shirui
    Zhu, Xingquan
    Zhou, Chuan
    Pan, Lei
    [J]. 2019 19TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM 2019), 2019, : 648 - 657
  • [2] geoGAT: Graph Model Based on Attention Mechanism for Geographic Text Classification
    Jing, Weipeng
    Song, Xianyang
    Di, Donglin
    Song, Houbing
    [J]. ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING, 2021, 20 (05)
  • [3] Deep Attention Diffusion Graph Neural Networks for Text Classification
    Liu, Yonghao
    Guan, Renchu
    Giunchiglia, Fausto
    Liang, Yanchun
    Feng, Xiaoyue
    [J]. 2021 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2021), 2021, : 8142 - 8152
  • [4] Improvements to adversarial training for text classification
    He, Jia-Long
    Zhang, Xiao-Lin
    Wang, Yong-Ping
    Gu, Rui-Chun
    Liu, Li-Xin
    Xu, En-Hui
    [J]. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2024, 46 (02) : 5191 - 5202
  • [5] An adversarial training method for text classification
    Liu, Xiaoyang
    Dai, Shanghong
    Fiumara, Giacomo
    De Meo, Pasquale
    [J]. JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2023, 35 (08)
  • [6] Contrastive Learning with Heterogeneous Graph Attention Networks on Short Text Classification
    Sun, Zhongtian
    Harit, Anoushka
    Cristea, Alexandra, I
    Yu, Jialin
    Shi, Lei
    Al Moubayed, Noura
    [J]. 2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [7] Adversarial Training for Relation Classification with Attention Based Gate Mechanism
    Cao, Pengfei
    Chen, Yubo
    Liu, Kang
    Zhao, Jun
    [J]. KNOWLEDGE GRAPH AND SEMANTIC COMPUTING: KNOWLEDGE COMPUTING AND LANGUAGE UNDERSTANDING (CCKS 2018), 2019, 957 : 91 - 102
  • [8] A text classification method based on LSTM and graph attention network
    Wang, Haitao
    Li, Fangbing
    [J]. CONNECTION SCIENCE, 2022, 34 (01) : 2466 - 2480
  • [9] Knowledge Graph Recommendation Model Based on Adversarial Training
    Zhang, Suqi
    Zhang, Ningjing
    Fan, Shuai
    Gu, Junhua
    Li, Jianxin
    [J]. APPLIED SCIENCES-BASEL, 2022, 12 (15):
  • [10] Revisiting Attention-Based Graph Neural Networks for Graph Classification
    Tao, Ye
    Li, Ying
    Wu, Zhonghai
    [J]. PARALLEL PROBLEM SOLVING FROM NATURE - PPSN XVII, PPSN 2022, PT I, 2022, 13398 : 442 - 458