A Chinese text classification based on active

被引:2
|
作者
Deng, Song [1 ]
Li, Qianliang [1 ]
Dai, Renjie [2 ]
Wei, Siming [2 ]
Wu, Di [3 ]
He, Yi [4 ]
Wu, Xindong [5 ]
机构
[1] Nanjing Univ Post & Telecommun, Inst Adv Technol, Nanjing 210003, Peoples R China
[2] State Grid Shanghai Municipal Elect Power Co, Shanghai 200122, Peoples R China
[3] Southwest Univ, Coll Comp & Informat Sci, Chongqing 400715, Peoples R China
[4] Old Dominion Univ, Norfolk, VA 23462 USA
[5] Hefei Univ Technol, Key Lab Knowledge Engn Big Data, Minist Educ China, Hefei 230009, Peoples R China
关键词
Natural language processing; Deep active learning; Hierarchical confidence; Power text; Knowledge graph; ALGORITHM;
D O I
10.1016/j.asoc.2023.111067
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The construction of knowledge graph is beneficial for grid production, electrical safety protection, fault diagnosis and traceability in an observable and controllable way. Highly-precision text classification algorithm is crucial to build a professional knowledge graph in power system. Unfortunately, there are a large number of poorly described and specialized texts in the power business system, and the amount of data containing valid labels in these texts is low. This will bring great challenges to improve the precision of text classification models. To offset the gap, we propose a classification algorithm for Chinese text in the power system based on deep active learning (CCTP-DAL). Our core idea is to apply a hierarchical confidence strategy to a deep active learning model, to balance the trade-offs between the amount of training data and the accuracy of text classification. Our CCTP-DAL (1) trains the Bert model using a small amount of labeled data to calculate the confidence level of each short text, (2) selects high-confidence text data with optimal model generalization capability based on the hierarchical confidence level, and (3) fuses deep learning models and active learning strategies to ensure high text classification accuracy with less labeled training data. We benchmark our model on a real crawler data on the web with extensive experiments. The experimental results demonstrate that our proposed model can achieve higher text classification accuracy with less labeled training data compared with other deep learning models.
引用
收藏
页数:11
相关论文
共 50 条
  • [21] Chinese News Text Classification Method Based On Attention Mechanism
    Ruan, Jinjun
    Caballero, Jonathan M.
    Juanatas, Ronaldo A.
    2022 7TH INTERNATIONAL CONFERENCE ON BUSINESS AND INDUSTRIAL RESEARCH (ICBIR2022), 2022, : 330 - 334
  • [22] Blogger's Interest Mining Based on Chinese Text Classification
    Yang, Suhua
    Yan, Jianzhuo
    Gao, Chen
    Tan, Guohua
    NONLINEAR MATHEMATICS FOR UNCERTAINTY AND ITS APPLICATIONS, 2011, 100 : 611 - 618
  • [23] Research on Chinese text classification based on Naive Bayesian method
    Geng Xinglong
    Gao Xiuyan
    Zhao Bin
    PROCEEDINGS OF THE FIFTH INTERNATIONAL SYMPOSIUM ON TEST AUTOMATION & INSTRUMENTATION, VOLS 1 AND 2, 2014, : 226 - 230
  • [24] Chinese Text Feature Extraction and Classification Based on Deep Learning
    Wang, Ruishuang
    Li, Zhao
    Cao, Jian
    Chen, Tong
    PROCEEDINGS OF THE THIRD INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND APPLICATION ENGINEERING (CSAE2019), 2019,
  • [25] Research on Chinese News Text Classification Based on ERNIE Model
    Zhang, Wenxu
    PROCEEDINGS OF THE WORLD CONFERENCE ON INTELLIGENT AND 3-D TECHNOLOGIES, WCI3DT 2022, 2023, 323 : 89 - 100
  • [26] A Chinese text classification system based on Naive Bayes algorithm
    Cui, Wei
    2016 INTERNATIONAL CONFERENCE ON ELECTRONIC, INFORMATION AND COMPUTER ENGINEERING, 2016, 44
  • [27] A Chinese Text Classification Model Based on Radicals and Character Distinctions
    Yan-Xin, Huang
    Bo, Li
    IEEE ACCESS, 2023, 11 : 45520 - 45526
  • [28] Six-Granularity Based Chinese Short Text Classification
    Sun, Xinjie
    Liu, Zhifang
    Huo, Xingying
    IEEE ACCESS, 2023, 11 : 35841 - 35852
  • [29] Automatic Chinese Text Classification Based on NSVMDT-KNN
    Xu, QiNan
    Liu, Zhijng
    FIFTH INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS AND KNOWLEDGE DISCOVERY, VOL 2, PROCEEDINGS, 2008, : 410 - 414
  • [30] Chinese Text Classification System on Regulatory Information Based on SVM
    Zhang, Mingyue
    Ai, Xinbo
    Hu, Yanzhu
    2018 4TH INTERNATIONAL CONFERENCE ON ENVIRONMENTAL SCIENCE AND MATERIAL APPLICATION, 2019, 252