Robust Multi-task Learning-based Korean POS Tagging to OvercomeWord Spacing Errors

被引:0
|
作者
Park, Cheoneum [1 ,2 ]
Kim, Juae [3 ,4 ]
机构
[1] SK Telecom, 65 Eulji Ro, Seoul 04539, South Korea
[2] Hyundai Motor Co, 65 Eulji Ro, Seoul 04539, South Korea
[3] Hankuk Univ Foreign Studies, 107 Imun Ro, Seoul 02451, South Korea
[4] Hyundai Motor Co, 107 Imun Ro, Seoul 02451, South Korea
关键词
Morphological analysis; part-of-speech tagging; word spacing; multi-task learning;
D O I
10.1145/3591206
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
End-to-end neural network-based approaches have recently demonstrated significant improvements in natural language processing (NLP). However, in the NLP application such as assistant systems, NLP components are still processed to extract results using a pipeline paradigm. The pipeline-based concept has issues with error propagation. In Korean, morphological analysis and part-of-speech (POS) tagging step, incorrectly analyzing POS tags for a sentence containing spacing errors negatively affects other modules behind the POS module. Hence, we present a multi-task learning-based POS tagging neural model for Korean with word spacing challenges. When we apply this model to the Korean morphological analysis and POS tagging, we get findings that are robust to word spacing errors. We adopt syllable-level input and output formats, as well as a simple structure for ELECTRA and RNN-CRF models for multi-task learning, and we achieve a good performance 98.30 of F1, better than previous studies on the Sejong corpus test set.
引用
下载
收藏
页数:13
相关论文
共 50 条
  • [41] Multi-task Learning Based Skin Segmentation
    Tan, Taizhe
    Shan, Zhenghao
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT III, KSEM 2023, 2023, 14119 : 360 - 369
  • [42] Multi-Task Learning Based Network Embedding
    Wang, Shanfeng
    Wang, Qixiang
    Gong, Maoguo
    FRONTIERS IN NEUROSCIENCE, 2020, 13
  • [43] Multi-Task Learning-Based Channel Estimation for RIS Assisted Multi-User Communication Systems
    Xie, Wenwu
    Xiao, Jian
    Zhu, Peng
    Yu, Chao
    IEEE COMMUNICATIONS LETTERS, 2022, 26 (03) : 577 - 581
  • [44] Graph-based Multi-task Learning
    Li, Ya
    Tian, Xinmei
    2015 IEEE 16TH INTERNATIONAL CONFERENCE ON COMMUNICATION TECHNOLOGY (ICCT), 2015, : 730 - 733
  • [45] Meta-Knowledge and Multi-Task Learning-Based Multi-Scene Adaptive Crowd Counting
    Tang, Siqi
    Pan, Zhisong
    Hu, Guyu
    Wu, Yang
    Li, Yunbo
    SENSORS, 2022, 22 (09)
  • [46] Multi-task federated learning-based system anomaly detection and multi-classification for microservices architecture
    Hao, Junfeng
    Chen, Peng
    Chen, Juan
    Li, Xi
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2024, 159 : 77 - 90
  • [47] Multi-task learning with contextual hierarchical attention for Korean coreference resolution
    Park, Cheoneum
    ETRI JOURNAL, 2023, 45 (01) : 93 - 104
  • [48] Asymmetric Multi-task Learning Based on Task Relatedness and Loss
    Lee, Giwoong
    Yang, Eunho
    Hwang, Sung Ju
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 48, 2016, 48
  • [49] Deep Reinforcement Learning-Based Multi-Task Scheduling in Cloud Manufacturing Under Different Task Arrival Modes
    Ping, Yaoyao
    Liu, Yongkui
    Zhang, Lin
    Wang, Lihui
    Xu, Xun
    JOURNAL OF MANUFACTURING SCIENCE AND ENGINEERING-TRANSACTIONS OF THE ASME, 2023, 145 (08):
  • [50] Joint computation offloading and task caching for multi-user and multi-task MEC systems: reinforcement learning-based algorithms
    Elgendy, Ibrahim A.
    Zhang, Wei-Zhe
    He, Hui
    Gupta, Brij B.
    Abd El-Latif, Ahmed A.
    WIRELESS NETWORKS, 2021, 27 (03) : 2023 - 2038