GNoM: Graph Neural Network Enhanced Language Models for Disaster Related Multilingual Text Classification

被引:2
|
作者
Ghosh, Samujjwal [1 ]
Maji, Subhadeep [2 ]
Desarkar, Maunendra Sankar [1 ]
机构
[1] Indian Inst Technol Hyderabad, Hyderabad, India
[2] Amazon, Hyderabad, India
关键词
Multilingual Learning; Natural Language Processing; Graph Neural Networks; Text Classification; Disaster Management;
D O I
10.1145/3501247.3531561
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Online social media works as a source of various valuable and actionable information during disasters. These information might be available in multiple languages due to the nature of user generated content. An effective system to automatically identify and categorize these actionable information should be capable to handle multiple languages and under limited supervision. However, existing works mostly focus on English language only with the assumption that sufficient labeled data is available. To overcome these challenges, we propose a multilingual disaster related text classification system which is capable to work undervmonolingual, cross-lingual and multilingual lingual scenarios and under limited supervision. Our end-to-end trainable framework combines the versatility of graph neural networks, by applying over the corpus, with the power of transformer based large language models, over examples, with the help of cross-attention between the two. We evaluate our framework over total nine English, Non-English and monolingual datasets invmonolingual, cross-lingual and multilingual lingual classification scenarios. Our framework outperforms state-of-the-art models in disaster domain and multilingual BERT baseline in terms of Weighted F-1 score. We also show the generalizability of the proposed model under limited supervision.
引用
收藏
页码:55 / 65
页数:11
相关论文
共 50 条
  • [21] Label-Dividing Gated Graph Neural Network for Hierarchical Text Classification
    Zheng, Siqi
    Zhou, Jie
    Meng, Kui
    Liu, Gongshen
    [J]. 2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [22] A neural network model for hierarchical multilingual text categorization
    Chau, RN
    Yeh, CS
    Smith, KA
    [J]. ADVANCES IN NEURAL NETWORKS - ISNN 2005, PT 2, PROCEEDINGS, 2005, 3497 : 238 - 245
  • [23] Evaluation of Neural Network Language Models In Handwritten Chinese Text Recognition
    Wu, Yi-Chao
    Yin, Fei
    Liu, Cheng-Lin
    [J]. 2015 13TH IAPR INTERNATIONAL CONFERENCE ON DOCUMENT ANALYSIS AND RECOGNITION (ICDAR), 2015, : 166 - 170
  • [24] Recurrent Graph Neural Networks for Text Classification
    Wei, Xinde
    Huang, Hai
    Ma, Longxuan
    Yang, Ze
    Xu, Liutong
    [J]. PROCEEDINGS OF 2020 IEEE 11TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND SERVICE SCIENCE (ICSESS 2020), 2020, : 91 - 97
  • [25] Graph neural networks for text classification: a survey
    Wang, Kunze
    Ding, Yihao
    Han, Soyeon Caren
    [J]. ARTIFICIAL INTELLIGENCE REVIEW, 2024, 57 (08)
  • [26] Improving handwritten Chinese text recognition using neural network language models and convolutional neural network shape models
    Wu, Yi-Chao
    Yin, Fei
    Liu, Cheng-Lin
    [J]. PATTERN RECOGNITION, 2017, 65 : 251 - 264
  • [27] Neural Architecture Search via Multi-Hashing Embedding and Graph Tensor Networks for Multilingual Text Classification
    Yan, Xueming
    Huang, Han
    Jin, Yaochu
    Chen, Liang
    Liang, Zhanning
    Hao, Zhifeng
    [J]. IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024, 8 (01): : 350 - 363
  • [28] Prosodically-enhanced Recurrent Neural Network Language Models
    Gangireddy, Siva Reddy
    Renals, Steve
    Nankaku, Yoshihiko
    Lee, Akinobu
    [J]. 16TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2015), VOLS 1-5, 2015, : 2390 - 2394
  • [29] Statistical Analysis of Multilingual Text Corpus and Development of Language Models
    Agrawal, Shyam S.
    Bansal, Abhimanue Shweta
    Mahajan, Minakshi
    [J]. LREC 2014 - NINTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, 2014, : 2436 - 2440
  • [30] Transformer and Graph Convolutional Network for Text Classification
    Boting Liu
    Weili Guan
    Changjin Yang
    Zhijie Fang
    Zhiheng Lu
    [J]. International Journal of Computational Intelligence Systems, 16