GNoM: Graph Neural Network Enhanced Language Models for Disaster Related Multilingual Text Classification

被引:2
|
作者
Ghosh, Samujjwal [1 ]
Maji, Subhadeep [2 ]
Desarkar, Maunendra Sankar [1 ]
机构
[1] Indian Inst Technol Hyderabad, Hyderabad, India
[2] Amazon, Hyderabad, India
关键词
Multilingual Learning; Natural Language Processing; Graph Neural Networks; Text Classification; Disaster Management;
D O I
10.1145/3501247.3531561
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Online social media works as a source of various valuable and actionable information during disasters. These information might be available in multiple languages due to the nature of user generated content. An effective system to automatically identify and categorize these actionable information should be capable to handle multiple languages and under limited supervision. However, existing works mostly focus on English language only with the assumption that sufficient labeled data is available. To overcome these challenges, we propose a multilingual disaster related text classification system which is capable to work undervmonolingual, cross-lingual and multilingual lingual scenarios and under limited supervision. Our end-to-end trainable framework combines the versatility of graph neural networks, by applying over the corpus, with the power of transformer based large language models, over examples, with the help of cross-attention between the two. We evaluate our framework over total nine English, Non-English and monolingual datasets invmonolingual, cross-lingual and multilingual lingual classification scenarios. Our framework outperforms state-of-the-art models in disaster domain and multilingual BERT baseline in terms of Weighted F-1 score. We also show the generalizability of the proposed model under limited supervision.
引用
收藏
页码:55 / 65
页数:11
相关论文
共 50 条
  • [1] Bert-Enhanced Text Graph Neural Network for Classification
    Yang, Yiping
    Cui, Xiaohui
    [J]. ENTROPY, 2021, 23 (11)
  • [2] Text Level Graph Neural Network for Text Classification
    Huang, Lianzhe
    Ma, Dehong
    Li, Sujian
    Zhang, Xiaodong
    Wang, Houfeng
    [J]. 2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019): PROCEEDINGS OF THE CONFERENCE, 2019, : 3444 - 3450
  • [3] Deep Neural Network Models for Paraphrased Text Classification in the Arabic Language
    Mahmoud, Adnen
    Zrigui, Mounir
    [J]. NATURAL LANGUAGE PROCESSING AND INFORMATION SYSTEMS (NLDB 2019), 2019, 11608 : 3 - 16
  • [4] Review of Graph Neural Network in Text Classification
    Malekzadeh, Masoud
    Hajibabaee, Parisa
    Heidari, Maryam
    Zad, Samira
    Uzuner, Ozlem
    Jones, James H. Jr Jr
    [J]. 2021 IEEE 12TH ANNUAL UBIQUITOUS COMPUTING, ELECTRONICS & MOBILE COMMUNICATION CONFERENCE (UEMCON), 2021, : 84 - 91
  • [5] Text Classification with Attention Gated Graph Neural Network
    Zhaoyang Deng
    Chenxiang Sun
    Guoqiang Zhong
    Yuxu Mao
    [J]. Cognitive Computation, 2022, 14 : 1464 - 1473
  • [6] Text Classification with Attention Gated Graph Neural Network
    Deng, Zhaoyang
    Sun, Chenxiang
    Zhong, Guoqiang
    Mao, Yuxu
    [J]. COGNITIVE COMPUTATION, 2022, 14 (04) : 1464 - 1473
  • [7] Heterogeneous Graph Neural Network for Short Text Classification
    Zhang, Bingjie
    He, Qing
    Zhang, Damin
    [J]. APPLIED SCIENCES-BASEL, 2022, 12 (17):
  • [8] A Sequential Graph Neural Network for Short Text Classification
    Zhao, Ke
    Huang, Lan
    Song, Rui
    Shen, Qiang
    Xu, Hao
    [J]. ALGORITHMS, 2021, 14 (12)
  • [9] Graph Reasoning Enhanced Language Models for Text-to-SQL
    Gong, Zheng
    Sun, Ying
    [J]. PROCEEDINGS OF THE 47TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, SIGIR 2024, 2024, : 2447 - 2451
  • [10] Heterogeneous graph convolutional neural network for short text classification
    Huang, Bo
    Li, Peipei
    Fang, Zhijun
    Lei, Lv
    Wang, Chenming
    [J]. International Journal of Intelligent Systems Technologies and Applications, 2023, 21 (04) : 344 - 365