Social media data analysis framework for disaster response

被引:0
|
作者
Ponce-López V. [1 ]
Spataru C. [1 ]
机构
[1] UCL Energy Institute, University College London, London
来源
Discover Artificial Intelligence | 2022年 / 2卷 / 01期
基金
日本科学技术振兴机构; 英国科研创新办公室; 巴西圣保罗研究基金会;
关键词
Disaster response; Machine learning; Message filtering framework; Text analysis;
D O I
10.1007/s44163-022-00026-4
中图分类号
学科分类号
摘要
This paper presents a social media data analysis framework applied to multiple datasets. The method developed uses machine learning classifiers, where filtering binary classifiers based on deep bidirectional neural networks are trained on benchmark datasets of disaster responses for earthquakes and floods and extreme flood events. The classifiers consist of learning from discrete handcrafted features and fine-tuning approaches using deep bidirectional Transformer neural networks on these disaster response datasets. With the development of the multiclass classification approach, we compare the state-of-the-art results in one of the benchmark datasets containing the largest number of disaster-related categories. The multiclass classification approaches developed in this research with support vector machines provide a precision of 0.83 and 0.79 compared to Bernoulli naïve Bayes, which are 0.59 and 0.76, and multinomial naïve Bayes, which are 0.79 and 0.91, respectively. The binary classification methods based on the MDRM dataset show a higher precision with deep learning methods (DistilBERT) than BoW and TF-IDF, while in the case of UnifiedCEHMET dataset show a high performance for accuracy with the deep learning method in terms of severity, with a precision of 0.92 compared to BoW and TF-IDF method which has a precision of 0.68 and 0.70, respectively. © The Author(s) 2022.
引用
收藏
相关论文
共 50 条
  • [31] Mining Social Media for Disaster Management: Leveraging Social Media Data for Community Recovery
    Shibuya, Yuya
    2017 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2017, : 3111 - 3118
  • [32] Social media data and post-disaster recovery
    Jamali, Mehdi
    Nejat, Ali
    Ghosh, Souparno
    Jin, Fang
    Cao, Guofeng
    INTERNATIONAL JOURNAL OF INFORMATION MANAGEMENT, 2019, 44 : 25 - 37
  • [33] Review of the Application of Social Media Data in Disaster Research
    Tang, Jiting
    Yang, Saini
    Wang, Weiping
    MODERN MANAGEMENT BASED ON BIG DATA I (MMBD 2020), 2020, 329 : 74 - 82
  • [34] Social media data for disaster risk management and research
    Erokhin, Dmitry
    Komendantova, Nadejda
    INTERNATIONAL JOURNAL OF DISASTER RISK REDUCTION, 2024, 114
  • [35] Use of Social Media Data in Disaster Management: A Survey
    Phengsuwan, Jedsada
    Shah, Tejal
    Thekkummal, Nipun Balan
    Wen, Zhenyu
    Sun, Rui
    Pullarkatt, Divya
    Thirugnanam, Hemalatha
    Ramesh, Maneesha Vinodini
    Morgan, Graham
    James, Philip
    Ranjan, Rajiv
    FUTURE INTERNET, 2021, 13 (02): : 1 - 24
  • [36] Data Extrapolation in Social Sensing for Disaster Response
    Gu, Siyu
    Pan, Chenji
    Liu, Hengchang
    Li, Shen
    Hu, Shaohan
    Su, Lu
    Wang, Shiguang
    Wang, Dong
    Amin, Tanvir
    Govindan, Ramesh
    Aggarwal, Charu
    Ganti, Raghu
    Srivatsa, Mudhakar
    Barnoy, Amotz
    Terlecky, Peter
    Abdelzaher, Tarek
    2014 IEEE INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING IN SENSOR SYSTEMS (IEEE DCOSS 2014), 2014, : 119 - 126
  • [37] A deep learning-based social media text analysis framework for disaster resource management
    Ashutosh Bhoi
    Sthita Pragyan Pujari
    Rakesh Chandra Balabantaray
    Social Network Analysis and Mining, 2020, 10
  • [38] A deep learning-based social media text analysis framework for disaster resource management
    Bhoi, Ashutosh
    Pujari, Sthita Pragyan
    Balabantaray, Rakesh Chandra
    SOCIAL NETWORK ANALYSIS AND MINING, 2020, 10 (01)
  • [39] A SENTIMENT-BASED FILTERATION AND DATA ANALYSIS FRAMEWORK FOR SOCIAL MEDIA
    Abd Ghani, Norjihan
    Kamal, Siti Syahidah Mohamad
    PROCEEDINGS OF THE 5TH INTERNATIONAL CONFERENCE ON COMPUTING & INFORMATICS, 2015, : 632 - 637
  • [40] Big social data as a service (BSDaaS): a service composition framework for social media analysis
    Ali, Kashif
    Hamilton, Margaret
    Thevathayan, Charles
    Zhang, Xiuzhen
    JOURNAL OF BIG DATA, 2022, 9 (01)