A proposal for an approach to mapping susceptibility to landslides using natural language processing and machine learning

被引:12
|
作者
Rodrigues, Saulo Guilherme [1 ]
Silva, Maisa Mendonca [2 ]
Alencar, Marcelo Hazin [3 ]
机构
[1] Univ Fed Pernambuco, Ctr Acad Agreste CAA, Ave Marielle Franco S-N,Km 59, BR-55014900 Caruaru, PE, Brazil
[2] Univ Fed Pernambuco, Dept Engn Management, Ave Arquitetura Cidade Univ, BR-50740550 Recife, PE, Brazil
[3] Univ Fed Pernambuco UFPE, Res Grp Risk Assessment & Modelling Environm Asse, Recife, PE, Brazil
关键词
Mapping susceptibility; Natural language processing; Machine learning; ARTIFICIAL NEURAL-NETWORKS; DATA MINING TECHNIQUES; RANDOM-FOREST; SPATIAL PREDICTION; FLOOD SUSCEPTIBILITY; DECISION TREE; PERFORMANCE EVALUATION; LOGISTIC-REGRESSION; TEXT CLASSIFICATION; GENETIC ALGORITHM;
D O I
10.1007/s10346-021-01643-3
中图分类号
P5 [地质学];
学科分类号
0709 ; 081803 ;
摘要
Compiling an inventory is a fundamental step for carrying out assessments of landslide hazards. However, data in sufficient quantity and quality are not always available. Thus, this study puts forward an approach for drawing up a landslide inventory using textual data from telephone records, and for mapping hazards of landslides in an urban area. Forty thousand seven hundred ninety-two textual records and the naive Bayes algorithm were used to classify them, and these form the landslide inventory. After creating the inventory, the random forest algorithm with 12 conditioning variables was used to map landslide hazards. The text classification model obtained an accuracy of 0.8671 and a Kappa index of 0.8038. The hazard mapping model obtained accuracy of 0.9503 and an AUC (area under the curve)-ROC (receiver operating characteristics) of 0.9870. The results produced by the model were also compared with real landslides reported in news reports and were shown to be close to what had happened, thus demonstrating the ability of the proposed approach to predict landslides. Finally, the proposed approach can be used in simulation environments, thereby supporting strategic decision-making associated with hazard analysis.
引用
收藏
页码:2515 / 2529
页数:15
相关论文
共 50 条
  • [1] A proposal for an approach to mapping susceptibility to landslides using natural language processing and machine learning
    Saulo Guilherme Rodrigues
    Maisa Mendonça Silva
    Marcelo Hazin Alencar
    Landslides, 2021, 18 : 2515 - 2529
  • [2] Software security with natural language processing and vulnerability scoring using machine learning approach
    Verma B.K.
    Yadav A.K.
    Journal of Ambient Intelligence and Humanized Computing, 2024, 15 (04) : 2641 - 2651
  • [3] A linguistic approach proposal for mechanical design using natural language processing
    Linhares, JC
    Dias, A
    COMPUTATIONAL PROCESSING OF THE PORTUGUESE LANAGUAGE, PROCEEDINGS, 2003, 2721 : 171 - 174
  • [4] Using Machine Learning and Natural Language Processing to Review and Classify the Medical Literature on Cancer Susceptibility Genes
    Bao, Yujia
    Deng, Zhengyi
    Wang, Yan
    Kim, Heeyoon
    Armengol, Victor Diego
    Acevedo, Francisco
    Ouardaoui, Nofal
    Wang, Cathy
    Parmigiani, Giovanni
    Barzilay, Regina
    Braun, Danielle
    Hughes, Kevin S.
    JCO CLINICAL CANCER INFORMATICS, 2019, 3
  • [5] BCBSLA APPROACH USING NATURAL LANGUAGE PROCESSING (NLP) AND MACHINE LEARNING TO PREDICT THE RISK OF HOSPITALIZATIONS
    Holloway, J.
    Neely, C.
    Yuan, X.
    Zhang, Y.
    Ouyang, J.
    Cantrell, D.
    Chaisson, J.
    Tisdale, K.
    Bergeron, T.
    Nigam, S.
    VALUE IN HEALTH, 2019, 22 : S266 - S266
  • [6] Optimizing biochar for carbon sequestration: a synergistic approach using machine learning and natural language processing
    Li, Jiayi
    Chen, Yixuan
    Wang, Chaojie
    Chen, Hanbo
    Gao, Yurong
    Meng, Jun
    Han, Zhongyuan
    Van Zwieten, Lukas
    He, Yi
    Li, Caibin
    Cornelissen, Gerard
    Wang, Hailong
    BIOCHAR, 2025, 7 (01)
  • [7] A Machine Learning Approach to Fake News Detection Using Knowledge Verification and Natural Language Processing
    Ibrishimova, Marina Danchovsky
    Li, Kin Fun
    ADVANCES IN INTELLIGENT NETWORKING AND COLLABORATIVE SYSTEMS, INCOS - 2019, 2020, 1035 : 223 - 234
  • [9] Knowledgeable Machine Learning for Natural Language Processing
    Han, Xu
    Zhang, Zhengyan
    Liu, Zhiyuan
    COMMUNICATIONS OF THE ACM, 2021, 64 (11) : 50 - 51
  • [10] Machine learning in statistical natural language processing
    Mochihashi, Daichi
    Kyokai Joho Imeji Zasshi/Journal of the Institute of Image Information and Television Engineers, 2015, 69 (02): : 131 - 135