Cloud Computing Model for Big Geological Data Processing

被引:4
|
作者
Song, Miaomiao [1 ]
Li, Zhe [1 ]
Zhou, Bin [1 ]
Li, Chaoling [2 ]
机构
[1] Shandong Acad Sci, Inst Oceanog Instrumentat, Qingdao, Peoples R China
[2] China Geol Survey, Res Dev Ctr, Beijing, Peoples R China
关键词
geological data analysis; mining area resource assessment; big data; cloud computing intelligence system; hadoop MapReduce; GPU parallel computing;
D O I
10.4028/www.scientific.net/AMM.475-476.306
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Geological data with phyletic and various, huge and complex data format, the analysis of geological data processing is mainly divided into three parts: Mines forecast, mine evaluation and mine positioning. Traditional geological data analysis model is limited by limited storage space and computational efficiency, and cannot meet the needs of a large number of geological data fast operations. "Big data technology" provides the ideal solution to the vast amounts of geological data management, information extraction, and comprehensive analysis. For mass storage capacity and high-speed computing power that the "big data technology" need, we built an intelligence systems applied to the analysis of geological data based on MapReduce and GPU double parallel processing cloud computing model. For a large number of geological data, using liadoop cluster system to solve the problem of large amounts of data storage, and designing efficient parallel processing method based on GPU (Graphics Processing Units: calculation of Graphics Processing unit), the method was applied to MapReduce framework, finally completing MapReduce and GPU double parallel processing cloud computing model to improve the operation speed of the system. Through theoretical modeling and experimental verification, indicating that the system can meet the analysis of geological data operation precision, the operation data amount and the operation speed.
引用
收藏
页码:306 / +
页数:2
相关论文
共 50 条
  • [1] Cloud Computing for Big Data Processing
    Li, Xiaofang
    Zhuang, Yanbin
    Yang, Simon X.
    [J]. INTELLIGENT AUTOMATION AND SOFT COMPUTING, 2017, 23 (04): : 545 - 546
  • [2] Big Data Processing in Cloud Computing Environments
    Ji, Changqing
    Li, Yu
    Qiu, Wenming
    Awada, Uchechukwu
    Li, Keqiu
    [J]. PROCEEDINGS OF THE 2012 12TH INTERNATIONAL SYMPOSIUM ON PERVASIVE SYSTEMS, ALGORITHMS, AND NETWORKS (I-SPAN 2012), 2012, : 17 - 23
  • [3] Big Data Processing in Cloud Computing Environments
    Noraziah, A.
    Fakherldin, Mohammed Adam Ibrahim
    Adam, Khalid
    Majid, Mazlina Abdul
    [J]. ADVANCED SCIENCE LETTERS, 2017, 23 (11) : 11092 - 11095
  • [4] Cloud computing model for big data processing and performance optimization of multimedia communication
    Zhou, Zhicheng
    Zhao, Liang
    [J]. COMPUTER COMMUNICATIONS, 2020, 160 : 326 - 332
  • [5] Big Data Processing for Pervasive Environment in Cloud Computing
    Amato, Alba
    Di Martino, Beniamino
    Venticinque, Salvatore
    [J]. 2014 INTERNATIONAL CONFERENCE ON INTELLIGENT NETWORKING AND COLLABORATIVE SYSTEMS (INCOS), 2014, : 598 - 603
  • [6] The Modeling of Big Traffic Data Processing Based on Cloud Computing
    Zhang, Dongbo
    YanfangShou
    Xu, Jianmin
    [J]. PROCEEDINGS OF THE 2016 12TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION (WCICA), 2016, : 2394 - 2399
  • [7] Healthcare big data processing mechanisms: The role of cloud computing
    Rajabion, Lila
    Shaltooki, Abdusalam Abdulla
    Taghikhah, Masoud
    Ghasemi, Amirhossein
    Badfar, Arshad
    [J]. INTERNATIONAL JOURNAL OF INFORMATION MANAGEMENT, 2019, 49 : 271 - 289
  • [8] Application Of Cloud Computing In Biomedicine Big Data Analysis Cloud Computing In Big Data
    Yang, Tianyi
    Zhao, Yang
    [J]. 2017 INTERNATIONAL CONFERENCE ON ALGORITHMS, METHODOLOGY, MODELS AND APPLICATIONS IN EMERGING TECHNOLOGIES (ICAMMAET), 2017,
  • [9] Cloud Computing and Big Data
    Hsu, Ching-Hsien
    Tang, Chunming
    Esteves, Rui M.
    [J]. JOURNAL OF INTERNET TECHNOLOGY, 2014, 15 (06): : 995 - 997
  • [10] Data Processing in Cloud Computing Model on the Example of Salesforce Cloud
    Maranda, Witold
    Poniszewska-Maranda, Aneta
    Szymczynska, Malgorzata
    [J]. INFORMATION, 2022, 13 (02)