Cloud Computing Model for Big Geological Data Processing

被引:4
|
作者
Song, Miaomiao [1 ]
Li, Zhe [1 ]
Zhou, Bin [1 ]
Li, Chaoling [2 ]
机构
[1] Shandong Acad Sci, Inst Oceanog Instrumentat, Qingdao, Peoples R China
[2] China Geol Survey, Res Dev Ctr, Beijing, Peoples R China
关键词
geological data analysis; mining area resource assessment; big data; cloud computing intelligence system; hadoop MapReduce; GPU parallel computing;
D O I
10.4028/www.scientific.net/AMM.475-476.306
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Geological data with phyletic and various, huge and complex data format, the analysis of geological data processing is mainly divided into three parts: Mines forecast, mine evaluation and mine positioning. Traditional geological data analysis model is limited by limited storage space and computational efficiency, and cannot meet the needs of a large number of geological data fast operations. "Big data technology" provides the ideal solution to the vast amounts of geological data management, information extraction, and comprehensive analysis. For mass storage capacity and high-speed computing power that the "big data technology" need, we built an intelligence systems applied to the analysis of geological data based on MapReduce and GPU double parallel processing cloud computing model. For a large number of geological data, using liadoop cluster system to solve the problem of large amounts of data storage, and designing efficient parallel processing method based on GPU (Graphics Processing Units: calculation of Graphics Processing unit), the method was applied to MapReduce framework, finally completing MapReduce and GPU double parallel processing cloud computing model to improve the operation speed of the system. Through theoretical modeling and experimental verification, indicating that the system can meet the analysis of geological data operation precision, the operation data amount and the operation speed.
引用
收藏
页码:306 / +
页数:2
相关论文
共 50 条
  • [41] pipsCloud: High performance cloud computing for remote sensing big data management and processing
    Wang, Lizhe
    Ma, Yan
    Yan, Jining
    Chang, Victor
    Zomaya, Albert Y.
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2018, 78 : 353 - 368
  • [42] Advances in cloud computing and big data analytics
    Dong, Fang
    Shen, Jun
    He, Qiang
    [J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2018, 30 (20):
  • [43] On the Use of Cloud Computing for Big Data Mining
    Talia, Domenico
    [J]. 2017 6TH INTERNATIONAL CONFERENCE ON RELIABILITY, INFOCOM TECHNOLOGIES AND OPTIMIZATION (TRENDS AND FUTURE DIRECTIONS) (ICRITO), 2017, : 39 - 40
  • [44] Big data analytics in Cloud computing: an overview
    Berisha, Blend
    Meziu, Endrit
    Shabani, Isak
    [J]. JOURNAL OF CLOUD COMPUTING-ADVANCES SYSTEMS AND APPLICATIONS, 2022, 11 (01):
  • [45] Cloud Computing: The Future of Big Data Management
    Ouf, Shimaa
    Nasr, Mona
    [J]. INTERNATIONAL JOURNAL OF CLOUD APPLICATIONS AND COMPUTING, 2015, 5 (02) : 53 - 61
  • [46] Challenges and Opportunities in Big Data and Cloud Computing
    Sohail, Hassan
    Zameer, Zeenia
    Ahmed, Hafiz Farhan
    Iqbal, Usama
    Shah, Pir Amad Ali
    [J]. FUTURE INTELLIGENT VEHICULAR TECHNOLOGIES, FUTURE 5V 2016, 2017, 185 : 175 - 181
  • [47] Big data analytics in Cloud computing: an overview
    Blend Berisha
    Endrit Mëziu
    Isak Shabani
    [J]. Journal of Cloud Computing, 11
  • [48] A survey of big data for IoT in cloud computing
    Cao, Junkuo
    Lin, Mingcai
    Ma, Xiaojin
    [J]. Ma, Xiaojin (xjma@shu.edu.cn), 1600, International Association of Engineers (47): : 585 - 592
  • [49] Modeling and simulation of cloud computing and big data
    Karatza, Helen D.
    Stavrinides, Georgios L.
    [J]. SIMULATION MODELLING PRACTICE AND THEORY, 2019, 93 (1-2) : 1 - 2
  • [50] Big Data Cleaning Algorithms in Cloud Computing
    Feng, Zhang
    Hui-Feng, Xue
    Dong-Sheng, Xu
    Yong-Heng, Zhang
    Fei, You
    [J]. INTERNATIONAL JOURNAL OF ONLINE ENGINEERING, 2013, 9 (03) : 77 - 81