RESEARCH ON INTEGRATION AND SHARING SOLUTIONS FOR BIG STRUCTURED DATA FOR THE MARINE ENVIRONMENT

被引:1
|
作者
Wang, Wei [1 ]
Cheng, Wenfang [2 ]
Chen, Jing [1 ]
Yu, Ya-Nan [1 ]
Zhang, Jianxun [1 ]
机构
[1] Tianjin Univ Technol & Educ, Coll Informat Engn, Tianjin, Peoples R China
[2] State Ocean Adm, Polar Res Inst China, Shanghai, Peoples R China
来源
基金
中国国家自然科学基金;
关键词
marine big data; integration; sharing;
D O I
10.6119/JMST-017-1226-21
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
The data-intensive science, a new paradigm in scientific discovery, demands an urgent solution to integrate and share big marine environment data. Through the modeling of marine environmental features (such as Temperature, Salinity, Density et al.), a novel solution is presented in this paper. This solution employs Hadoop and Hbase, based on the Bigtable algorithm first proposed by Google Inc. By using hierarchical technology, scalability of the data integration framework is realized. Additionally, an efficient execution of various queries is realized by using the customized auxiliary index algorithm. In the experimental cluster environment constructed from four ordinary personal computers, experiments involving a huge amount of structured marine environmental data importing, cost-effective storage, and query processing were carried out successfully. The experimental results indicate that this solution to storing and sharing big data for the marine environment has the property of infinite lateral expansion, and is able to execute efficient and complicated query operations.
引用
收藏
页码:791 / 801
页数:11
相关论文
共 50 条
  • [21] In Search of Big Medical Data Integration Solutions - A Comprehensive Survey
    Dhayne, Houssein
    Haque, Rafiqul
    Kilany, Rima
    Taher, Yehia
    [J]. IEEE ACCESS, 2019, 7 : 91265 - 91290
  • [22] INITIATIVES AND CHALLENGES TO PROVIDE AN ENVIRONMENT FOR SHARING AND ANALYSIS OF CORPORATE DATA: BIG DATA PE
    Luizines Van Leijden, Eronita Maria
    dos Santos Bueno, Cassiane de Fatima
    d'Amorim, Flavia Danzi
    Marques Silva, Marcio Alexandre
    [J]. REVISTA DO SERVICO PUBLICO, 2022, 73 : 26 - 48
  • [23] Against Dataism and for Data Sharing of Big Biomedical and Clinical Data with Research Parasites
    Emmert-Streib, Frank
    Dehmer, Matthias
    Yli-Harja, Olli
    [J]. FRONTIERS IN GENETICS, 2016, 7
  • [24] The Integration of Marine Biodiversity Information Resources Based on Big Data Technology
    Meng, Yinghui
    Chen, Yuewen
    Zhu, Fubao
    Tian, Erlin
    [J]. JOURNAL OF COASTAL RESEARCH, 2020, : 806 - 811
  • [25] A data model-independent approach to big research data integration
    Bartalesi, Valentina
    Meghini, Carlo
    Thanos, Costantino
    [J]. International Journal of Metadata, Semantics and Ontologies, 2019, 13 (04): : 330 - 345
  • [26] Research on Knowledge Collaboration System in Big Data Environment
    Jia, Lin
    Liu, Qing
    Zhou, He-yu
    Guo, Qing-rong
    [J]. INTERNATIONAL CONFERENCE ON SOCIAL, EDUCATION AND MANAGEMENT ENGINEERING (SEME 2014), 2014, : 518 - 522
  • [27] Research on the Integration Technology of Marine Environmental Protection Data
    Ye, Na
    Qin, Rufu
    [J]. COMPUTER AND INFORMATION TECHNOLOGY, 2014, 519-520 : 21 - 27
  • [28] Effect Evaluation of Eco-Environmental Big Data Resource Integration and Data Sharing Construction
    Fan, Yongqiang
    Long, Shijun
    Zhang, Ruobing
    Ge, Cheng
    Zhang, Yonggang
    Zhang, Qingsong
    [J]. Wireless Communications and Mobile Computing, 2022, 2022
  • [29] Big data in autism research: Methodological challenges and solutions
    Lee, Brian K.
    Schendel, Diana E.
    Shea, Lindsay L.
    [J]. AUTISM RESEARCH, 2023, 16 (10) : 1852 - 1858
  • [30] Effect Evaluation of Eco-Environmental Big Data Resource Integration and Data Sharing Construction
    Fan, Yongqiang
    Long, Shijun
    Zhang, Ruobing
    Ge, Cheng
    Zhang, Yonggang
    Zhang, Qingsong
    [J]. WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2022, 2022