RESEARCH ON INTEGRATION AND SHARING SOLUTIONS FOR BIG STRUCTURED DATA FOR THE MARINE ENVIRONMENT

被引:1
|
作者
Wang, Wei [1 ]
Cheng, Wenfang [2 ]
Chen, Jing [1 ]
Yu, Ya-Nan [1 ]
Zhang, Jianxun [1 ]
机构
[1] Tianjin Univ Technol & Educ, Coll Informat Engn, Tianjin, Peoples R China
[2] State Ocean Adm, Polar Res Inst China, Shanghai, Peoples R China
来源
基金
中国国家自然科学基金;
关键词
marine big data; integration; sharing;
D O I
10.6119/JMST-017-1226-21
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
The data-intensive science, a new paradigm in scientific discovery, demands an urgent solution to integrate and share big marine environment data. Through the modeling of marine environmental features (such as Temperature, Salinity, Density et al.), a novel solution is presented in this paper. This solution employs Hadoop and Hbase, based on the Bigtable algorithm first proposed by Google Inc. By using hierarchical technology, scalability of the data integration framework is realized. Additionally, an efficient execution of various queries is realized by using the customized auxiliary index algorithm. In the experimental cluster environment constructed from four ordinary personal computers, experiments involving a huge amount of structured marine environmental data importing, cost-effective storage, and query processing were carried out successfully. The experimental results indicate that this solution to storing and sharing big data for the marine environment has the property of infinite lateral expansion, and is able to execute efficient and complicated query operations.
引用
收藏
页码:791 / 801
页数:11
相关论文
共 50 条
  • [1] A new manufacturing resources integration and sharing modes in big data environment
    Xiang, Feng
    Chen, XiaoWu
    Jiang, GuoZhang
    [J]. PROCEEDINGS OF THE 2016 IEEE 11TH CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS (ICIEA), 2016, : 1984 - 1987
  • [2] Challenges and Solutions of Big Data Sharing
    Zhang, Zhen
    Mu, Huaiqin
    [J]. IWCMC 2021: 2021 17TH INTERNATIONAL WIRELESS COMMUNICATIONS & MOBILE COMPUTING CONFERENCE (IWCMC), 2021, : 2144 - 2148
  • [3] Systematic method for big manufacturing data integration and sharing
    Feng Xiang
    Qi Yin
    Zihan Wang
    Guo Zhang Jiang
    [J]. The International Journal of Advanced Manufacturing Technology, 2018, 94 : 3345 - 3358
  • [4] Systematic method for big manufacturing data integration and sharing
    Xiang, Feng
    Yin, Qi
    Wang, Zihan
    Jiang, Guo Zhang
    [J]. INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2018, 94 (9-12): : 3345 - 3358
  • [5] RESEARCH ON INFORMATION SHARING AND FUSION OF PUBLIC SECURITY INFORMATION UNDER BIG DATA ENVIRONMENT
    Fan, Jiaqi
    Hu, Kaixi
    Chen, Zeyan
    Li, Jiawen
    [J]. FRESENIUS ENVIRONMENTAL BULLETIN, 2022, 31 (6A): : 6115 - 6123
  • [6] Research on Key Issues of Data Integration Technology in Electric Power System in Big Data Environment
    Liu, Donglan
    Ma, Lei
    Liu, Xin
    Yu, Hao
    Tan, Hu
    Zhao, Xiaohong
    Zhao, Yong
    Lv, Guodong
    [J]. 2017 IEEE 9TH INTERNATIONAL CONFERENCE ON COMMUNICATION SOFTWARE AND NETWORKS (ICCSN), 2017, : 1368 - 1372
  • [7] Research On Sharing And Application Of Medical Big Data
    Liu, Yutao
    Cai, Hengyu
    Li, Guijie
    [J]. 2018 3RD INTERNATIONAL CONFERENCE ON SMART CITY AND SYSTEMS ENGINEERING (ICSCSE), 2018, : 771 - 774
  • [8] Research on the Mass structured Data Storage and Sorting Algorithm and Methodology for SQL Database under the Big Data Environment
    Wang, Rong
    Wu, Chunhui
    Dai, Wenhua
    [J]. PROCEEDINGS OF THE 2015 CONFERENCE ON INFORMATIZATION IN EDUCATION, MANAGEMENT AND BUSINESS, 2015, 20 : 176 - 180
  • [9] Research on Sharing System of Big Data Teaching Resources
    Dai, Zhiqiang
    [J]. PROCEEDINGS OF THE 2016 2ND INTERNATIONAL CONFERENCE ON EDUCATION TECHNOLOGY, MANAGEMENT AND HUMANITIES SCIENCE, 2016, 50 : 432 - 434
  • [10] Firework: Big Data Sharing and Processing in Collaborative Edge Environment
    Zhang, Quan
    Zhang, Xiaohong
    Zhang, Qingyang
    Shi, Weisong
    Zhong, Hong
    [J]. PROCEEDINGS OF 2016 FOURTH IEEE WORKSHOP ON HOT TOPICS IN WEB SYSTEMS AND TECHNOLOGIES (HOTWEB), 2016, : 20 - 25