Design of Marine Data Warehouse ETL System

被引:1
|
作者
Wen WeiJun [1 ]
机构
[1] Ocean Univ China, Dept Marine Technol, Qingdao 266100, Peoples R China
来源
MECHANICAL COMPONENTS AND CONTROL ENGINEERING III | 2014年 / 668-669卷
关键词
data warehouse; ETL; marine data; data cleaning; data extracting; data transformation;
D O I
10.4028/www.scientific.net/AMM.668-669.1374
中图分类号
TH [机械、仪表工业];
学科分类号
0802 ;
摘要
ETL refers to the process of data extracting, transformation and loading and is deemed as a critical step in ensuring the quality, data specification and standardization of marine environmental data. Marine data, due to their complication, field diversity and huge volume, still remain decentralized, polyphyletic and isomerous with different semantics and hence far from being able to provide effective data sources for decision making. ETL enables the construction of marine environmental data warehouse in the form of cleaning, transformation, integration, loading and periodic updating of basic marine data warehouse. The paper presents a research on rules for cleaning, transformation and integration of marine data, based on which original ETL system of marine environmental data warehouse is so designed and developed. The system further guarantees data quality and correctness in analysis and decision-making based on marine environmental data in the future.
引用
收藏
页码:1374 / 1377
页数:4
相关论文
共 50 条
  • [31] An improved join-free snowflake schema for ETL and OLAP of data warehouse
    Wang Jianmin
    Zhao Wenbin
    Fan Tongrang
    Yang Shilong
    Lv Hongwei
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2020, 32 (23):
  • [32] Implementation of Change Data Capture in ETL Process for Data Warehouse Using HDFS and Apache Spark
    Denny
    Atmaja, I. Pulu Medagia
    Saptawijaya, Ali
    Aminah, Siti
    2017 INTERNATIONAL WORKSHOP ON BIG DATA AND INFORMATION SECURITY (IWBIS 2017), 2017, : 49 - 55
  • [33] Web services-based virtual data warehouse as an integration and ETL tool
    Boreisha, Y
    Myronovych, O
    ISWS '05: Proceedings of the 2005 International Symposium on Web Services and Applications, 2005, : 52 - 58
  • [34] Data Warehouse and Data Mining Based on Marine Environment
    Dong, Xiaowei
    JOURNAL OF COASTAL RESEARCH, 2020, : 394 - 397
  • [35] Data Warehouse Design Considerations for a Healthcare Business Intelligence System
    George, Joseph
    Kumar, B. Vijay
    Kumar, V. Santhosh
    WORLD CONGRESS ON ENGINEERING, WCE 2015, VOL I, 2015, : 308 - 311
  • [36] Sale Decision Analysis System Design Based on Data Warehouse
    Yu, Changhui
    2016 INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION, BIG DATA & SMART CITY (ICITBS), 2017, : 468 - 471
  • [37] Design of distributed data warehouse for humanized clothing recommendation system
    Xie, Yinggang
    Wang, Zhiliang
    Ping, An
    Ten, Shaodong
    Nagai, Masatake
    Journal of Computational Information Systems, 2007, 3 (02): : 643 - 648
  • [38] Data Warehouse Design for Croatian Students' Nourishment Information System
    Milanovic, Nenad
    Soskic, Goran
    Petkovic, Ana
    PROCEEDINGS OF THE ITI 2009 31ST INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY INTERFACES, 2009, : 193 - 198
  • [39] Research on the Data Warehouse in the Design Process of the Database Application System
    Ma, Guojun
    PROCEEDINGS OF THE 2015 4TH INTERNATIONAL CONFERENCE ON COMPUTER, MECHATRONICS, CONTROL AND ELECTRONIC ENGINEERING (ICCMCEE 2015), 2015, 37 : 50 - 54
  • [40] Design of Early warning system of agricultural products in the Data Warehouse
    Zhou Lijuan
    Li Kang
    He Xiaoxu
    HIGH PERFORMANCE STRUCTURES AND MATERIALS ENGINEERING, PTS 1 AND 2, 2011, 217-218 : 656 - 661