Design of Marine Data Warehouse ETL System

被引：1
|
作者：
Wen WeiJun [1 ]
机构：
[1] Ocean Univ China, Dept Marine Technol, Qingdao 266100, Peoples R China
来源：
MECHANICAL COMPONENTS AND CONTROL ENGINEERING III | 2014年 / 668-669卷
关键词：
data warehouse; ETL; marine data; data cleaning; data extracting; data transformation;
D O I：
10.4028/www.scientific.net/AMM.668-669.1374
中图分类号：
TH [机械、仪表工业];
学科分类号：
0802 ;
摘要：
ETL refers to the process of data extracting, transformation and loading and is deemed as a critical step in ensuring the quality, data specification and standardization of marine environmental data. Marine data, due to their complication, field diversity and huge volume, still remain decentralized, polyphyletic and isomerous with different semantics and hence far from being able to provide effective data sources for decision making. ETL enables the construction of marine environmental data warehouse in the form of cleaning, transformation, integration, loading and periodic updating of basic marine data warehouse. The paper presents a research on rules for cleaning, transformation and integration of marine data, based on which original ETL system of marine environmental data warehouse is so designed and developed. The system further guarantees data quality and correctness in analysis and decision-making based on marine environmental data in the future.
引用
收藏
页码：1374 / 1377
页数：4
相关论文
共 50 条
  • [11] Using ETL Tools for Developing a Virtual Data Warehouse
    Kholod, Ivan I.
    Efimova, Maria S.
    Kulikov, Sergey Ya.
    PROCEEDINGS OF THE XIX IEEE INTERNATIONAL CONFERENCE ON SOFT COMPUTING AND MEASUREMENTS (SCM 2016), 2016, : 351 - 354
  • [12] Modeling ETL Process in Data warehouse: An Exploratory Study
    Sharma, Sonal
    Jain, Rajni
    2014 FOURTH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTING AND COMMUNICATION TECHNOLOGIES (ACCT 2014), 2014, : 271 - +
  • [13] An ETL Strategy for Real-Time Data Warehouse
    Zhou, Haihe
    Yang, Dingyu
    Xu, Yang
    PRACTICAL APPLICATIONS OF INTELLIGENT SYSTEMS, 2011, 124 : 329 - +
  • [14] RESEARCH ON THE DESIGN OF WEB DATA WAREHOUSE BASED ON ETL META DATA MODEL AND PARTICLE SWARM OPTIMISATION
    Jun-Zhou, Li
    Nan, Yu
    JOURNAL OF THE BALKAN TRIBOLOGICAL ASSOCIATION, 2016, 22 (02): : 1184 - 1192
  • [15] DATA MIGRATION FROM A PRODUCT TO A DATA WAREHOUSE USING ETL TOOL
    Shrinivasan, Chandrika
    14TH EUROPEAN CONFERENCE ON SOFTWARE MAINTENANCE AND REENGINEERING (CSMR 2010), 2010, : 63 - 65
  • [16] Research of data quality assurance about ETL of telecom data warehouse
    Wei, S., 1839, Asian Network for Scientific Information (12):
  • [17] Design and Implementation of ETL Strategy in Tele-Communication Based on the Tool of Teradata Data Warehouse
    Zhang Qinhe
    Li Min
    2011 INTERNATIONAL CONFERENCE ON FUTURE MANAGEMENT SCIENCE AND ENGINEERING (ICFMSE 2011), VOL 1, 2011, 5 : 31 - 36
  • [18] Warehouse design for marine products storing warehouse
    Hwang, Heung Suk
    Bae, Suk-Tae
    Cho, Gyu-Sung
    PROCEEDING OF THE SEVENTH INTERNATIONAL CONFERENCE ON INFORMATION AND MANAGEMENT SCIENCES, 2008, 7 : 741 - 741
  • [19] Applying ETL Fuzzy Filter for Data Warehouse Size Minimization
    Zacek, Jaroslav
    Hunka, Frantisek
    PROCEEDINGS OF THE INTERNATIONAL CONFERENCE OF NUMERICAL ANALYSIS AND APPLIED MATHEMATICS 2014 (ICNAAM-2014), 2015, 1648
  • [20] Research on the Design of a New Data Warehouse System
    Qiang, Song
    Liu, Lingxia
    2009 2ND IEEE INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND INFORMATION TECHNOLOGY, VOL 4, 2009, : 462 - +
12345