A New Approach for Integrating Data into Big Data Warehouse

被引：2

作者：

Hilali, Intissar ^{[1
]}

Arfaoui, Nouha ^{[2
]}

Ejbali, Ridha ^{[2
]}

机构：

[1] Univ Gabes, Fac Sci Gabes, Gabes, Tunisia

[2] Res Team Intelligent Machines RTIM Gabes, Gabes, Tunisia

来源：

FOURTEENTH INTERNATIONAL CONFERENCE ON MACHINE VISION (ICMV 2021) | 2022年 / 12084卷

关键词：

Data Warehouse; Big Data; Mapping; Extraction; Transformation; Loading; Volume; Variety; Velocity;

D O I：

10.1117/12.2623069

中图分类号：

O43 [光学];

学科分类号：

070207 ; 0803 ;

摘要：

ETL process is responsible of the integration of data into the data warehouse. It is about extracting data from different sources, transforming it to deliver quality data of value for analysis, and loading it into the warehouse. In this context, we propose a new approach called Mapping-ELT (M-ELT) is suggested to deal with ELT basic operations and take into account the semantic heterogeneity. In order to accelerate data handling, the Hive is used to improve data warehousing capabilities and Ontology as a solution to treat the problems of semantic heterogeneity. Experimental results confirm that the ELT operation works well, particularly with adapted operations.

引用

页数：6

共 50 条

[1] On the Research of Data Warehouse in Big Data
Qin, Hai-fei
Qian, Zhi-ming
Zhao, Yong-chao
[J]. 2015 INTERNATIONAL CONFERENCE ON NETWORK AND INFORMATION SYSTEMS FOR COMPUTERS (ICNISC), 2015, : 354 - 357
[2] Integrating and managing temporal data in a data warehouse
Shin, YO
Baik, DK
Ryu, KH
Lee, JY
[J]. INTERNATIONAL SOCIETY FOR COMPUTERS AND THEIR APPLICATIONS 13TH INTERNATIONAL CONFERENCE ON COMPUTERS AND THEIR APPLICATIONS, 1998, : 186 - 189
[3] Big Data Augmentation with Data Warehouse: A Survey
Aftab, Umar
Siddiqui, Ghazanfar Farooq
[J]. 2018 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2018, : 2785 - 2794
[4] Data Warehouse Design for Big Data in Academia
Rudniy, Alex
[J]. CMC-COMPUTERS MATERIALS & CONTINUA, 2022, 71 (01): : 979 - 992
[5] A new process for healthcare big data warehouse integration
Arfaoui, Nouha
[J]. INTERNATIONAL JOURNAL OF DATA MINING MODELLING AND MANAGEMENT, 2023, 15 (03) : 240 - 254
[6] Big Data Augmentation with Data Warehouse: A Survey
Aftab, Umar
Siddiqui, Ghazanfar Farooq
[J]. 2018 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2018, : 2775 - 2784
[7] An approach for integrating heterogeneous information sources in a medical data warehouse
Kerkri E.M.
Quantin C.
Allaert F.A.
Cottin Y.
Charve P.
Jouanot F.
Yétongnon K.
[J]. Journal of Medical Systems, 2001, 25 (3) : 167 - 176
[8] Integrating Web-based data into a data warehouse
Huang, ZY
Chen, LD
Frolick, MN
[J]. INFORMATION SYSTEMS MANAGEMENT, 2002, 19 (01) : 23 - 34
[9] Data Warehouse with Big Data Technology for Higher Education
Santoso, Leo Willyanto
Yulia
[J]. 4TH INFORMATION SYSTEMS INTERNATIONAL CONFERENCE (ISICO 2017), 2017, 124 : 93 - 99
[10] Designing and Implementing Data Warehouse for Agricultural Big Data
Ngo, Vuong M.
Le-Khac, Nhien-An
Kechadi, M-Tahar
[J]. BIG DATA - BIGDATA 2019, 2019, 11514 : 1 - 17

← 1 2 3 4 5 →