Improving the Quality Validation of the ETL Process using Test Automation

被引:0
|
作者
Staegemann, Daniel [1 ]
Volk, Matthias [1 ]
Jamous, Naoum [1 ]
Venkatesh, Ranjan [1 ]
Hart, Stefan Willi [1 ]
Bosse, Sascha [1 ]
Turowski, Klaus [1 ]
机构
[1] Otto von Guericke Univ, Magdeburg, Germany
来源
关键词
Big Data; Testing; Validation; ETL; Data Lake; Data Warehouse; Automation; BIG DATA; DESIGN; PERFORMANCE; SYSTEMS;
D O I
暂无
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Due to the growing amount of data that are produced, the concept of big data analytics gained plenty of interest among researchers and practitioners. However, there are many challenges related to its use. One of those is the data storing and subsequently the corresponding extraction of required data. Since this process is prone to error, it requires thorough quality validation. To facilitate this procedure, an automated approach is proposed, using the example of a financial institution, replacing its formerly applied manual method. As a result, the time needed for a complete factory acceptance test could be reduced by 39 percent.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Improving UI Test Automation using Robotic Process Automation
    Cernat, Marina
    Staicu, Adelina-Nicoleta
    Stefanescu, Alin
    [J]. ICSOFT: PROCEEDINGS OF THE 15TH INTERNATIONAL CONFERENCE ON SOFTWARE TECHNOLOGIES, 2020, : 260 - 267
  • [2] Data Validation in ETL Using TALEND
    Sreemathy, J.
    Priyadharshini, S.
    Radha, K.
    Sangeerna, K.
    Nivetha, G.
    [J]. 2019 5TH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTING & COMMUNICATION SYSTEMS (ICACCS), 2019, : 1183 - 1186
  • [3] Improving the Web usage analysis process: A UML model of the ETL process
    Maier, Thilo
    [J]. ADVANCES IN WEB MINING AND WEB USAGE ANALYSIS, 2006, 3932 : 18 - 36
  • [4] Data quality in ETL process: A preliminary study
    Souibgui, Manel
    Atigui, Faten
    Zammali, Saloua
    Cherfi, Samira
    Ben Yahia, Sadok
    [J]. KNOWLEDGE-BASED AND INTELLIGENT INFORMATION & ENGINEERING SYSTEMS (KES 2019), 2019, 159 : 676 - 687
  • [5] Data generator for evaluating ETL process quality
    Theodorou, Vasileios
    Jovanovic, Petar
    Abello, Alberto
    Nakuci, Emona
    [J]. INFORMATION SYSTEMS, 2017, 63 : 80 - 100
  • [6] Improving test quality using test data compression
    Mukherjee, N
    [J]. 14TH ASIAN TEST SYMPOSIUM, PROCEEDINGS, 2005, : 463 - 463
  • [7] Improving Corporate Secretary Productivity using Robotic Process Automation
    William, Woelly
    William, Linda
    [J]. 2019 INTERNATIONAL CONFERENCE ON TECHNOLOGIES AND APPLICATIONS OF ARTIFICIAL INTELLIGENCE (TAAI), 2019,
  • [8] QUALITY MEASURES FOR ETL PROCESS MODELS IN DATA WAREHOUSES
    Munoz, Lilia
    Pardillo, Jesus
    Mazon, Jose-Norberto
    Trujillo, Juan
    [J]. SISTEMAS E TECHNOLOGIAS DE INFORMACAO: ACTAS DA 4A CONFERENCIA IBERICA DE SISTEMAS E TECNOLOGIAS DE LA INFORMACAO, 2009, : 49 - +
  • [9] Improving the die cast process with automation
    Gaby, M
    Pierson, J
    Wise, L
    [J]. DIE CASTING ENGINEER, 2000, 44 (05): : 50 - +
  • [10] SERVICE QUALITY EVALUATION USING ROBOTIC PROCESS AUTOMATION TOOLS
    Negoiţă, Radu Florin
    Borangiu, Theodor
    [J]. UPB Scientific Bulletin, Series C: Electrical Engineering and Computer Science, 2023, 85 (03): : 93 - 108