A Service-Oriented Framework for ETL Implementation

被引:2
|
作者
Oliveira, Bruno [1 ]
Leite, Mario [1 ]
Oliveira, Oscar [1 ]
Belo, Orlando [2 ]
机构
[1] Porto Polytech, Sch Management & Technol, CIICESI, Felgueiras, Portugal
[2] Univ Minho, ALGORITMI R&D Ctr, Campus Gualtar, Braga, Portugal
关键词
Analytical systems; ETL patterns; Service-oriented approach; ETL as a service;
D O I
10.1007/978-3-031-16474-3_52
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The development of analytical systems imposes several challenges related not only to the amount and heterogeneity of the involved data but also to the constant need to readapt and evolve to overcome new business challenges. The data modelling layer represents the mapping between the domain and technical knowledge, however, to organize raw data into a form that can be used for analytics, specific Extract, Transform and Load (ETL) processes should be applied. ETL systems are recognized as a critical and tightly coupled system component that encapsulates data-level requirements that are hard to implement and maintain. In a Big Data era, adaptability and extensibility are important characteristics to hold when developing analytical systems. Thus, to provide more consistent, reliable, flexible, and reusable ETL processes, a service-oriented implementation for ETL development is proposed.
引用
收藏
页码:636 / 647
页数:12
相关论文
共 50 条
  • [1] ETL Development using Patterns: A Service-Oriented Approach
    Oliveira, Bruno
    Oliveira, Oscar
    Santos, Vasco
    Belo, Orlando
    [J]. PROCEEDINGS OF THE 21ST INTERNATIONAL CONFERENCE ON ENTERPRISE INFORMATION SYSTEMS (ICEIS), VOL 1, 2019, : 216 - 222
  • [2] A service-oriented context-awareness reasoning framework and its implementation
    Cheng, Xiufeng
    Yang, Jinqing
    Xia, Lixin
    [J]. ELECTRONIC LIBRARY, 2018, 36 (06): : 1114 - 1134
  • [3] A service management framework for service-oriented enterprises
    Huang, Y
    Kumaran, S
    Chung, JY
    [J]. CEC 2004: IEEE INTERNATIONAL CONFERENCE ON E-COMMERCE TECHNOLOGY, PROCEEDINGS, 2004, : 181 - 186
  • [4] A SERVICE-ORIENTED FRAMEWORK FOR MAS MODELING
    Yves, Wautelet
    Youssef, Achbany
    Manuel, Kolp
    [J]. ICEIS 2008: PROCEEDINGS OF THE TENTH INTERNATIONAL CONFERENCE ON ENTERPRISE INFORMATION SYSTEMS, VOL ISAS-1: INFORMATION SYSTEMS ANALYSIS AND SPECIFICATION, VOL 1, 2008, : 120 - 128
  • [5] A modeling framework for service-oriented architecture
    Zhang, Tao
    Ying, Shi
    Cao, Sheng
    Jia, Xiangyang
    [J]. QSIC 2006: SIXTH INTERNATIONAL CONFERENCE ON QUALITY SOFTWARE, PROCEEDINGS, 2006, : 219 - +
  • [6] Research on service-Oriented software framework
    Li, Y
    Wu, ZH
    Deng, SG
    [J]. GRID AND COOPERATIVE COMPUTING GCC 2004 WORKSHOPS, PROCEEDINGS, 2004, 3252 : 27 - 35
  • [7] A service-oriented trust management framework
    Dimitrakos, T
    [J]. TRUST, REPUTATION, AND SECURITY: THEORIES AND PRACTICE, 2003, 2631 : 53 - 72
  • [8] Service-oriented framework for Internet applications
    Shan, Tony C.
    Hua, Winnie W.
    [J]. IEEE INTERNATIONAL CONFERENCE ON SERVICE-ORIENTED COMPUTING AND APPLICATIONS, PROCEEDINGS, 2007, : 295 - +
  • [9] Service-oriented workflow: The DySCo framework
    Piccinelli, G
    Finkelstein, A
    Williams, SL
    [J]. PROCEEDINGS OF THE 29TH EUROMICRO CONFERENCE: NEW WAVES IN SYSTEM ARCHITECTURE, 2003, : 291 - 297
  • [10] A Framework for Clarifying Service-Oriented Notions
    Terlouw, Linda I.
    Dietz, Jan L. G.
    [J]. ENTERPRISE MODELLING AND INFORMATION SYSTEMS ARCHITECTURES-AN INTERNATIONAL JOURNAL, 2010, 5 (01): : 26 - 43