An On-Demand ELT Architecture for Real-Time BI

被引：0

作者：

Freudenreich, Tobias ^{[1
]}

Furtado, Pedro ^{[2
]}

Koncilia, Christian ^{[3
]}

Thiele, Maik ^{[4
]}

Waas, Florian ^{[5
]}

Wrembel, Robert ^{[6
]}

机构：

[1] Tech Univ Darmstadt, Darmstadt, Germany

[2] Univ Coimbra, P-3000 Coimbra, Portugal

[3] Univ Klagenfurt, Klagenfurt, Austria

[4] Tech Univ Dresden, Dresden, Germany

[5] EMC, Greenplum, San Mateo, CA USA

[6] Poznan Univ Tech, Poznan, Poland

来源：

ENABLING REAL-TIME BUSINESS INTELLIGENCE, VLDB 2012 | 2013年 / 154卷

关键词：

Real-time BI; ETL; ELT; Materialized Views;

D O I：

暂无

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

Online or real-time BI has remained elusive despite significant efforts by academic and industrial research. Some of the most prominent problems in accomplishing faster turnaround are related to the data ingest. The process of extracting data from source systems, transforming, and loading (ETL) it is often bottlenecked by architectural choices and fragmentation of the processing chain. In this paper, we present a vision for a resource-efficient infrastructure that enables just-in-time processing with regards to data ingest. At the heart of our approach are (1) the converting of compute intensive parts of the ETL process into in-database processing and (2) the activating of the process on demand via a system of flexible views. Our approach avoids processing of data that is not being accessed any time soon, scales effectively with the database system and avoids administration and management overhead.

引用

页码：50 / 59

页数：10

共 50 条

[31] Enabling on-demand real-time functional MRI analysis using grid technology
Bagarinao, E
Matsuo, K
Tanaka, Y
Sarmenta, LFG
Nakai, T
[J]. METHODS OF INFORMATION IN MEDICINE, 2005, 44 (05) : 665 - 673
[32] Performance evaluations and estimations of workload of on-demand updates in soft real-time systems
Gustafsson, Thomas
Hansson, Jorgen
[J]. 13TH IEEE INTERNATIONAL CONFERENCE ON EMBEDDED AND REAL-TIME COMPUTING SYSTEMS AND APPLICATIONS, PROCEEDINGS, 2007, : 337 - +
[33] Real-time ridesharing operations for on-demand capacitated systems considering dynamic travel time information
Ghandeharioun, Zahra
Kouvelas, Anastasios
[J]. TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2023, 151
[34] On-demand broadcast algorithms with caching on improving response time for real-time information dispatch systems
Hui, CY
Ng, JKY
Lee, VCS
[J]. 11TH IEEE INTERNATIONAL CONFERENCE ON EMBEDDED AND REAL-TIME COMPUTING SYSTEMS AND APPLICATIONS, PROCEEDINGS, 2005, : 285 - 288
[35] Incorporating on-demand stereo for real time recognition
Deselaers, T.
Criminisi, A.
Winn, J.
Agarwal, A.
[J]. 2007 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOLS 1-8, 2007, : 1267 - +
[36] OCSM: an optimized channel split methodtowards real-time and on-demand data broadcast scheduling
Hu, Wenbin
Qiu, Zhenyu
Nie, Cong
Lin, Fu
[J]. WIRELESS NETWORKS, 2019, 25 (02) : 861 - 874
[37] Captioning on-demand and real-time web multimedia - Easy-to-use tools for educators
Smith, J
[J]. ED-MEDIA 2004: World Conference on Educational Multimedia, Hypermedia & Telecommunications, Vols. 1-7, 2004, : 5221 - 5223
[38] Data management in real-time systems: a case of on-demand updates in vehicle control systems
Gustafsson, T
Hansson, J
[J]. RTAS 2004: 10TH IEEE REAL-TIME AND EMBEDDED TECHNOLOGY AND APPLICATIONS SYMPOSIUM, PROCEEDINGS, 2004, : 182 - 191
[39] An Adaptive TTL Allocation Scheme for Real-time Live and On-Demand Personal Broadcasting Service
Kim, Namtae
You, Dongho
Jeong, Eun Young
Seo, Bong-Seok
Kim, Dong Ho
Lee, Ye Hoon
[J]. 2017 IEEE 7TH INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS - BERLIN (ICCE-BERLIN), 2017, : 51 - 52
[40] Smart wound dressing for advanced wound management: Real-time monitoring and on-demand treatment
Pang, Qian
Yang, Fang
Jiang, Zilian
Wu, Kaihao
Hou, Ruixia
Zhu, Yabin
[J]. MATERIALS & DESIGN, 2023, 229

← 1 2 3 4 5 →