Efficient data access and performance improvement model for virtual data warehouse

被引:6
|
作者
Khan, Fakhri Alam [1 ]
Ahmad, Awais [1 ]
Imran, Muhammad [2 ]
Alharbi, Mafawez [3 ]
Mujeeb-ur-Rehman [1 ]
Jan, Bilal [2 ]
机构
[1] Imsci Peshawar, Ctr Excellence IT, Peshawar, Pakistan
[2] Sarhad Univ Sci & Technol, Peshawar, Pakistan
[3] Majmaah Univ, Comp Sci Dept, Coll Sci, Al Majmaah, Saudi Arabia
关键词
Business intelligence; OLTP; Performance optimization; Query optimization; Virtual data warehouse;
D O I
10.1016/j.scs.2017.08.003
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
This paper presents a model for improving query performance in Virtual Data Warehouse (VDW) by simulating VDW environment on a cellular phone billing and customer care system which involves processing millions of Call Detail Records (CDRs) generated by thousands of counters across the country. Processing aggregations on millions of CDRs requires expensive systems, especially when analysing customers' traffic trends and encompasses several performance optimization techniques used for improvement of query performance in VDW. In this regard, VDW offers several advantages such as real-time analytic reports, reduced maintenance, low cost solution and flexible data integration, but performance is still one of its critical shortcomings. This paper enhances performance of VDW by using techniques like partitioned materialized views, index performance optimization, query rewrite in materialized views, analytic functions, sub-queries and enabling parallel execution etc.Thestudy uses Oracle 10 g as a backend database; Oracle management console and SQL query analyser are used for monitoring performance concerns during validation of VDW model; standard PL/SQL developer is used for extracting and loading test data; and finally, Hyperion Development suite is used for testing time comparisons of datasets both in normal OLTP and simulated VDW environments.
引用
收藏
页码:232 / 240
页数:9
相关论文
共 50 条
  • [21] Improvement of Prediction Performance for Data-Driven Virtual Sensors
    Dementjev, Alexander
    Ribbecke, Heinz-Dieter
    Kabitzsch, Klaus
    [J]. 2010 IEEE CONFERENCE ON EMERGING TECHNOLOGIES AND FACTORY AUTOMATION (ETFA), 2010,
  • [22] Efficient Join Synopsis Maintenance for Data Warehouse
    Zhao, Zhuoyue
    Li, Feifei
    Liu, Yuxi
    [J]. SIGMOD'20: PROCEEDINGS OF THE 2020 ACM SIGMOD INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, 2020, : 2027 - 2042
  • [23] Maintenance strategy for efficient communication at data warehouse
    Leel, HC
    Bae, SH
    [J]. COMPUTATIONAL SCIENCE AND ITS APPLICATIONS - ICCSA 2004, PT 2, 2004, 3044 : 186 - 195
  • [24] High performance analytical data reconstructing strategy in data warehouse
    Xia, XF
    Li, Q
    Xu, LY
    Sun, WD
    Shi, SX
    Yu, G
    [J]. Current Trends in High Performance Computing and Its Applications, Proceedings, 2005, : 527 - 531
  • [25] Research on Efficient Data Warehouse Construction Methods for Big Data Applications
    Zhao, Chenggang
    Du, Junwei
    Wang, Furong
    Li, Haojie
    [J]. Applied Mathematics and Nonlinear Sciences, 2024, 9 (01)
  • [26] Efficient Data Organisation in Distributed Computer Systems using Data Warehouse
    Cosma, S.
    Valeanu, M.
    Cosma, D.
    Moldovan, G.
    Vasilescu, D.
    [J]. INTERNATIONAL JOURNAL OF COMPUTERS COMMUNICATIONS & CONTROL, 2013, 8 (03) : 366 - 374
  • [27] Using ETL Tools for Developing a Virtual Data Warehouse
    Kholod, Ivan I.
    Efimova, Maria S.
    Kulikov, Sergey Ya.
    [J]. PROCEEDINGS OF THE XIX IEEE INTERNATIONAL CONFERENCE ON SOFT COMPUTING AND MEASUREMENTS (SCM 2016), 2016, : 351 - 354
  • [28] Discussion of metadata model in data warehouse
    Luo, Changlong
    Huang, Zilong
    [J]. Nanjing Youdian Xueyuan Xuebao/Journal of Nanjing Institute of Posts and Telecommunications, 2000, 20 (04): : 80 - 83
  • [30] Efficient approach for view materialisation in a data warehouse by prioritising data cubes
    Gosain, Anjana
    Madaan, Heena
    [J]. IET SOFTWARE, 2018, 12 (06) : 498 - 506