Efficient data access and performance improvement model for virtual data warehouse

被引:6
|
作者
Khan, Fakhri Alam [1 ]
Ahmad, Awais [1 ]
Imran, Muhammad [2 ]
Alharbi, Mafawez [3 ]
Mujeeb-ur-Rehman [1 ]
Jan, Bilal [2 ]
机构
[1] Imsci Peshawar, Ctr Excellence IT, Peshawar, Pakistan
[2] Sarhad Univ Sci & Technol, Peshawar, Pakistan
[3] Majmaah Univ, Comp Sci Dept, Coll Sci, Al Majmaah, Saudi Arabia
关键词
Business intelligence; OLTP; Performance optimization; Query optimization; Virtual data warehouse;
D O I
10.1016/j.scs.2017.08.003
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
This paper presents a model for improving query performance in Virtual Data Warehouse (VDW) by simulating VDW environment on a cellular phone billing and customer care system which involves processing millions of Call Detail Records (CDRs) generated by thousands of counters across the country. Processing aggregations on millions of CDRs requires expensive systems, especially when analysing customers' traffic trends and encompasses several performance optimization techniques used for improvement of query performance in VDW. In this regard, VDW offers several advantages such as real-time analytic reports, reduced maintenance, low cost solution and flexible data integration, but performance is still one of its critical shortcomings. This paper enhances performance of VDW by using techniques like partitioned materialized views, index performance optimization, query rewrite in materialized views, analytic functions, sub-queries and enabling parallel execution etc.Thestudy uses Oracle 10 g as a backend database; Oracle management console and SQL query analyser are used for monitoring performance concerns during validation of VDW model; standard PL/SQL developer is used for extracting and loading test data; and finally, Hyperion Development suite is used for testing time comparisons of datasets both in normal OLTP and simulated VDW environments.
引用
收藏
页码:232 / 240
页数:9
相关论文
共 50 条
  • [1] Data warehouse performance
    Gray, P
    [J]. INFORMATION SYSTEMS MANAGEMENT, 2000, 17 (02) : 87 - 91
  • [2] Controlling access to data warehouse data within the database
    Niedrite, L
    Grundmane, L
    [J]. Databases and Information Systems, 2005, 118 : 126 - 138
  • [3] A data warehouse conceptual data model
    Franconi, E
    Kamble, A
    [J]. 16TH INTERNATIONAL CONFERENCE ON SCIENTIFIC AND STATISTICAL DATABASE MANAGEMENT, PROCEEDINGS, 2004, : 435 - 436
  • [4] The virtual data warehouse for small business
    Schwarzkopf, AB
    [J]. ASSOCIATION FOR INFORMATION SYSTEMS PROCEEDING OF THE AMERICAS CONFERENCE ON INFORMATION SYSTEMS, 1997, : 467 - 469
  • [5] The Virtual Enterprise Data Warehouse for Healthcare
    McGlothlin, James P.
    Madugula, Amar
    Stojic, Ilija
    [J]. PROCEEDINGS OF THE 10TH INTERNATIONAL JOINT CONFERENCE ON BIOMEDICAL ENGINEERING SYSTEMS AND TECHNOLOGIES, VOL 5: HEALTHINF, 2017, : 469 - 476
  • [6] Improved Performance of Data Warehouse
    Tiwari, Prayag
    Kumar, Sachin
    Mishra, Avinash Chandra
    Kumar, Vivek
    Terfa, Bodena
    [J]. PROCEEDINGS OF THE 2017 INTERNATIONAL CONFERENCE ON INVENTIVE COMMUNICATION AND COMPUTATIONAL TECHNOLOGIES (ICICCT), 2017, : 94 - 99
  • [7] A distributed multidimensional data model of data warehouse
    Lin, YF
    Huang, HK
    Li, HS
    [J]. ROUGH SETS, FUZZY SETS, DATA MINING, AND GRANULAR COMPUTING, 2003, 2639 : 664 - 667
  • [8] DATA ACCESS WITHIN THE INFORMATION WAREHOUSE FRAMEWORK
    SINGLETON, JP
    SCHWARTZ, MM
    [J]. IBM SYSTEMS JOURNAL, 1994, 33 (02) : 300 - 325
  • [9] A data access challenge:: Build a SAS® frame application for access to an informix data warehouse
    Bentley, JE
    [J]. PROCEEDINGS OF THE TWENTY-THIRD ANNUAL SAS USERS GROUP INTERNATIONAL CONFERENCE, 1998, : 544 - 550
  • [10] Data Warehouse Performance: Selected Techniques and Data Structures
    Wrembel, Robert
    [J]. BUSINESS INTELLIGENCE, 2012, 96 : 27 - 62