Study of optimized window aggregate function for big data analytics

被引:0
|
作者
Kumar S. [1 ]
Kumar P. [1 ]
Mittal A. [1 ]
机构
[1] Department of Computer Science, Ambedkar Institute of Advanced Communication Technologies & Research, New Delhi
来源
Recent Patents on Engineering | 2019年 / 13卷 / 02期
关键词
Big data analytics; Optimization; Parallel processing; Query processing; Segment tree data structure; Window aggregate function;
D O I
10.2174/1872212112666180330162741
中图分类号
学科分类号
摘要
Background: A Window Aggregate function belongs to a class of functions, which have emerged as a very important tool for Big Data Analytics. They lend support in analysis and decision-making applications. A window aggregate function aggregates and returns the result by applying the function over a limited number of tuples corresponding to current tuple and hence lending support for big data analytics. We have gone through different patents related to window aggregate functions and its optimization. The cost associated with Big data analytics, especially the processing of window functions is one of the major limiting factors. However, now a number of optimizing techniques have evolved for both single as well as multiple window aggregate functions. Methods: In this paper, the authors have discussed various optimization techniques and summarized the latest techniques that have been developed over a period through intensive research in this area. The paper tried to compare various techniques based on certain parameters like the degree of parallelism, multiple window function support, execution time etc. Results: After analyzing all these techniques, segment tree data structure seems better technique as it outperforms other techniques on different grounds like efficiency, memory overhead, execution speed and degree of parallelism. Conclusion: In order to optimize the window aggregate function, segment tree data structure technique is a better technique, which can certainly improve the processing of window aggregate function specifically in big data analytics. © 2019 Bentham Science Publishers.
引用
收藏
页码:101 / 107
页数:6
相关论文
共 50 条
  • [41] IoT Big Data Analytics
    Choudhury, Salimur
    Ye, Qiang
    Dong, Mianxiong
    Zhang, Qingchen
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2019, 2019
  • [42] Big Data Analytics in Retail
    Lekhwar, Shubham
    Yadav, Shweta
    Singh, Archana
    INFORMATION AND COMMUNICATION TECHNOLOGY FOR INTELLIGENT SYSTEMS, ICTIS 2018, VOL 2, 2019, 107 : 469 - 477
  • [43] Crowdsourcing for big data analytics
    Kashima, Hisashi
    Journal of the Institute of Electronics, Information and Communication Engineers, 2014, 97 (05): : 364 - 369
  • [44] Big Data and Analytics in Healthcare
    Tan, S. S. -L.
    Gao, G.
    Koch, S.
    METHODS OF INFORMATION IN MEDICINE, 2015, 54 (06) : 546 - 547
  • [45] Handbook of Big Data Analytics
    Shalabh
    JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES A-STATISTICS IN SOCIETY, 2019, 182 (04) : 1646 - 1647
  • [46] Big Data Analytics in MOOCs
    Zheng, Yanyan
    Yin, Beibei
    CIT/IUCC/DASC/PICOM 2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER AND INFORMATION TECHNOLOGY - UBIQUITOUS COMPUTING AND COMMUNICATIONS - DEPENDABLE, AUTONOMIC AND SECURE COMPUTING - PERVASIVE INTELLIGENCE AND COMPUTING, 2015, : 682 - 687
  • [47] Trends in big data analytics
    Kambatla, Karthik
    Kollias, Giorgos
    Kumar, Vipin
    Grama, Ananth
    JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2014, 74 (07) : 2561 - 2573
  • [48] Business Analytics and Big Data
    de Vasconcelos, Jose Braga
    Rocha, Alvaro
    INTERNATIONAL JOURNAL OF INFORMATION MANAGEMENT, 2019, 46 : 250 - 251
  • [49] Biological Big Data Analytics
    Gharajeh, Mohammad Samadi
    DEEP DIVE INTO NOSQL DATABASES: THE USE CASES AND APPLICATIONS, 2018, 109 : 321 - 355
  • [50] Big Data and Enterprise Analytics
    Chaudhuri, Surajit
    CONCEPTUAL MODELING, ER 2013, 2013, 8217