Measuring data-centre workflows complexity through process mining: the Google cluster case

被引:16
|
作者
Fernandez-Cerero, Damian [1 ]
Jesus Varela-Vaca, Angel [1 ]
Fernandez-Montes, Alejandro [1 ]
Teresa Gomez-Lopez, Maria [1 ]
Antonio Alvarez-Bermejo, Jose [2 ]
机构
[1] Univ Seville, Dept Comp Languages & Syst, Seville 41012, Spain
[2] Univ Almeria, Dept Comp Sci, Almeria 04120, Spain
来源
JOURNAL OF SUPERCOMPUTING | 2020年 / 76卷 / 04期
关键词
Cloud computing; Business process management; Scheduling; Process mining; Process discovery; High performance computing; ENERGY POLICIES; CLOUD; MACHINES;
D O I
10.1007/s11227-019-02996-2
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Data centres have become the backbone of large Cloud services and applications, providing virtually unlimited elastic and scalable computational and storage resources. The search for the efficiency and optimisation of resources is one of the current key aspects for large Cloud Service Providers and is becoming more and more challenging, since new computing paradigms such as Internet of Things, Cyber-Physical Systems and Edge Computing are spreading. One of the key aspects to achieve efficiency in data centres consists of the discovery and proper analysis of the data-centre behaviour. In this paper, we present a model to automatically retrieve execution workflows of existing data-centre logs by employing process mining techniques. The discovered processes are characterised and analysed according to the understandability and complexity in terms of execution efficiency of data-centre jobs. We finally validate and demonstrate the usability of the proposal by applying the model in a real scenario, that is, the Google Cluster traces.
引用
收藏
页码:2449 / 2478
页数:30
相关论文
共 50 条
  • [1] Measuring data-centre workflows complexity through process mining: the Google cluster case
    Damián Fernández-Cerero
    Ángel Jesús Varela-Vaca
    Alejandro Fernández-Montes
    María Teresa Gómez-López
    José Antonio Alvárez-Bermejo
    The Journal of Supercomputing, 2020, 76 : 2449 - 2478
  • [2] Leveraging Event Data for Measuring Process Complexity
    Vidgof, Maxim
    Mendling, Jan
    PROCESS MINING WORKSHOPS, ICPM 2022, 2023, 468 : 84 - 95
  • [3] Business Process Reporting Using Process Mining, Analytic Workflows and Process Cubes: A Case Study in Education
    Bolt, Alfredo
    de Leoni, Massimiliano
    van der Aalst, Wil M. P.
    Gorissen, Pierre
    DATA-DRIVEN PROCESS DISCOVERY AND ANALYSIS, SIMPDA 2015, 2017, 244 : 28 - 53
  • [4] Scalable Crowd Ideation Support through Data Visualization, Mining, and Structured Workflows
    Girotto, Victor
    Walker, Erin
    Burleson, Winslow
    CSCW'17: COMPANION OF THE 2017 ACM CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK AND SOCIAL COMPUTING, 2017, : 183 - 186
  • [5] Improving expression data mining through cluster validation
    Bolshakova, N
    Azuaje, F
    ITAB 2003: 4TH INTERNATIONAL IEEE EMBS SPECIAL TOPIC CONFERENCE ON INFORMATION TECHNOLOGY APPLICATIONS IN BIOMEDICINE, CONFERENCE PROCEEDINGS: NEW SOLUTIONS FOR NEW CHALLENGES, 2003, : 19 - 22
  • [6] Calculation and Allocation of Complexity Costs Using Process Data Mining
    Riesener, M.
    Doelle, C.
    Menges, A.
    Schuh, G.
    2019 IEEE INTERNATIONAL CONFERENCE ON INDUSTRIAL ENGINEERING AND ENGINEERING MANAGEMENT (IEEM), 2019, : 997 - 1001
  • [7] DATA MINING IN TELECOMMUNICATIONS: CASE STUDY OF CLUSTER ANALYSIS
    Bach, Mirjana Pejic
    Simicevic, Vanja
    Leskovic, Darko
    ANNALS OF DAAAM FOR 2009 & PROCEEDINGS OF THE 20TH INTERNATIONAL DAAAM SYMPOSIUM, 2009, 20 : 491 - 492
  • [8] Tailoring the Engineering Design Process Through Data and Process Mining
    Maruster, Laura
    Alblas, Alex
    IEEE TRANSACTIONS ON ENGINEERING MANAGEMENT, 2022, 69 (04) : 1577 - 1591
  • [9] Towards Data-Driven Business Process Redesign Through the Lens of Process Mining Case Studies
    Wang, Zeping
    Syed, Rehan
    Ouyang, Chun
    BUSINESS PROCESS MANAGEMENT WORKSHOPS, BPM 2023, 2024, 492 : 259 - 271
  • [10] Complexity-Aware Generation of Workflows by Process-Oriented Case-Based Reasoning
    Mueller, Gilbert
    Bergmann, Ralph
    KI 2017: ADVANCES IN ARTIFICIAL INTELLIGENCE, 2017, 10505 : 207 - 221