Measuring data-centre workflows complexity through process mining: the Google cluster case

被引:16
|
作者
Fernandez-Cerero, Damian [1 ]
Jesus Varela-Vaca, Angel [1 ]
Fernandez-Montes, Alejandro [1 ]
Teresa Gomez-Lopez, Maria [1 ]
Antonio Alvarez-Bermejo, Jose [2 ]
机构
[1] Univ Seville, Dept Comp Languages & Syst, Seville 41012, Spain
[2] Univ Almeria, Dept Comp Sci, Almeria 04120, Spain
来源
JOURNAL OF SUPERCOMPUTING | 2020年 / 76卷 / 04期
关键词
Cloud computing; Business process management; Scheduling; Process mining; Process discovery; High performance computing; ENERGY POLICIES; CLOUD; MACHINES;
D O I
10.1007/s11227-019-02996-2
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Data centres have become the backbone of large Cloud services and applications, providing virtually unlimited elastic and scalable computational and storage resources. The search for the efficiency and optimisation of resources is one of the current key aspects for large Cloud Service Providers and is becoming more and more challenging, since new computing paradigms such as Internet of Things, Cyber-Physical Systems and Edge Computing are spreading. One of the key aspects to achieve efficiency in data centres consists of the discovery and proper analysis of the data-centre behaviour. In this paper, we present a model to automatically retrieve execution workflows of existing data-centre logs by employing process mining techniques. The discovered processes are characterised and analysed according to the understandability and complexity in terms of execution efficiency of data-centre jobs. We finally validate and demonstrate the usability of the proposal by applying the model in a real scenario, that is, the Google Cluster traces.
引用
收藏
页码:2449 / 2478
页数:30
相关论文
共 50 条
  • [21] Supporting Governance in Healthcare Through Process Mining: A Case Study
    Agostinelli, Simone
    Covino, Federico
    D'Agnese, Giampaolo
    De Crea, Carmela
    Leotta, Francesco
    Marrella, Andrea
    IEEE ACCESS, 2020, 8 : 186012 - 186025
  • [22] Hunting Killer Tasks for Cloud System Through Machine Learning: A Google Cluster Case Study
    Tang Hongyan
    Li Ying
    Jia Tong
    Wu Zhonghai
    2016 IEEE INTERNATIONAL CONFERENCE ON SOFTWARE QUALITY, RELIABILITY AND SECURITY (QRS 2016), 2016, : 1 - 12
  • [23] Polygonization of point clusters through cluster boundary extraction for geographical data mining
    Lee, I
    Estivill-Castro, V
    ADVANCES IN SPATIAL DATA HANDLING, 2002, : 27 - 40
  • [24] Mining Google Trends Data for Health Information: The Case of the Irish "CervicalCheck" Screening Programme Revelations
    Ryan, Paul M.
    Ryan, C. Anthony
    CUREUS JOURNAL OF MEDICAL SCIENCE, 2019, 11 (08)
  • [25] A new method for organizational process model discovery through the analysis of workflows and data exchange networks
    Aghabaghery, Roshanak
    Hashemi Golpayegani, Alireza
    Esmaeili, Leila
    SOCIAL NETWORK ANALYSIS AND MINING, 2020, 10 (01)
  • [26] Rugby game performances and weekly workload: Using of data mining process to enter in the complexity
    Dubois, Romain
    Bru, Noelle
    Paillard, Thierry
    Le Cunuder, Anne
    Lyons, Mark
    Maurelli, Olivier
    Philippe, Kilian
    Prioux, Jacques
    PLOS ONE, 2020, 15 (01):
  • [27] A new method for organizational process model discovery through the analysis of workflows and data exchange networks
    Roshanak Aghabaghery
    Alireza Hashemi Golpayegani
    Leila Esmaeili
    Social Network Analysis and Mining, 2020, 10
  • [28] Case of Process Mining from Business Execution Log Data
    Bae, Joonsoo
    Kang, Young Ki
    INTELLIGENT DECISION TECHNOLOGIES (IDT'2012), VOL 1, 2012, 15 : 419 - 425
  • [29] Towards Enhancing Manufacturing Process Performance Through Multivariate Data Mining
    Charaniya, Salim
    Huong Le
    Mills, Keri
    Johnson, Kevin
    Karypis, George
    Hu, Wei-Shou
    PROCEEDINGS OF THE 21ST ANNUAL MEETING OF THE EUROPEAN SOCIETY FOR ANIMAL CELL TECHNOLOGY (ESACT), 2009, 2012, 5 : 285 - 294
  • [30] Optimizing a batch manufacturing process through interpretable data mining models
    Last, Mark
    Danon, Guy
    Biderman, Sholomo
    Miron, Eli
    JOURNAL OF INTELLIGENT MANUFACTURING, 2009, 20 (05) : 523 - 534