Clustering Evolving Batch System Jobs for Online Anomaly Detection

被引:0
|
作者
Kuehn, Eileen [1 ]
机构
[1] Karlsruhe Inst Technol, Steinbuch Ctr Comp, Karlsruhe, Germany
关键词
NETWORKS;
D O I
10.1109/ICDMW.2015.219
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In batch systems monitoring information at the level of individual jobs is crucial to optimize resource utilization and prevent misusage. However, especially the usage of network resources is difficult to track. In order to understand usage patterns in modern computing clusters, a more detailed monitoring than existent solutions is required. A monitoring on job level leads to dynamic graphs of processes with attached time series data of e.g. network resource usage. Utilizing clustering, common usage patterns can be identified and outliers detected. This work provides an overview about ongoing efforts to cluster dynamic graphs in the context of distributed streams of monitoring events.
引用
收藏
页码:1534 / 1535
页数:2
相关论文
共 50 条
  • [1] Online Clustering for Evolving Data Streams with Online Anomaly Detection
    Chenaghlou, Milad
    Moshtaghi, Masud
    Leckie, Christopher
    Salehi, Mahsa
    [J]. ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2018, PT II, 2018, 10938 : 506 - 519
  • [2] A scalable architecture for online anomaly detection of WLCG batch jobs
    Kuehn, E.
    Fischer, M.
    Giffels, M.
    Jung, C.
    Petzold, A.
    [J]. 17TH INTERNATIONAL WORKSHOP ON ADVANCED COMPUTING AND ANALYSIS TECHNIQUES IN PHYSICS RESEARCH (ACAT2016), 2016, 762
  • [3] Human Activity Clustering for Online Anomaly Detection
    Zhu, Xudong
    Liu, Zhijing
    Zhang, Juehui
    [J]. JOURNAL OF COMPUTERS, 2011, 6 (06) : 1071 - 1079
  • [4] Isolation Mondrian Forest for Batch and Online Anomaly Detection
    Ma, Haoran
    Ghojogh, Benyamin
    Samad, Maria N.
    Zheng, Dongyu
    Crowley, Mark
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2020, : 3051 - 3058
  • [5] Online Anomaly Detection Based on Support Vector Clustering
    Mohammad Amin Adibi
    Jamal Shahrabi
    [J]. International Journal of Computational Intelligence Systems, 2015, 8 : 735 - 746
  • [6] Online Anomaly Detection Based on Support Vector Clustering
    Adibi, Mohammad Amin
    Shahrabi, Jamal
    [J]. INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE SYSTEMS, 2015, 8 (04) : 735 - 746
  • [7] ONLINE ANOMALY DETECTION IN VIDEOS BY CLUSTERING DYNAMIC EXEMPLARS
    Feng, Jie
    Zhang, Chao
    Hao, Pengwei
    [J]. 2012 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2012), 2012, : 3097 - 3100
  • [8] Batch and online anomaly detection for scientific applications in a Kubernetes environment
    Hariri, Sahand
    Kind, Matias Carrasco
    [J]. PROCEEDINGS OF THE ACM WORKSHOP ON SCIENTIFIC CLOUD COMPUTING (SCIENCECLOUD'18), 2018,
  • [9] Online System Prognostics with Ensemble Models and Evolving Clustering
    Tseng, Fling
    Filev, Dimitar
    Yildirim, Murat
    Chinnam, Ratna Babu
    [J]. MACHINES, 2023, 11 (01)
  • [10] Self-adaptive and dynamic clustering for online anomaly detection
    Lee, Seungmin
    Kim, Gisung
    Kim, Sehun
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2011, 38 (12) : 14891 - 14898