Concept Drift-Based Runtime Reliability Anomaly Detection for Edge Services Adaptation

被引:8
|
作者
Wang, Lei [1 ]
Chen, Shuhan [1 ]
He, Qiang [2 ]
机构
[1] Nanjing Forestry Univ, Dept Management Sci & Engn, Nanjing 210037, Jiangsu, Peoples R China
[2] Swinburne Univ Technol, Dept Comp Technol, Hawthorn, Vic 3122, Australia
关键词
Reliability; Image edge detection; Runtime; Anomaly detection; Servers; Feature extraction; Software reliability; Adaptation; anomaly detection; computation offloading; concept drift; mobile edge computing (MEC); reliability; CACHE DATA INTEGRITY; ONLINE;
D O I
10.1109/TKDE.2021.3127224
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
To meet the rapidly increasing need of computation-intensive and latency-sensitive applications, mobile edge computing (MEC) has attracted tremendous attention from both academia and industry. However, the runtime reliability of edge services fluctuates over time due to the dynamics in their internal states and the external environment. This causes the distribution of edge services' reliability data streams to vary in the form of concept drift. Severe negative reliability drifts indicate that an edge service may be suffering from a performance anomaly or a runtime failure. To ensure the stable operation of edge services, we propose A-Detection, a concept drift-based runtime reliability anomaly detection approach for edge services adaptation. We integrate reservoir sampling and singular value decomposition (SVD) for large-scale streaming data sampling and feature extraction. Jensen Shannon (JS) divergence is utilized to develop a dissimilarity metric of data stream distribution, called FDC, for runtime edge service reliability anomaly detection. When an anomaly is detected in a running edge service, checkpoint-retry is combined with computation offloading to implement runtime reliability adaptation. Extensive experimental results verify and demonstrate the effectiveness and efficiency of A-Detection.
引用
收藏
页码:12153 / 12166
页数:14
相关论文
共 50 条
  • [21] DB-Drift: Concept drift aware density-based anomaly detection for maritime trajectories
    Henriksen, Amelia
    2023 SENSOR SIGNAL PROCESSING FOR DEFENCE CONFERENCE, SSPD, 2023, : 96 - 100
  • [22] Improved Long Short-Term Memory based anomaly detection with concept drift adaptive method for supporting IoT services
    Xu, Rongbin
    Cheng, Yongliang
    Liu, Zhiqiang
    Xie, Ying
    Yang, Yun
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2020, 112 : 228 - 242
  • [23] Real-time reliability evaluation for product with nonlinear drift-based Wiener process
    Wang, Xiaolin
    Guo, Bo
    Cheng, Zhijun
    Zhongnan Daxue Xuebao (Ziran Kexue Ban)/Journal of Central South University (Science and Technology), 2013, 44 (08): : 3203 - 3209
  • [24] Concept drift detection and adaptation with hierarchical hypothesis testing
    Yu, Shujian
    Abraham, Zubin
    Wang, Heng
    Shah, Mohak
    Wei, Yantao
    Principe, Jose C.
    JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2019, 356 (05): : 3187 - 3215
  • [25] Concept drift detection and adaptation for federated and continual learning
    Casado, Fernando E.
    Lema, Dylan
    Criado, Marcos F.
    Iglesias, Roberto
    Regueiro, Carlos, V
    Barro, Senen
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (03) : 3397 - 3419
  • [26] Concept drift detection and adaptation for federated and continual learning
    Fernando E. Casado
    Dylan Lema
    Marcos F. Criado
    Roberto Iglesias
    Carlos V. Regueiro
    Senén Barro
    Multimedia Tools and Applications, 2022, 81 : 3397 - 3419
  • [27] Incremental Isolation Forest to Handle Concept Drift in Anomaly Detection
    Ahlawat, Nidhi
    Awekar, Amit
    PROCEEDINGS OF 7TH JOINT INTERNATIONAL CONFERENCE ON DATA SCIENCE AND MANAGEMENT OF DATA, CODS-COMAD 2024, 2024, : 582 - 583
  • [28] Situational Anomaly Detection in Multimedia Data under Concept Drift
    Kumari, Pratibha
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 2969 - 2973
  • [29] Anomaly and change point detection for time series with concept drift
    Liu, Jiayi
    Yang, Donghua
    Zhang, Kaiqi
    Gao, Hong
    Li, Jianzhong
    WORLD WIDE WEB-INTERNET AND WEB INFORMATION SYSTEMS, 2023, 26 (05): : 3229 - 3252
  • [30] Anomaly and change point detection for time series with concept drift
    Jiayi Liu
    Donghua Yang
    Kaiqi Zhang
    Hong Gao
    Jianzhong Li
    World Wide Web, 2023, 26 : 3229 - 3252