DiskTransformer: A Transformer Network for Hard Disk Failure Prediction

被引:0
|
作者
Ge, Wenqiang [1 ]
Liu, Peishun [1 ]
Zhang, Mingyu [1 ]
Zhang, Zhen [1 ]
Lai, Yiwan [1 ]
机构
[1] Ocean Univ China, Fac Informat Sci & Engn, Qingdao, Peoples R China
基金
国家重点研发计划;
关键词
hard disk drive; failure prediction; time-series feature extraction; Transformer; feature fusion;
D O I
10.1109/ICAIBD62003.2024.10604547
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The hard disk drive is one of the most commonly damaged components in data centers, which can cause a lot of losses such as unexpected shutdowns and data loss. Therefore, the prediction of hard disk drive failures has received widespread attention in data center management. Existing work has made remarkable progress in the accuracy of failure prediction. However, the prediction performance for long-term failure and small-sample disks is not satisfactory. To address this issue, we propose a new method for hard disk failure prediction. The framework consists of a time-series feature extraction network and a prediction network. The time-series feature extraction network is composed of a Temporal Convolutional Network used to extract different dimensional relationships and a set of Long Short Term Memory networks used to extract independent dimensional time-series features. The prediction network uses a Transformer model, which can fully utilize the high-quality fused features extracted by the time-series feature extraction network for disk drive failure prediction. Experimental results on public datasets have demonstrated that our proposed method can not only predict long-term failure but also has reliable prediction performance when facing small-sample disk data.
引用
收藏
页码:327 / 332
页数:6
相关论文
共 50 条
  • [1] Hard Disk Drive Failure Prediction Method based on a Bayesian Network
    Chaves, Iago C.
    de Paula, Manoel Rui P.
    Leite, Lucas G. M.
    Gomes, Joao Paulo P.
    Machado, Javam C.
    [J]. 2018 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2018,
  • [2] Hard Disk Failure Prediction on Highly Imbalanced Data using LSTM Network
    Cahyadi
    Forshaw, Matthew
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2021, : 3985 - 3991
  • [3] BaNHFaP: A Bayesian Network based Failure Prediction Approach for Hard Disk Drives
    Chaves, Iago C.
    de Paula, Manoel Rui P.
    Leite, Lucas G. M.
    Queiroz, Lucas P.
    Gomes, Joao Paulo P.
    Machado, Javam C.
    [J]. PROCEEDINGS OF 2016 5TH BRAZILIAN CONFERENCE ON INTELLIGENT SYSTEMS (BRACIS 2016), 2016, : 427 - 432
  • [4] Hard disk drive reliability modeling and failure prediction
    Strom, Brian D.
    Lee, SungChang
    Tyndall, George W.
    Khurshudov, Andrei
    [J]. IEEE TRANSACTIONS ON MAGNETICS, 2007, 43 (09) : 3676 - 3684
  • [5] Hard Disk Failure Prediction Based on Lightgbm with CID
    Wang, Hengrui
    Yang, Yahui
    Yang, Hongzhang
    [J]. 26TH IEEE SYMPOSIUM ON COMPUTERS AND COMMUNICATIONS (IEEE ISCC 2021), 2021,
  • [6] Hard Disk Failure Prediction Based on Blending Ensemble Learning
    Zhang, Mingyu
    Ge, Wenqiang
    Tang, Ruichun
    Liu, Peishun
    [J]. APPLIED SCIENCES-BASEL, 2023, 13 (05):
  • [7] Unsupervised adversarial learning method for hard disk failure prediction
    Jiang, Shaobin
    Du, Chun
    Chen, Hao
    Li, Jun
    Wu, Jiangjiang
    [J]. Xi'an Dianzi Keji Daxue Xuebao/Journal of Xidian University, 2020, 47 (02): : 118 - 125
  • [8] Hard Disk Drive Failure Analysis and Prediction: An Industry View
    Miller, Zach
    Medaiyese, Olusiji
    Ravi, Madhavan
    Beatty, Alex
    Lin, Fred
    [J]. 2023 53RD ANNUAL IEEE/IFIP INTERNATIONAL CONFERENCE ON DEPENDABLE SYSTEMS AND NETWORKS - SUPPLEMENTAL VOLUME, DSN-S, 2023, : 21 - 27
  • [9] Hard disk drive failure prediction using SMART attribute
    Tomer, Vikas
    Sharma, Vedna
    Gupta, Sonali
    Singh, Devesh Pratap
    [J]. MATERIALS TODAY-PROCEEDINGS, 2021, 46 : 11258 - 11262
  • [10] Hard Disk Drive Failure Prediction for Mobile Edge Computing Based on an LSTM Recurrent Neural Network
    Shen, Jing
    Ren, Yongjian
    Wan, Jian
    Lan, Yunlong
    [J]. MOBILE INFORMATION SYSTEMS, 2021, 2021