Attention-aware temporal-spatial graph neural network with multi-sensor information fusion for fault diagnosis

被引:21
|
作者
Wang, Zhe [1 ,2 ]
Wu, Zhiying [1 ]
Li, Xingqiu [3 ]
Shao, Haidong [4 ]
Han, Te [5 ]
Xie, Min [1 ,2 ,6 ]
机构
[1] City Univ Hong Kong, Dept Adv Design & Syst Engn, Hong Kong, Peoples R China
[2] Ctr Intelligent Multidimens Data Anal, Sci Pk, Hong Kong, Peoples R China
[3] Northwestern Polytech Univ, Sch Civil Aviat, Xian, Peoples R China
[4] Hunan Univ, Coll Mech & Vehicle Engn, Changsha, Peoples R China
[5] Beijing Inst Technol, Sch Management & Econ, Beijing, Peoples R China
[6] City Univ Hong Kong Chengdu Res Inst, Chengdu, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep learning; Fault diagnosis; Graph neural network; Information fusion; Attention mechanism; SPARSE AUTOENCODER; SYSTEM;
D O I
10.1016/j.knosys.2023.110891
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Intelligent fault diagnosis has attracted intensive efforts in machine predictive maintenance. However, the structural information from multi-sensor signals has not been fully investigated. In this study, a novel temporal-spatial graph neural network with an attention-aware module (A-TSGNN) is proposed to accomplish multi-source information fusion. First, the graph structure naturally organizes the diverse sensors. The graph convolution model realizes the feature representation in the spatial dimension. Then, time-dependent learning is applied in the temporal dimension, and a temporal-spatial learning framework is built. An additional attention module is designed to learn the flexible weights and model the importance of individual sensors and their correlations. Experiments on a wind turbine dataset achieves an accuracy of 0.9669 and an F1-score of 0.9649. For the gearbox dataset, the values are 0.9927 and 0.9920, respectively. The overall macro-average area under the curve metrics reach a perfect score of 1.00 for both datasets, indicating exceptional performance. The adaptive attention mechanism is also discussed to verify the superiority of the A-TSGNN. Furthermore, comparisons with the single-sensor scheme and other fusion models demonstrate the stable performance of the proposed method. The A-TSGNN provides a potential model for comprehensively utilizing multi-sensor data, showing a promising prospect.
引用
收藏
页数:15
相关论文
共 50 条
  • [21] Multi-sensor fault detection and correction for automated IAQ monitoring in smart buildings through attention-aware autoencoders with spatial prediction module
    Tariq, Shahzeb
    Loy-Benitez, Jorge
    Yoo, ChangKyoo
    JOURNAL OF BUILDING ENGINEERING, 2024, 96
  • [22] Research on multi-sensor information fusion technique for motor fault diagnosis
    Tailong, Qin
    Hang, Cheng
    Fafa, Chen
    PROCEEDINGS OF THE 2009 2ND INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, VOLS 1-9, 2009, : 4514 - 4517
  • [23] Application of Multi-sensor Information Fusion in the Fault Diagnosis of Hydraulic System
    LIU Bao-jie
    YANG Qing-wen
    WU Xiang
    FANG Shi-dong
    GUO Feng
    International Journal of Plant Engineering and Management, 2017, 22 (01) : 12 - 20
  • [24] Application of multi-sensor information fusion in fault diagnosis of rotating machinery
    Guan, Ke
    Mei, Tao
    Wang, Deji
    2006 IEEE INTERNATIONAL CONFERENCE ON INFORMATION ACQUISITION, VOLS 1 AND 2, CONFERENCE PROCEEDINGS, 2006, : 425 - 429
  • [25] TGF: Multiscale transformer graph attention network for multi-sensor image fusion
    Mustafa, Hafiz Tayyab
    Shamsolmoali, Pourya
    Lee, Ik Hyun
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 238
  • [26] Action Recognition by an Attention-Aware Temporal Weighted Convolutional Neural Network
    Wang, Le
    Zang, Jinliang
    Zhang, Qilin
    Niu, Zhenxing
    Hua, Gang
    Zheng, Nanning
    SENSORS, 2018, 18 (07)
  • [27] Convolutional autoencoder neural network for fault diagnosis with multi-sensor data
    Wang, Xin
    Cui, Lingli
    Yang, Na
    PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART C-JOURNAL OF MECHANICAL ENGINEERING SCIENCE, 2022,
  • [28] Multi-sensor Information Fusion Method Based on BP Neural Network
    Lin Liandong
    INTERNATIONAL JOURNAL OF ONLINE ENGINEERING, 2016, 12 (05) : 53 - 57
  • [29] Multi-branch convolutional attention network for multi-sensor feature fusion in intelligent fault diagnosis of rotating machinery
    Wu, Ke
    Li, Zirui
    Chen, Chong
    Song, Zhenguo
    Wu, Jun
    QUALITY ENGINEERING, 2024, 36 (03) : 609 - 623
  • [30] Fast Aging-Aware Timing Analysis Framework With Temporal-Spatial Graph Neural Network
    Ye, Jinfeng
    Ren, Pengpeng
    Xue, Yongkang
    Fang, Hui
    Ji, Zhigang
    IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2024, 43 (06) : 1862 - 1871