Multimodal Decoupled Representation With Compatibility Learning for Explicit Nonstationary Process Monitoring

被引:3
|
作者
Song, Pengyu [1 ]
Zhao, Chunhui [1 ]
Ding, Jinliang [2 ]
Zhao, Shunyi [3 ]
机构
[1] Zhejiang Univ, Coll Control Sci & Engn, Hangzhou 310027, Peoples R China
[2] Northeastern Univ, State Key Lab Synthet Automat Proc Ind, Shenyang 110819, Peoples R China
[3] Jiangnan Univ, Key Lab Adv Proc Controlfor Light Ind, Minist Educ, Wuxi 214122, Peoples R China
基金
国家重点研发计划;
关键词
Cascaded learning architecture; compat-ibility learning; explicit process monitoring; information refinement; multimodal decoupled representation; nonstationarity; NEURAL-NETWORKS; COINTEGRATION; STATIONARY;
D O I
10.1109/TIE.2023.3299013
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Frequent switching of operating conditions in industrial processes tends to make the data distribution time varying and variable correlations nonuniform, which brings considerable challenges for explicit representation and monitoring of nonstationary processes. This study addresses the abovementioned problem based on the following recognitions: 1) despite changes in operating conditions, there exist time-invariant process mechanisms, which are nonlinearly coupled with nonstationarity; 2) such a coupling relationship is not uniform but may show diverse modes changing with time, defined as multimodal coupling here; 3) diverse coupling relations can be derived from the superposition of nonstationarity induced by definite driving forces, i.e., changeable operating condition settings, reflecting their intrinsic association under complex changes. Thereupon, a cascaded deep information separation (CDIS) architecture with a compatibility learning algorithm is proposed to extract multimodal decoupled representations. We design an information refinement module (IRM) to capture the basic coupling source (BCS) under the influence of driving forces, where a shortcut connection is incorporated into the nonlinear autoencoding structure. Multiple IRMs can be flexibly cascaded to achieve the superposition of BCSs, thus, portraying diverse multimodal couplings. Furthermore, by balancing the stationarity requirement and reconstruction constraint, the designed compatibility learning algorithm induces the cascaded IRMs to capture and filter out nonstationarity, thus, obtaining stationary refined data. In this way, stationarity and nonstationarity with multimodal couplings can be fully separated. The validity of CDIS is illustrated through a simulated example and a real condensing system experimental rig.
引用
收藏
页码:8121 / 8131
页数:11
相关论文
共 50 条
  • [21] Relaxing Contrastiveness in Multimodal Representation Learning
    Lin, Zudi
    Bas, Erhan
    Singh, Kunwar Yashraj
    Swaminathan, Gurumurthy
    Bhotika, Rahul
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 2226 - 2235
  • [22] Disentangled Multimodal Representation Learning for Recommendation
    Liu, Fan
    Chen, Huilin
    Cheng, Zhiyong
    Liu, Anan
    Nie, Liqiang
    Kankanhalli, Mohan
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 7149 - 7159
  • [23] Geometric Multimodal Contrastive Representation Learning
    Poklukar, Petra
    Vasco, Miguel
    Yin, Hang
    Melo, Francisco S.
    Paiva, Ana
    Kragic, Danica
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,
  • [24] Hierarchical Multimodal Graph Learning for Outfit Compatibility Modelling
    Xu, Rucong
    Wang, Jianfeng
    Li, Ming
    Xu, Junyan
    Li, Yun
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024, 8 (06): : 4130 - 4142
  • [25] Improving Video Representation of Vision-Language Model with Decoupled Explicit Temporal Modeling
    Liu, Yuxi
    Zheng, Wenyu
    Chen, Sihong
    Zheng, Xinming
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2024, PT VII, 2025, 15037 : 525 - 539
  • [26] Hierarchical representation and interpretable learning for accelerated quality monitoring in machining process
    Hoang, Danny
    Errahmouni, Hamza
    Chen, Hanning
    Rachuri, Sriniket
    Mannan, Nasir
    Elkharboutly, Ruby
    Imani, Mohsen
    Chen, Ruimin
    Imani, Farhad
    CIRP JOURNAL OF MANUFACTURING SCIENCE AND TECHNOLOGY, 2024, 50 : 198 - 212
  • [27] Deep Reinforcement Learning With Explicit Context Representation
    Munguia-Galeano, Francisco
    Tan, Ah-Hwee
    Ji, Ze
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2025, 36 (01) : 419 - 432
  • [28] Deep Reinforcement Learning With Explicit Context Representation
    Munguia-Galeano, Francisco
    Tan, Ah-Hwee
    Ji, Ze
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2025, 36 (01) : 419 - 432
  • [29] Decoupled Representation Learning for Skeleton-Based Gesture Recognition
    Liu, Jianbo
    Liu, Yongcheng
    Wang, Ying
    Prinet, Veronique
    Xiang, Shiming
    Pan, Chunhong
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 5750 - 5759
  • [30] Gradient Decoupled Learning With Unimodal Regularization for Multimodal Remote Sensing Classification
    Wei, Shicai
    Luo, Chunbo
    Ma, Xiaoguang
    Luo, Yang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62