Deep Energy-Based NARX Models

被引:5
|
作者
Hendriks, Johannes N. [1 ]
Gustafsson, Fredrik K. [2 ]
Ribeiro, Antonio H. [3 ]
Wills, Adrian G. [1 ]
Schon, Thomas B. [2 ]
机构
[1] Univ Newcastle, Sch Engn, Callaghan, NSW, Australia
[2] Uppsala Univ, Dept Informat Technol, Uppsala, Sweden
[3] Univ Fed Minas Gerais, Dept Comp Sci, BR-31270901 Belo Horizonte, MG, Brazil
来源
IFAC PAPERSONLINE | 2021年 / 54卷 / 07期
关键词
System Identification; Energy-Based Models; Deep Neural Networks;
D O I
10.1016/j.ifacol.2021.08.410
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper is directed towards the problem of learning nonlinear ARX models based on observed input output data. In particular, our interest is in learning a conditional distribution of the current output based on a finite window of past inputs and outputs. To achieve this, we consider the use of so-called energy-based models, which have been developed in allied fields for learning unknown distributions based on data. This energy-based model relies on a general function to describe the distribution, and here we consider a deep neural network for this purpose. The primary benefit of this approach is that it is capable of learning both simple and highly complex noise models, which we demonstrate on simulated and experimental data. Copyright (C) 2021 The Authors.
引用
收藏
页码:505 / 510
页数:6
相关论文
共 50 条
  • [31] Nieme: Large-scale energy-based models
    Maes, Francis
    Journal of Machine Learning Research, 2009, 10 : 743 - 746
  • [32] Energy-based numerical models for assessment of soil liquefaction
    Amir Hossein Alavi
    Amir Hossein Gandomi
    Geoscience Frontiers, 2012, (04) : 541 - 555
  • [33] Nieme: Large-Scale Energy-Based Models
    Maes, Francis
    JOURNAL OF MACHINE LEARNING RESEARCH, 2009, 10 : 743 - 746
  • [34] EGG: Accuracy Estimation of Individual Multimeric Protein Models Using Deep Energy-Based Models and Graph Neural Networks
    Siciliano, Andrew Jordan
    Zhao, Chenguang
    Liu, Tong
    Wang, Zheng
    INTERNATIONAL JOURNAL OF MOLECULAR SCIENCES, 2024, 25 (11)
  • [35] Energy-based models in document recognition and computer vision
    LeCun, Yann
    Chopra, Sumit
    Ranzato, Marc'Aurelio
    Huang, Fu-Jie
    ICDAR 2007: NINTH INTERNATIONAL CONFERENCE ON DOCUMENT ANALYSIS AND RECOGNITION, VOLS I AND II, PROCEEDINGS, 2007, : 337 - 341
  • [36] Rate-Distortion Theory by and for Energy-Based Models
    Li, Qing
    Guyot, Cyril
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2024, 72 (07) : 4072 - 4083
  • [37] On Energy-Based Models with Overparametrized Shallow Neural Networks
    Domingo-Enrich, Carles
    Bietti, Alberto
    Vanden-Eijnden, Eric
    Bruna, Joan
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139
  • [38] Improved Contrastive Divergence Training of Energy-Based Models
    Du, Yilun
    Li, Shuang
    Tenenbaum, Joshua
    Mordatch, Igor
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139
  • [39] Energy-based numerical models for assessment of soil liquefaction
    Amir Hossein Alavi
    Amir Hossein Gandomi
    Geoscience Frontiers, 2012, 3 (04) : 541 - 555
  • [40] Energy Discrepancies: A Score-Independent Loss for Energy-Based Models
    Schroder, Tobias
    Ou, Zijing
    Lim, Jen Ning
    Li, Yingzhen
    Vollmer, Sebastian J.
    Duncan, Andrew B.
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,