Deep Energy-Based NARX Models

被引:5
|
作者
Hendriks, Johannes N. [1 ]
Gustafsson, Fredrik K. [2 ]
Ribeiro, Antonio H. [3 ]
Wills, Adrian G. [1 ]
Schon, Thomas B. [2 ]
机构
[1] Univ Newcastle, Sch Engn, Callaghan, NSW, Australia
[2] Uppsala Univ, Dept Informat Technol, Uppsala, Sweden
[3] Univ Fed Minas Gerais, Dept Comp Sci, BR-31270901 Belo Horizonte, MG, Brazil
来源
IFAC PAPERSONLINE | 2021年 / 54卷 / 07期
关键词
System Identification; Energy-Based Models; Deep Neural Networks;
D O I
10.1016/j.ifacol.2021.08.410
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper is directed towards the problem of learning nonlinear ARX models based on observed input output data. In particular, our interest is in learning a conditional distribution of the current output based on a finite window of past inputs and outputs. To achieve this, we consider the use of so-called energy-based models, which have been developed in allied fields for learning unknown distributions based on data. This energy-based model relies on a general function to describe the distribution, and here we consider a deep neural network for this purpose. The primary benefit of this approach is that it is capable of learning both simple and highly complex noise models, which we demonstrate on simulated and experimental data. Copyright (C) 2021 The Authors.
引用
收藏
页码:505 / 510
页数:6
相关论文
共 50 条
  • [1] Joint Energy-based Models for Deep Probabilistic Regression
    Liu, Xixi
    Lin, Che-Tsung
    Zach, Christopher
    2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 2693 - 2699
  • [2] The physics of energy-based models
    Huembeli, Patrick
    Arrazola, Juan Miguel
    Killoran, Nathan
    Mohseni, Masoud
    Wittek, Peter
    QUANTUM MACHINE INTELLIGENCE, 2022, 4 (01)
  • [3] The physics of energy-based models
    Patrick Huembeli
    Juan Miguel Arrazola
    Nathan Killoran
    Masoud Mohseni
    Peter Wittek
    Quantum Machine Intelligence, 2022, 4
  • [4] Conjugate Energy-Based Models
    Wu, Hao
    Esmaeili, Babak
    Wick, Michael
    Tristan, Jean-Baptiste
    van de Meent, Jan-Willem
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139
  • [5] A FRAMEWORK FOR PRUNING DEEP NEURAL NETWORKS USING ENERGY-BASED MODELS
    Salehinejad, Hojjat
    Valaee, Shahrokh
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 3920 - 3924
  • [6] Energy-based models for environmental biotechnology
    Rodriguez, Jorge
    Lema, Juan M.
    Kleerebezem, Robbert
    TRENDS IN BIOTECHNOLOGY, 2008, 26 (07) : 366 - 374
  • [7] Residual energy-based models for text
    Bakhtin, Anton
    Deng, Yuntian
    Gross, Sam
    Ott, Myle
    Ranzato, Marc'Aurelio
    Szlam, Arthur
    Journal of Machine Learning Research, 2021, 22
  • [8] Energy-Based Reranking: Improving Neural Machine Translation Using Energy-Based Models
    Bhattacharyya, Sumanta
    Rooshenas, Amirmohammad
    Naskar, Subhajit
    Sun, Simeng
    Iyyer, Mohit
    McCallum, Andrew
    59TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 11TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (ACL-IJCNLP 2021), VOL 1, 2021, : 4528 - 4537
  • [9] Energy-Based Models of P Systems
    Mauri, Giancarlo
    Leporati, Alberto
    Zandron, Claudio
    MEMBRANE COMPUTING, 2010, 5957 : 104 - 124
  • [10] Residual Energy-Based Models for Text
    Bakhtin, Anton
    Deng, Yuntian
    Gross, Sam
    Ott, Myle
    Ranzato, Marc'Aurelio
    Szlam, Arthur
    JOURNAL OF MACHINE LEARNING RESEARCH, 2021, 22