Robust Standard Gradient Descent Algorithm for ARX Models Using Aitken Acceleration Technique

被引：14

作者：

Chen, Jing ^{[1
]}

Gan, Min ^{[2
]}

Zhu, Quanmin ^{[3
]}

Narayan, Pritesh ^{[3
]}

Liu, Yanjun ^{[4
]}

机构：

[1] Jiangnan Univ, Sch Sci, Wuxi 214122, Jiangsu, Peoples R China

[2] Qingdao Univ, Coll Comp Sci & Technol, Qingdao 266071, Peoples R China

[3] Univ West England, Dept Engn Design & Math, Bristol BS16 1QY, Avon, England

[4] Jiangnan Univ, Key Lab Adv Proc Control Light Ind, Minist Educ, Wuxi 214122, Jiangsu, Peoples R China

来源：

IEEE TRANSACTIONS ON CYBERNETICS | 2022年 / 52卷 / 09期

基金：

中国国家自然科学基金;

关键词：

Convergence; Acceleration; Mathematical model; Standards; Parameter estimation; Nonlinear equations; Computational modeling; Aitken acceleration technique; ARX model; convergence rate; parameter estimation; standard gradient descent (SGD) algorithm; LINEAR-SYSTEMS; IDENTIFICATION;

D O I：

10.1109/TCYB.2021.3063113

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

A robust standard gradient descent (SGD) algorithm for ARX models using the Aitken acceleration method is developed. Considering that the SGD algorithm has slow convergence rates and is sensitive to the step size, a robust and accelerative SGD (RA-SGD) algorithm is derived. This algorithm is based on the Aitken acceleration method, and its convergence rate is improved from linear convergence to at least quadratic convergence in general. Furthermore, the RA-SGD algorithm is always convergent with no limitation of the step size. Both the convergence analysis and the simulation examples demonstrate that the presented algorithm is effective.

引用

页码：9646 / 9655

页数：10

共 50 条

[31] Efficient gradient descent algorithm for sparse models with application in learning-to-rank
Lai, Hanjiang
Pan, Yan
Tang, Yong
Liu, Ning
KNOWLEDGE-BASED SYSTEMS, 2013, 49 : 190 - 198
[32] A new filter-based stochastic gradient algorithm for dual-rate ARX models
Chen, Jing
Liu, Yanjun
Xu, Ling
INTERNATIONAL JOURNAL OF ADAPTIVE CONTROL AND SIGNAL PROCESSING, 2018, 32 (11) : 1557 - 1568
[33] Aitken based modified Kalman filtering stochastic gradient algorithm for dual-rate nonlinear models
Chen, Jing
Zhang, Yong
Zhu, Quanmin
Liu, Yanjun
JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2019, 356 (08): : 4732 - 4746
[34] Solving Electromagnetic Inverse Problem Using Adaptive Gradient Descent Algorithm
Liu, Lian
Yang, Bo
Zhang, Yi
Xu, Yixian
Peng, Zhong
Wang, Feng
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
[35] Using the Stochastic Gradient Descent Optimization Algorithm on Estimating of Reactivity Ratios
Fazakas-Anca, Iosif Sorin
Modrea, Arina
Vlase, Sorin
MATERIALS, 2021, 14 (16)
[36] Distributed mirror descent algorithm over unbalanced digraphs based on gradient weighting technique
Shi, Chong-Xiao
Yang, Guang-Hong
JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2023, 360 (14): : 10656 - 10680
[37] Accelerating the Iteratively Preconditioned Gradient-Descent Algorithm using Momentum
Liu, Tianchen
Chakrabarti, Kushal
Chopra, Nikhil
2023 NINTH INDIAN CONTROL CONFERENCE, ICC, 2023, : 68 - 73
[38] Improved specular point prediction precision using gradient descent algorithm
Tian, Yusen
Xia, Junming
Sun, Yueqiang
Wang, Xianyi
Du, Qifei
Bai, Weihua
Wang, Dongwei
Cai, Yuerong
Wu, Chunjun
Li, Fu
Qiao, Hao
ADVANCES IN SPACE RESEARCH, 2020, 65 (06) : 1568 - 1579
[39] Compressive Sensing based Image Watermarking using Gradient Descent Algorithm
Cadjenovic, Ana
Bakic, Jelena
2016 5TH MEDITERRANEAN CONFERENCE ON EMBEDDED COMPUTING (MECO), 2016, : 385 - 388
[40] Parametric Tracking of Electrical Current Components Using Gradient Descent Algorithm
Frini, Marouane
Choqueuse, Vincent
Auger, Francois
PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART C-JOURNAL OF MECHANICAL ENGINEERING SCIENCE, 2022, 236 (16) : 8834 - 8841

← 1 2 3 4 5 →