Design of Neural Network With Levenberg-Marquardt and Bayesian Regularization Backpropagation for Solving Pantograph Delay Differential Equations

被引:80
|
作者
Khan, Imtiaz [1 ]
Raja, Muhammad Asif Zahoor [2 ,3 ]
Shoaib, Muhammad [4 ]
Kumam, Poom [5 ,6 ]
Alrabaiah, Hussam [7 ,8 ]
Shah, Zahir [9 ]
Islam, Saeed [1 ,10 ,11 ]
机构
[1] Abdul Wali Khan Univ Mardan, Dept Math, Mardan 23200, Pakistan
[2] Natl Yunlin Univ Sci & Technol, Future Technol Res Ctr, Touliu 64002, Yunlin, Taiwan
[3] COMSATS Univ Islamabad, Dept Elect & Comp Engn, Attock Campus, Attock 43600, Pakistan
[4] COMSATS Univ Islamabad, Dept Math, Attock Campus, Attock 43600, Pakistan
[5] King Mongkuts Univ Technol Thonburi KMUTT, Dept Math, KMUTT Fixed Point Res Lab, Fac Sci,Room SCL 802 Fixed Point Lab,Sci Lab Bldg, Bangkok 10140, Thailand
[6] China Med Univ, China Med Univ Hosp, Dept Med Res, Taichung 40402, Taiwan
[7] Al Ain Univ, Coll Engn, Al Ain, U Arab Emirates
[8] Tafila Tech Univ, Dept Math, Tafila 66110, Jordan
[9] King Mongkuts Univ Technol Thonburi KMUTT, Ctr Excellence Theoret & Computat Sci TaCS CoE, SCL 802 Fixed Point Lab, Bangkok 10140, Thailand
[10] Ton Duc Thang Univ, Fac Math & Stat, Ho Chi Minh City 70000, Vietnam
[11] Ton Duc Thang Univ, Informetr Res Grp, Ho Chi Minh City 70000, Vietnam
关键词
Mathematical model; Differential equations; Integrated circuit modeling; Solid modeling; Analytical models; Delays; Backpropagation; Artificial neural networks; Levenberg-Marquardt method; Bayesian regularization method; nonlinear pantograph equation; regression analysis; intelligent computing; numerical computing; INTERIOR-POINT ALGORITHM; COMPUTATIONAL INTELLIGENCE; APPROXIMATE SOLUTIONS; OPERATIONAL MATRIX; DYNAMICS; SYSTEMS; PARADIGMS; ANALYZE; MODEL; FLUID;
D O I
10.1109/ACCESS.2020.3011820
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, novel computing paradigm by exploiting the strength of feed-forward artificial neural networks (ANNs) with Levenberg-Marquardt Method (LMM), and Bayesian Regularization Method (BRM) based backpropagation is presented to find the solutions of initial value problems (IVBs) of linear/nonlinear pantograph delay differential equations (LP/NP-DDEs). The dataset for training, testing and validation is created with reference to known standard solutions of LP/NP-DDEs. ANNs are implemented using the said dataset for approximate modeling of the system on mean squared error based merit functions, while learning of the adjustable parameters is conducted with efficacy of LMM (ANN-LMM) and BRMs (ANN-BRM). The performance of the designed algorithms ANN-LMM and ANN-BRM on IVPs of first, second and third order NP-FDEs are verified by attaining a good agreement with the available solutions having accuracy in the range from 10(-5) to 10(-8) and are further endorsed through error histograms and regression measures.
引用
收藏
页码:137918 / 137933
页数:16
相关论文
共 50 条
  • [41] Smoothing Levenberg-Marquardt algorithm for solving non-Lipschitz absolute value equations
    Yilmaz, Nurullah
    Kayacan, Aysegul
    [J]. JOURNAL OF APPLIED ANALYSIS, 2023, 29 (02) : 277 - 286
  • [42] A DISCRETIZING LEVENBERG-MARQUARDT SCHEME FOR SOLVING NONLIEAR ILL-POSED INTEGRAL EQUATIONS
    Zhang, Rong
    Yang, Hongqi
    [J]. JOURNAL OF COMPUTATIONAL MATHEMATICS, 2022, 40 (05) : 690 - 714
  • [43] A Levenberg-Marquardt Backpropagation Neural Network for Predicting Forest Growing Stock Based on the Least-Squares Equation Fitting Parameters
    Zhou, Ruyi
    Wu, Dasheng
    Fang, Luming
    Xu, Aijun
    Lou, Xiongwei
    [J]. FORESTS, 2018, 9 (12)
  • [45] Lateral control of autonomous vehicle using levenberg-marquardt neural network algorithm
    Lee, K.B.
    Kim, Y.J.
    Ahn, O.S.
    Kim, Y.B.
    [J]. International Journal of Automotive Technology, 2002, 3 (02) : 79 - 88
  • [46] An Improved Levenberg-Marquardt Algorithm with Adaptive Learning Rate for RBF Neural Network
    An Ru
    Li Wen Jing
    Han Hong Gui
    Qiao Jun Fei
    [J]. PROCEEDINGS OF THE 35TH CHINESE CONTROL CONFERENCE 2016, 2016, : 3630 - 3635
  • [47] A Novel Modification on the Levenberg-Marquardt Algorithm for Avoiding Overfitting in Neural Network Training
    Iplikci, Serdar
    Bilgi, Batuhan
    Menemen, Ali
    Bahtiyar, Bedri
    [J]. ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2019: DEEP LEARNING, PT II, 2019, 11728 : 201 - 207
  • [48] On a multilevel Levenberg-Marquardt method for the training of artificial neural networks and its application to the solution of partial differential equations
    Calandra, H.
    Gratton, S.
    Riccietti, E.
    Vasseur, X.
    [J]. OPTIMIZATION METHODS & SOFTWARE, 2022, 37 (01): : 361 - 386
  • [49] Bayesian regularization-based Levenberg-Marquardt neural model combined with BFOA for improving surface finish of FDM processed part
    Mahapatra, S. S.
    Sood, Anoop Kumar
    [J]. INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2012, 60 (9-12): : 1223 - 1235
  • [50] Backpropagation of Levenberg-Marquardt artificial neural networks for reverse roll coating process in the bath of Sisko fluid
    Ali, Fateh
    Hou, Yanren
    Feng, Xinlong
    [J]. EUROPEAN PHYSICAL JOURNAL PLUS, 2023, 138 (10):