An improved Adagrad gradient descent optimization algorithm

被引：0

作者：

Zhang, N. ^{[1
]}

Lei, D. ^{[1
]}

Zhao, J. F. ^{[1
]}

机构：

[1] Shanghai Univ, Sch Mech Engn & Automat, Shanghai, Peoples R China

来源：

2018 CHINESE AUTOMATION CONGRESS (CAC) | 2018年

关键词：

deep learning; gradient descent; convergence; overfitting;

D O I：

暂无

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

Gradient descent optimization algorithm is very important in deep learning. In order to obtain a more stable convergence process and reduce overfitting in multiple epochs, we propose an improved Adagrad gradient descent optimization algorithm in this paper. Our approach is tested both on the Reuters dataset and the IMDB dataset with many gradient descent optimization algorithms. The results show that our approach has a more stable convergence process and can reduce overfitting in multiple epochs.

引用

页码：2359 / 2362

页数：4

共 50 条

[21] A Stochastic Gradient Descent Algorithm for Antenna Tilt Optimization in Cellular Networks
Liu, Yaxi
Wei Huangfu
Zhang, Haijun
Long, Keping
2018 10TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING (WCSP), 2018,
[22] A New Conjugate Gradient Algorithm with Sufficient Descent Property for Unconstrained Optimization
Wu, XiaoPing
Liu, LiYing
Xie, FengJie
Li, YongFei
MATHEMATICAL PROBLEMS IN ENGINEERING, 2015, 2015
[23] BRDF modeling and optimization of a target surface based on the gradient descent algorithm
Li, Yanhui
Yang, Pengfei
Bai, Lu
Zhang, Zifei
APPLIED OPTICS, 2023, 62 (36) : 9486 - 9492
[24] Using the Stochastic Gradient Descent Optimization Algorithm on Estimating of Reactivity Ratios
Fazakas-Anca, Iosif Sorin
Modrea, Arina
Vlase, Sorin
MATERIALS, 2021, 14 (16)
[25] Optimization of the Heart Pump Geometry based on Multiple Gradient Descent Algorithm
Iscan, Mehmet
Kadipasaoglu, Kamuran
2017 ELECTRIC ELECTRONICS, COMPUTER SCIENCE, BIOMEDICAL ENGINEERINGS' MEETING (EBBT), 2017,
[26] A gradient descent algorithm for LASSO
Kim, Yongdai
Kim, Yuwon
Kim, Jinseog
PREDICTION AND DISCOVERY, 2007, 443 : 73 - 82
[27] Hybrid FCM learning algorithm based on particle swarm optimization and gradient descent algorithm
Chen, Jun
Zhang, Yue
Gao, Xudong
16TH IEEE INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION, ROBOTICS AND VISION (ICARCV 2020), 2020, : 801 - 806
[28] A UAV attitude fusion algorithm based on gradient descent-improved EKF
Zhao, Guiling
Wang, Yuan
Liang, Weidong
Zhao, Hongxing
EARTH SCIENCE INFORMATICS, 2025, 18 (02)
[29] Distributed Randomized Gradient-Free Mirror Descent Algorithm for Constrained Optimization
Yu, Zhan
Ho, Daniel W. C.
Yuan, Deming
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2022, 67 (02) : 957 - 964
[30] An Accelerated Coordinate Gradient Descent Algorithm for Non-separable Composite Optimization
Aberdam, Aviad
Beck, Amir
JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2022, 193 (1-3) : 219 - 246

← 1 2 3 4 5 →