Online Learning for IoT Optimization: A Frank-Wolfe Adam-Based Algorithm

被引:24
|
作者
Zhang, Mingchuan [1 ]
Zhou, Yangfan [1 ]
Quan, Wei [2 ]
Zhu, Junlong [1 ]
Zheng, Ruijuan [1 ]
Wu, Qingtao [1 ]
机构
[1] Henan Univ Sci & Technol, Sch Informat Engn, Luoyang 471023, Peoples R China
[2] Beijing Jiaotong Univ, Sch Elect & Informat Engn, Beijing 100044, Peoples R China
基金
中国国家自然科学基金;
关键词
Adam; Frank-Wolfe; Internet of Things (IoT); online learning; INTERNET; THINGS; NETWORKING; SECURITY;
D O I
10.1109/JIOT.2020.2984011
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Many problems in the Internet of Things (IoT) can be regarded as online optimization problems. For this reason, an online-constrained problem in IoT is considered in this article, where the cost functions change over time. To solve this problem, many projected online optimization algorithms have been widely used. However, the projections of these algorithms become prohibitive in problems involving high-dimensional parameters and massive data. To address this issue, we propose a Frank-Wolfe Adam online learning algorithm called Frank-Wolfe Adam (FWAdam), which uses a Frank-Wolfe method to eschew costly projection operations. Furthermore, we first give the convergence analysis of the FWAdam algorithm, and prove its regret bound to T when cost functions are convex, where T is a time horizon. Finally, we present simulated experiments on two data sets to validate our theoretical results.
引用
下载
收藏
页码:8228 / 8237
页数:10
相关论文
共 50 条
  • [1] Dynamic Online Learning via Frank-Wolfe Algorithm
    Kalhan, Deepak S.
    Singh Bedi, Amrit
    Koppel, Alec
    Rajawat, Ketan
    Hassani, Hamed
    Gupta, Abhishek K.
    Banerjee, Adrish
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2021, 69 : 932 - 947
  • [2] Online Orthogonal Dictionary Learning Based on Frank-Wolfe Method
    Xue, Ye
    Lau, Vincent K. N.
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (09) : 5774 - 5788
  • [3] Federated Frank-Wolfe Algorithm
    Dadras, Ali
    Banerjee, Sourasekhar
    Prakhya, Karthik
    Yurtsever, Alp
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES: RESEARCH TRACK, PT III, ECML PKDD 2024, 2024, 14943 : 58 - 75
  • [4] FRANK-WOLFE ALGORITHM FROM OPTIMIZATION TO EQUILIBRIUM PROBLEMS
    Moudafi, Abdellatif
    JOURNAL OF NONLINEAR AND CONVEX ANALYSIS, 2019, 20 (11) : 2335 - 2345
  • [5] Distributed Momentum-Based Frank-Wolfe Algorithm for Stochastic Optimization
    Hou, Jie
    Zeng, Xianlin
    Wang, Gang
    Sun, Jian
    Chen, Jie
    IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2023, 10 (03) : 685 - 699
  • [6] A Frank-Wolfe Based Algorithm for Robust Discrete Optimization Under Uncertainty
    Al Dahik, Chifaa
    Al Masry, Zeina
    Chretien, Stephane
    Nicod, Jean-Marc
    Rabehasaina, Landy
    2020 PROGNOSTICS AND SYSTEM HEALTH MANAGEMENT CONFERENCE (PHM-BESANCON 2020), 2020, : 247 - 252
  • [7] Distributed Momentum-Based Frank-Wolfe Algorithm for Stochastic Optimization
    Jie Hou
    Xianlin Zeng
    Gang Wang
    Jian Sun
    Jie Chen
    IEEE/CAA Journal of Automatica Sinica, 2023, 10 (03) : 685 - 699
  • [8] Online Frank-Wolfe with Arbitrary Delays
    Wan, Yuanyu
    Tu, Wei-Wei
    Zhang, Lijun
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35, NEURIPS 2022, 2022,
  • [9] The Frank-Wolfe Algorithm: A Short Introduction
    Pokutta S.
    Jahresbericht der Deutschen Mathematiker-Vereinigung, 2024, 126 (1) : 3 - 35
  • [10] Adaptive Variant of the Frank-Wolfe Algorithm for Convex Optimization Problems
    Aivazian, G. V.
    Stonyakin, F. S.
    Pasechnyk, D. A.
    Alkousa, M. S.
    Raigorodsky, A. M.
    Baran, I. V.
    PROGRAMMING AND COMPUTER SOFTWARE, 2023, 49 (06) : 493 - 504