Online Learning for IoT Optimization: A Frank-Wolfe Adam-Based Algorithm

被引:24
|
作者
Zhang, Mingchuan [1 ]
Zhou, Yangfan [1 ]
Quan, Wei [2 ]
Zhu, Junlong [1 ]
Zheng, Ruijuan [1 ]
Wu, Qingtao [1 ]
机构
[1] Henan Univ Sci & Technol, Sch Informat Engn, Luoyang 471023, Peoples R China
[2] Beijing Jiaotong Univ, Sch Elect & Informat Engn, Beijing 100044, Peoples R China
基金
中国国家自然科学基金;
关键词
Adam; Frank-Wolfe; Internet of Things (IoT); online learning; INTERNET; THINGS; NETWORKING; SECURITY;
D O I
10.1109/JIOT.2020.2984011
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Many problems in the Internet of Things (IoT) can be regarded as online optimization problems. For this reason, an online-constrained problem in IoT is considered in this article, where the cost functions change over time. To solve this problem, many projected online optimization algorithms have been widely used. However, the projections of these algorithms become prohibitive in problems involving high-dimensional parameters and massive data. To address this issue, we propose a Frank-Wolfe Adam online learning algorithm called Frank-Wolfe Adam (FWAdam), which uses a Frank-Wolfe method to eschew costly projection operations. Furthermore, we first give the convergence analysis of the FWAdam algorithm, and prove its regret bound to T when cost functions are convex, where T is a time horizon. Finally, we present simulated experiments on two data sets to validate our theoretical results.
引用
下载
收藏
页码:8228 / 8237
页数:10
相关论文
共 50 条
  • [21] Stochastic Frank-Wolfe Methods for Nonconvex Optimization
    Reddi, Sashank J.
    Sra, Suvrit
    Poczos, Barnabas
    Smola, Alex
    2016 54TH ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING (ALLERTON), 2016, : 1244 - 1251
  • [22] Riemannian Optimization via Frank-Wolfe Methods
    Weber, Melanie
    Sra, Suvrit
    MATHEMATICAL PROGRAMMING, 2023, 199 (1-2) : 525 - 556
  • [23] The Iterates of the Frank-Wolfe Algorithm May Not Converge
    Bolte, Jerome
    Combettes, Cyrille W.
    Pauwelsb, Edouard
    MATHEMATICS OF OPERATIONS RESEARCH, 2023, 49 (04) : 2565 - 2578
  • [24] ON IMPROVING RATE OF CONVERGENCE OF FRANK-WOLFE ALGORITHM
    CANON, MD
    CULLUM, CD
    WOLFE, P
    SIAM REVIEW, 1968, 10 (04) : 470 - &
  • [25] A Momentum-Guided Frank-Wolfe Algorithm
    Li, Bingcong
    Coutino, Mario
    B. Giannakis, Georgios
    Leus, Geert
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2021, 69 : 3597 - 3611
  • [26] Correcting Covariate Shift with the Frank-Wolfe Algorithm
    Wen, Junfeng
    Greiner, Russell
    Schuurmans, Dale
    PROCEEDINGS OF THE TWENTY-FOURTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE (IJCAI), 2015, : 1010 - 1016
  • [27] A Neural Network Implementation of Frank-Wolfe Optimization
    Bauckhage, Christian
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2017, PT I, 2017, 10613 : 219 - 226
  • [28] On a Frank-Wolfe type theorem in cubic optimization
    Klatte, Diethard
    OPTIMIZATION, 2019, 68 (2-3) : 539 - 547
  • [29] Improved dynamic regret of distributed online multiple Frank-Wolfe convex optimization
    Wentao ZHANG
    Yang SHI
    Baoyong ZHANG
    Deming YUAN
    Science China(Information Sciences), 2024, 67 (11) : 164 - 179
  • [30] Improved dynamic regret of distributed online multiple Frank-Wolfe convex optimization
    Zhang, Wentao
    Shi, Yang
    Zhang, Baoyong
    Yuan, Deming
    Science China Information Sciences, 2024, 67 (11)