Online Learning for IoT Optimization: A Frank-Wolfe Adam-Based Algorithm

被引:24
|
作者
Zhang, Mingchuan [1 ]
Zhou, Yangfan [1 ]
Quan, Wei [2 ]
Zhu, Junlong [1 ]
Zheng, Ruijuan [1 ]
Wu, Qingtao [1 ]
机构
[1] Henan Univ Sci & Technol, Sch Informat Engn, Luoyang 471023, Peoples R China
[2] Beijing Jiaotong Univ, Sch Elect & Informat Engn, Beijing 100044, Peoples R China
基金
中国国家自然科学基金;
关键词
Adam; Frank-Wolfe; Internet of Things (IoT); online learning; INTERNET; THINGS; NETWORKING; SECURITY;
D O I
10.1109/JIOT.2020.2984011
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Many problems in the Internet of Things (IoT) can be regarded as online optimization problems. For this reason, an online-constrained problem in IoT is considered in this article, where the cost functions change over time. To solve this problem, many projected online optimization algorithms have been widely used. However, the projections of these algorithms become prohibitive in problems involving high-dimensional parameters and massive data. To address this issue, we propose a Frank-Wolfe Adam online learning algorithm called Frank-Wolfe Adam (FWAdam), which uses a Frank-Wolfe method to eschew costly projection operations. Furthermore, we first give the convergence analysis of the FWAdam algorithm, and prove its regret bound to T when cost functions are convex, where T is a time horizon. Finally, we present simulated experiments on two data sets to validate our theoretical results.
引用
下载
收藏
页码:8228 / 8237
页数:10
相关论文
共 50 条
  • [31] Efficient Online Learning with Memory via Frank-Wolfe Optimization: Algorithms with Bounded Dynamic Regret and Applications to Control
    Zhou, Hongyu
    Xu, Zirui
    Tzoumas, Vasileios
    2023 62ND IEEE CONFERENCE ON DECISION AND CONTROL, CDC, 2023, : 8266 - 8273
  • [32] A MODIFIED FRANK-WOLFE ALGORITHM AND ITS CONVERGENCE PROPERTIES
    吴方
    吴士泉
    Acta Mathematicae Applicatae Sinica, 1995, (03) : 285 - 291
  • [33] Coresets, Sparse Greedy Approximation, and the Frank-Wolfe Algorithm
    Clarkson, Kenneth L.
    ACM TRANSACTIONS ON ALGORITHMS, 2010, 6 (04)
  • [34] On the Global Linear Convergence of Frank-Wolfe Optimization Variants
    Lacoste-Julien, Simon
    Jaggi, Martin
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 28 (NIPS 2015), 2015, 28
  • [35] CONVERGENCE OF THE FRANK-WOLFE ALGORITHM IN TRANSPORTATION NETWORKS.
    Lupi, Marino
    Civil Engineering Systems, 1986, 3 (01): : 7 - 15
  • [36] Decentralized Frank-Wolfe Algorithm for Convex and Nonconvex Problems
    Wai, Hoi-To
    Lafond, Jean
    Scaglione, Anna
    Moulines, Eric
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2017, 62 (11) : 5522 - 5537
  • [37] Coresets, Sparse Greedy Approximation, and the Frank-Wolfe Algorithm
    Clarkson, Kenneth L.
    PROCEEDINGS OF THE NINETEENTH ANNUAL ACM-SIAM SYMPOSIUM ON DISCRETE ALGORITHMS, 2008, : 922 - 931
  • [38] A Fast and Scalable Polyatomic Frank-Wolfe Algorithm for the LASSO
    Jarret, Adrian
    Fageot, Julien
    Simeoni, Matthieu
    IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 637 - 641
  • [39] Communication-Efficient Frank-Wolfe Algorithm for Nonconvex Decentralized Distributed Learning
    Xian, Wenhan
    Huang, Feihu
    Huang, Heng
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 10405 - 10413
  • [40] Frank-Wolfe Style Algorithms for Large Scale Optimization
    Ding, Lijun
    Udell, Madeleine
    LARGE-SCALE AND DISTRIBUTED OPTIMIZATION, 2018, 2227 : 215 - 245