Online Learning for IoT Optimization: A Frank-Wolfe Adam-Based Algorithm

被引:24
|
作者
Zhang, Mingchuan [1 ]
Zhou, Yangfan [1 ]
Quan, Wei [2 ]
Zhu, Junlong [1 ]
Zheng, Ruijuan [1 ]
Wu, Qingtao [1 ]
机构
[1] Henan Univ Sci & Technol, Sch Informat Engn, Luoyang 471023, Peoples R China
[2] Beijing Jiaotong Univ, Sch Elect & Informat Engn, Beijing 100044, Peoples R China
基金
中国国家自然科学基金;
关键词
Adam; Frank-Wolfe; Internet of Things (IoT); online learning; INTERNET; THINGS; NETWORKING; SECURITY;
D O I
10.1109/JIOT.2020.2984011
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Many problems in the Internet of Things (IoT) can be regarded as online optimization problems. For this reason, an online-constrained problem in IoT is considered in this article, where the cost functions change over time. To solve this problem, many projected online optimization algorithms have been widely used. However, the projections of these algorithms become prohibitive in problems involving high-dimensional parameters and massive data. To address this issue, we propose a Frank-Wolfe Adam online learning algorithm called Frank-Wolfe Adam (FWAdam), which uses a Frank-Wolfe method to eschew costly projection operations. Furthermore, we first give the convergence analysis of the FWAdam algorithm, and prove its regret bound to T when cost functions are convex, where T is a time horizon. Finally, we present simulated experiments on two data sets to validate our theoretical results.
引用
下载
收藏
页码:8228 / 8237
页数:10
相关论文
共 50 条
  • [41] Robust matrix estimations meet Frank-Wolfe algorithm
    Jing, Naimin
    Fang, Ethan X. X.
    Tang, Cheng Yong
    MACHINE LEARNING, 2023, 112 (07) : 2723 - 2760
  • [42] Polytope Conditioning and Linear Convergence of the Frank-Wolfe Algorithm
    Pena, Javier
    Rodriguez, Daniel
    MATHEMATICS OF OPERATIONS RESEARCH, 2019, 44 (01) : 1 - 18
  • [43] Generalized stochastic Frank-Wolfe algorithm with stochastic "substitute" gradient for structured convex optimization
    Lu, Haihao
    Freund, Robert M.
    MATHEMATICAL PROGRAMMING, 2021, 187 (1-2) : 317 - 349
  • [44] Frank-Wolfe algorithm for learning SVM-type multi-category classifiers
    Tajima K.
    Hirohashi Y.
    Zara E.
    Kato T.
    IEICE Transactions on Information and Systems, 2021, 104 (11) : 1923 - 1929
  • [45] Escaping the curse of dimensionality in similarity learning: Efficient Frank-Wolfe algorithm and generalization bounds
    Liu, Kuan
    Bellet, Aurelien
    NEUROCOMPUTING, 2019, 333 : 185 - 199
  • [46] Frank-Wolfe Algorithm for Learning SVM-Type Multi-Category Classifiers
    Tajima, Kenya
    Hirohashi, Yoshihiro
    Zara, Esmeraldo
    Kato, Tsuyoshi
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2021, E104D (11): : 1923 - 1929
  • [47] A Communication-Efficient Distributed Frank-Wolfe Online Algorithm with an Event-Triggered Mechanism
    Huimin Gao
    Muhua Liu
    Zhihang Ji
    Ruijuan Zheng
    Qingtao Wu
    Cognitive Computation, 2025, 17 (2)
  • [49] A MODIFIED FRANK-WOLFE ALGORITHM FOR TENSOR FACTORIZATIONWITH UNIMODAL SIGNALS
    Chen, Junting
    Mitra, Urbashi
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 7938 - 7942
  • [50] Spectral Frank-Wolfe Algorithm: Strict Complementarity and Linear Convergence
    Ding, Lijun
    Fei, Yingjie
    Xu, Qiantong
    Yang, Chengrun
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 119, 2020, 119