Projection-free Decentralized Online Learning for Submodular Maximization over Time-Varying Networks

被引:0
|
作者
Zhu, Junlong [1 ]
Wu, Qingtao [1 ]
Zhang, Mingchuan [1 ]
Zheng, Ruijuan [1 ]
Li, Keqin [2 ]
机构
[1] Henan Univ Sci & Technol, Sch Informat Engn, Luoyang 471023, Peoples R China
[2] State Univ New York New Paltz, Dept Comp Sci, New Paltz, NY 12561 USA
基金
中国国家自然科学基金;
关键词
Expected Regret Bound; Frank-Wolfe Algorithm; Submodular Maximization; CONVEX-OPTIMIZATION; APPROXIMATIONS;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper considers a decentralized online submodular maximization problem over time-varying networks, where each agent only utilizes its own information and the received information from its neighbors. To address the problem, we propose a decentralized Meta-Frank-Wolfe online learning method in the adversarial online setting by using local communication and local computation. Moreover, we show that an expected regret bound of O(root T) is achieved with (1-1/e) approximation guarantee, where T is a time horizon. In addition, we also propose a decentralized one-shot Frank-Wolfe online learning method in the stochastic online setting. Furthermore, we also show that an expected regret bound O(T-2/3) is obtained with (1 - 1/e) approximation guarantee. Finally, we confirm the theoretical results via various experiments on different datasets.
引用
收藏
页数:42
相关论文
共 50 条
  • [1] Projection-free decentralized online learning for submodular maximization over time-varying networks
    Zhu, Junlong
    Wu, Qingtao
    Zhang, Mingchuan
    Zheng, Ruijuan
    Li, Keqin
    [J]. Journal of Machine Learning Research, 2021, 22
  • [2] Projection-free Distributed Online Learning in Networks
    Zhang, Wenpeng
    Zhao, Peilin
    Zhu, Wenwu
    Hoi, Steven C. H.
    Zhang, Tong
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 70, 2017, 70
  • [3] Projection-free Online Learning over Strongly Convex Sets
    Wan, Yuanyu
    Zhang, Lijun
    [J]. THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 10076 - 10084
  • [4] Fast Projection-Free Algorithm for Distributed Online Learning in Networks
    Wang, Jun-ya
    Li, De-quan
    Zhou, Yue-jin
    Lv, Jing-ge
    Dong, Qiao
    [J]. 2018 IEEE 18TH INTERNATIONAL CONFERENCE ON COMMUNICATION TECHNOLOGY (ICCT), 2018, : 1335 - 1341
  • [5] Riemannian Projection-free Online Learning
    Hu, Zihao
    Wang, Guanghui
    Abernethy, Jacob
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [6] Projection-free Online Learning in Dynamic Environments
    Wan, Yuanyu
    Xue, Bo
    Zhang, Lijun
    [J]. THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 10067 - 10075
  • [7] Decentralized Dictionary Learning Over Time-Varying Digraphs
    Daneshmand, Amir
    Sun, Ying
    Scutari, Gesualdo
    Facchinei, Francisco
    Sadler, Brian M.
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2019, 20
  • [8] Decentralized dictionary learning over time-varying digraphs
    Daneshmand, Amir
    Sun, Ying
    Scutari, Gesualdo
    Facchinei, Francisco
    Sadler, Brian M.
    [J]. Journal of Machine Learning Research, 2019, 20
  • [9] Decentralized optimization with affine constraints over time-varying networks
    Yarmoshik, Demyan
    Rogozin, Alexander
    Gasnikov, Alexander
    [J]. COMPUTATIONAL MANAGEMENT SCIENCE, 2024, 21 (01)
  • [10] Distributed Adaptive Subgradient Algorithms for Online Learning Over Time-Varying Networks
    Zhang, Mingchuan
    Hao, Bowei
    Ge, Quanbo
    Zhu, Junlong
    Zheng, Ruijuan
    Wu, Qingtao
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2022, 52 (07): : 4518 - 4529