Task Selection and Resource Optimization in Multi-Task Federated Learning With Model Decomposition

被引:0
|
作者
Sun, Haowen [1 ]
Chen, Ming [1 ,2 ]
Yang, Zhaohui [3 ]
Pan, Yijin [1 ]
Cang, Yihan [1 ]
Zhang, Zhaoyang [3 ]
机构
[1] Southeast Univ, Natl Mobile Commun Res Lab, Nanjing 210096, Peoples R China
[2] Purple Mt Labs, Nanjing 211100, Peoples R China
[3] Zhejiang Univ, Coll Informat Sci & Elect Engn, Hangzhou 310027, Peoples R China
基金
中国国家自然科学基金;
关键词
Convergence; Data models; Uplink; Vectors; Training; Federated learning; Bandwidth; Resource management; Radio frequency; Distributed databases; Multi-task federated learning; resource allocation; non-IID data;
D O I
10.1109/LCOMM.2024.3511663
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
In this letter, we investigate the training latency minimization problem for a multi-task federated learning (FL) framework with model decomposition over wireless communication networks. To handle the non-independent and non-identically distributed (non-IID) data, we first transform the multi-class classification task into multiple binary classification tasks. We then introduce sampling equalization to ensure the convergence of FL system. The optimization problem aims to minimize the training latency under energy and FL convergence constraints by optimizing task selection, number of learning iterations, and communication resource allocation. We decompose it into three sub-problems and propose alternating algorithm to address each sub-problem iteratively. Numerical results validate that the proposed algorithm significantly reduces time consumption compared to the conventional algorithms.
引用
收藏
页码:225 / 229
页数:5
相关论文
共 50 条
  • [21] Sparse Tensor Decomposition for Multi-task Interaction Selection
    Jeong, Jun-Yong
    Jun, Chi-Hyuck
    2019 10TH IEEE INTERNATIONAL CONFERENCE ON BIG KNOWLEDGE (ICBK 2019), 2019, : 189 - 198
  • [22] Structured feature selection and task relationship inference for multi-task learning
    Hongliang Fei
    Jun Huan
    Knowledge and Information Systems, 2013, 35 : 345 - 364
  • [23] Structured feature selection and task relationship inference for multi-task learning
    Fei, Hongliang
    Huan, Jun
    KNOWLEDGE AND INFORMATION SYSTEMS, 2013, 35 (02) : 345 - 364
  • [24] Coalition based utility and efficiency optimization for multi-task federated learning in Internet of Vehicles
    Li, Zejun
    Wu, Hao
    Lu, Yunlong
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2023, 140 : 196 - 208
  • [25] On the Energy and Communication Efficiency Tradeoffs in Federated and Multi-Task Learning
    Savazzi, Stefano
    Rampa, Vittorio
    Kianoush, Sanaz
    Bennis, Mehdi
    2022 IEEE 33RD ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS (IEEE PIMRC), 2022, : 1431 - 1437
  • [26] Multi-Task Learning as Multi-Objective Optimization
    Sener, Ozan
    Koltun, Vladlen
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 31 (NIPS 2018), 2018, 31
  • [27] Efficient Multi-Task Asynchronous Federated Learning in Edge Computing
    Cao, Xinyuan
    Ouyang, Tao
    Zhao, Kongyange
    Li, Yousheng
    Chen, Xu
    2024 IEEE/ACM 32ND INTERNATIONAL SYMPOSIUM ON QUALITY OF SERVICE, IWQOS, 2024,
  • [28] Matching Game for Multi-Task Federated Learning in Internet of Vehicles
    Li, Zejun
    Wu, Hao
    Lu, Yunlong
    Ai, Bo
    Zhong, Zhangdui
    Zhang, Yan
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (02) : 1623 - 1636
  • [29] Multi-Task Network Anomaly Detection using Federated Learning
    Zhao, Ying
    Chen, Junjun
    Wu, Di
    Teng, Jian
    Yu, Shui
    SOICT 2019: PROCEEDINGS OF THE TENTH INTERNATIONAL SYMPOSIUM ON INFORMATION AND COMMUNICATION TECHNOLOGY, 2019, : 273 - 279
  • [30] A Resource Allocation Strategy in Internet of Vehicles Based on Multi-Task Federated Learning and Incentive Mechanism
    Zhang, Jianquan
    Huang, Fangting
    Zhu, Shuqing
    Xiao, Xiao
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2025,