Task Selection and Resource Optimization in Multi-Task Federated Learning With Model Decomposition

被引:0
|
作者
Sun, Haowen [1 ]
Chen, Ming [1 ,2 ]
Yang, Zhaohui [3 ]
Pan, Yijin [1 ]
Cang, Yihan [1 ]
Zhang, Zhaoyang [3 ]
机构
[1] Southeast Univ, Natl Mobile Commun Res Lab, Nanjing 210096, Peoples R China
[2] Purple Mt Labs, Nanjing 211100, Peoples R China
[3] Zhejiang Univ, Coll Informat Sci & Elect Engn, Hangzhou 310027, Peoples R China
基金
中国国家自然科学基金;
关键词
Convergence; Data models; Uplink; Vectors; Training; Federated learning; Bandwidth; Resource management; Radio frequency; Distributed databases; Multi-task federated learning; resource allocation; non-IID data;
D O I
10.1109/LCOMM.2024.3511663
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
In this letter, we investigate the training latency minimization problem for a multi-task federated learning (FL) framework with model decomposition over wireless communication networks. To handle the non-independent and non-identically distributed (non-IID) data, we first transform the multi-class classification task into multiple binary classification tasks. We then introduce sampling equalization to ensure the convergence of FL system. The optimization problem aims to minimize the training latency under energy and FL convergence constraints by optimizing task selection, number of learning iterations, and communication resource allocation. We decompose it into three sub-problems and propose alternating algorithm to address each sub-problem iteratively. Numerical results validate that the proposed algorithm significantly reduces time consumption compared to the conventional algorithms.
引用
收藏
页码:225 / 229
页数:5
相关论文
共 50 条
  • [1] Federated Multi-Task Learning
    Smith, Virginia
    Chiang, Chao-Kai
    Sanjabi, Maziar
    Talwalkar, Ameet
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 30 (NIPS 2017), 2017, 30
  • [2] Federated Multi-task Graph Learning
    Liu, Yijing
    Han, Dongming
    Zhang, Jianwei
    Zhu, Haiyang
    Xu, Mingliang
    Chen, Wei
    ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2022, 13 (05)
  • [3] Joint Client Selection and Task Assignment for Multi-Task Federated Learning in MEC Networks
    Cheng, Zhipeng
    Min, Minghui
    Liwang, Minghui
    Gao, Zhibin
    Huang, Lianfen
    2021 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2021,
  • [4] Powering Multi-Task Federated Learning with Competitive GPU Resource Sharing
    Yu, Yongbo
    Yu, Fuxun
    Xu, Zirui
    Wang, Di
    Zhang, Mingjia
    Li, Ang
    Bray, Shawn
    Liu, Chenchen
    Chen, Xiang
    COMPANION PROCEEDINGS OF THE WEB CONFERENCE 2022, WWW 2022 COMPANION, 2022, : 567 - 571
  • [5] Task-Aware Dynamic Model Optimization for Multi-Task Learning
    Choi, Sujin
    Jin, Hyundong
    Kim, Eunwoo
    IEEE ACCESS, 2023, 11 : 137709 - 137717
  • [6] HFedMTL: Hierarchical Federated Multi-Task Learning
    Yi, Xingfu
    Li, Rongpeng
    Peng, Chenghui
    Wu, Jianjun
    Zhao, Zhifeng
    2022 IEEE 33RD ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS (IEEE PIMRC), 2022,
  • [7] Variable Selection and Task Grouping for Multi-Task Learning
    Jeong, Jun-Yong
    Jun, Chi-Hyuck
    KDD'18: PROCEEDINGS OF THE 24TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2018, : 1589 - 1598
  • [8] Multi-Task Learning Resource Allocation in Federated Integrated Sensing and Communication Networks
    Liu, Xiangnan
    Zhang, Haijun
    Ren, Chao
    Li, Haojin
    Sun, Chen
    Leung, Victor C. M.
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (09) : 11612 - 11623
  • [9] Multi-task learning for stock selection
    Ghosn, J
    Bengio, Y
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 9: PROCEEDINGS OF THE 1996 CONFERENCE, 1997, 9 : 946 - 952
  • [10] AUTOSEM: Automatic Task Selection and Mixing in Multi-Task Learning
    Guo, Han
    Pasunuru, Ramakanth
    Bansal, Mohit
    2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, 2019, : 3520 - 3531