Accelerating Convergence in Split Learning for Time-Varying and Resource-Limited Environments

被引:0
|
作者
Marinova, Matea [1 ]
Rakovic, Valentin [1 ]
机构
[1] Ss Cyril & Methodius Univ, Fac Elect Engn & Informat Technol, Skopje, North Macedonia
关键词
Convergence rate maximization; deep neural networks; delay minimization; optimal cut layer; split learning;
D O I
10.1109/MELECON56669.2024.10608579
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Split Learning (SL) is a distributed learning paradigm characterized by the neural network partitioning into distinct client-side and server-side segments. This work focuses on optimizing SL's performance for time-varying and resource-constrained systems. Specifically, the main goal in the paper is to determine the optimal cut layer position in the neural network that minimizes the total training delay, i.e. maximizes the rate of convergence. The performance analysis shows that the proposed cut layer selection algorithm outperforms State of the Art solutions.
引用
收藏
页码:13 / 18
页数:6
相关论文
共 50 条
  • [1] Biosurveillance in resource-limited environments
    Taitt, Chris
    ABSTRACTS OF PAPERS OF THE AMERICAN CHEMICAL SOCIETY, 2017, 254
  • [2] Breeding strategies for resource-limited environments
    Beilharz, RG
    ASIAN-AUSTRALASIAN JOURNAL OF ANIMAL SCIENCES, 2000, 13 : 271 - 274
  • [3] Security Architecture for Resource-Limited Environments
    Nair, S.
    Abraham, S.
    Al Ibrahim, O.
    2011 7TH INTERNATIONAL WIRELESS COMMUNICATIONS AND MOBILE COMPUTING CONFERENCE (IWCMC), 2011, : 412 - 417
  • [4] Thermal protection of the newborn in resource-limited environments
    Lunze, K.
    Hamer, D. H.
    JOURNAL OF PERINATOLOGY, 2012, 32 (05) : 317 - 324
  • [5] Thermal protection of the newborn in resource-limited environments
    K Lunze
    D H Hamer
    Journal of Perinatology, 2012, 32 : 317 - 324
  • [6] The economics of genomics within resource-limited environments
    Patrinos, George P.
    EUROPEAN JOURNAL OF HUMAN GENETICS, 2024, 32 : 87 - 87
  • [7] Split Federated Learning: Speed up Model Training in Resource-Limited Wireless Networks
    Zhang, Songge
    Wu, Wen
    Hu, Penghui
    Li, Shaofeng
    Zhang, Ning
    2023 IEEE 43RD INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS, ICDCS, 2023, : 985 - 986
  • [8] On the Convergence of No-Regret Learning Dynamics in Time-Varying Games
    Anagnostides, Ioannis
    Panageas, Ioannis
    Farina, Gabriele
    Sandholm, Tuomas
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [9] Cooperation and stability for complex systems in resource-limited environments
    Butler, Stacey
    O'Dwyer, James P.
    THEORETICAL ECOLOGY, 2020, 13 (02) : 239 - 250
  • [10] Cooperation and stability for complex systems in resource-limited environments
    Stacey Butler
    James P. O’Dwyer
    Theoretical Ecology, 2020, 13 : 239 - 250