Optimum splitting computing for DNN training through next generation smart networks: a multi-tier deep reinforcement learning approach

被引:0
|
作者
Lien, Shao-Yu [1 ]
Yeh, Cheng-Hao [2 ]
Deng, Der-Jiunn [3 ]
机构
[1] Natl Yang Ming Chiao Tung Univ, Coll Artificial Intelligence, Gaofa 3rd Rd, Tainan 71150, Taiwan
[2] Natl Chung Cheng Univ, Dept Comp Sci & Informat Engn, Univ Rd, Chiyi 621301, Taiwan
[3] Natl Changhua Univ Educ, Dept Comp Sci & Informat Engn, Jinde Rd, Changhua 50007, Taiwan
关键词
Deep neural networks (DNNs); Deep reinforcement learning (DRL); Split computing; Sixth generation (6 G) Networks;
D O I
10.1007/s11276-023-03600-5
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Deep neural networks (DNNs) involving massive neural nodes grouped into different neural layers have been a promising innovation for function approximation and inference, which have been widely applied to various vertical applications such as image recognition. However, the computing burdens to train a DNN model with a limited latency may not be affordable for the user equipment (UE), which consequently motivates the concept of splitting the computations of DNN layers to not only the edge server but also the cloud platform. Despite the availability of more computing resources, computing tasks with such split computing also suffer packet transmission unreliability, latency, and significant energy consumption. A practical scheme to optimally split the computations of DNN layers to the UE, edge, and cloud is thus urgently desired. To solve this optimization, we propose a multi-tier deep reinforcement learning (DRL) scheme for the UE and edge to distributively determine the splitting points to minimize the overall training latency while meeting the constraints of overall energy consumption and image recognition accuracy. The performance evaluation results show the outstanding performance of the proposed design as compared with state-of-the-art schemes, to fully justify the practicability in the next-generation smart networks.
引用
收藏
页码:1737 / 1751
页数:15
相关论文
共 50 条
  • [1] Optimum splitting computing for DNN training through next generation smart networks: a multi-tier deep reinforcement learning approach
    Shao-Yu Lien
    Cheng-Hao Yeh
    Der-Jiunn Deng
    [J]. Wireless Networks, 2024, 30 : 1737 - 1751
  • [2] Optimum splitting computing for DNN training through next generation smart networks: a multi-tier deep reinforcement learning approach
    Lien, Shao-Yu
    Yeh, Cheng-Hao
    Deng, Der-Jiunn
    [J]. WIRELESS NETWORKS, 2024, 30 (03) : 1737 - 1751
  • [3] Multi-Tier Deep Reinforcement Learning for Non-Terrestrial Networks
    Cao, Yang
    Lien, Shao-Yu
    Liang, Ying-Chang
    Niyato, Dusit
    [J]. IEEE WIRELESS COMMUNICATIONS, 2024, 31 (03) : 194 - 201
  • [4] Adaptive Training and Aggregation for Federated Learning in Multi-Tier Computing Networks
    Hou, Wenjing
    Wen, Hong
    Zhang, Ning
    Lei, Wenxin
    Lin, Haojie
    Han, Zhu
    Liu, Qiang
    [J]. IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (05) : 4376 - 4388
  • [5] Task Offloading With Multi-Tier Computing Resources in Next Generation Wireless Networks
    Wang, Kunlun
    Jin, Jiong
    Yang, Yang
    Zhang, Tao
    Nallanathan, Arumugam
    Tellambura, Chintha
    Jabbari, Bijan
    [J]. IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2023, 41 (02) : 306 - 319
  • [6] Efficient Communication-Computation Tradeoff for Split Computing: A Multi-Tier Deep Reinforcement Learning Approach
    Cao, Yang
    Lien, Shao-Yu
    Yeh, Cheng-Hao
    Liang, Ying-Chang
    Niyato, Dusit
    [J]. IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 176 - 181
  • [7] Guest Editorial Multi-Tier Computing for Next Generation Wireless Networks-Part II
    Wang, Kunlun
    Yang, Yang
    Jin, Jiong
    Zhang, Tao
    Nallanathan, Arumugam
    Tellambura, Chintha
    Jabbari, Bijan
    [J]. IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2023, 41 (03) : 569 - 573
  • [8] Guest Editorial Multi-Tier Computing for Next Generation Wireless Networks-Part I
    Wang, Kunlun
    Yang, Yang
    Jin, Jiong
    Zhang, Tao
    Nallanathan, Arumugam
    Tellambura, Chintha
    Jabbari, Bijan
    [J]. IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2023, 41 (02) : 301 - 305
  • [9] Multi-Tier Cellular Handover with Multi-Access Edge Computing and Deep Learning
    Kapadia, Percy
    Seet, Boon-Chong
    [J]. TELECOM, 2021, 2 (04): : 446 - 471
  • [10] Fog Computing in Multi-Tier Data Center Networks: A Hierarchical Game Approach
    Zhang, Huaqing
    Xiao, Yong
    Bu, Shengrong
    Niyato, Dusit
    Yu, Richard
    Han, Zhu
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2016,