Decentralized Distributed Deep Learning in Heterogeneous WAN Environments

被引：6
|
作者：
Hong, Rankyung [1 ]
Chandra, Abhishek [1 ]
机构：
[1] Univ Minnesota, Minneapolis, MN 55455 USA
来源：
PROCEEDINGS OF THE 2018 ACM SYMPOSIUM ON CLOUD COMPUTING (SOCC '18) | 2018年
关键词：
D O I：
10.1145/3267809.3275447
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
引用
收藏
页码：505 / 505
页数：1
相关论文
共 50 条
  • [1] Orchestra: Adaptively Accelerating Distributed Deep Learning in Heterogeneous Environments
    Du, Haizhou
    Huang, Sheng
    Xiang, Qiao
    PROCEEDINGS OF THE 19TH ACM INTERNATIONAL CONFERENCE ON COMPUTING FRONTIERS 2022 (CF 2022), 2022, : 181 - 184
  • [2] HeterPS: Distributed deep learning with reinforcement learning based scheduling in heterogeneous environments
    Liu, Ji
    Wu, Zhihua
    Feng, Danlei
    Zhang, Minxu
    Wu, Xinxuan
    Yao, Xuefeng
    Yu, Dianhai
    Ma, Yanjun
    Zhao, Feng
    Dou, Dejing
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2023, 148 : 106 - 117
  • [3] An Incremental Iterative Acceleration Architecture in Distributed Heterogeneous Environments With GPUs for Deep Learning
    Zhang, Xuedong
    Tang, Zhuo
    Du, Lifan
    Yang, Li
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2021, 32 (11) : 2823 - 2837
  • [4] RelaySum for Decentralized Deep Learning on Heterogeneous Data
    Vogels, Thijs
    He, Lie
    Koloskova, Anastasia
    Lin, Tao
    Karimireddy, Sai Praneeth
    Stich, Sebastian U.
    Jaggi, Martin
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [5] ASHL: An Adaptive Multi-Stage Distributed Deep Learning Training Scheme for Heterogeneous Environments
    Shen, Zhaoyan
    Tang, Qingxiang
    Zhou, Tianren
    Zhang, Yuhao
    Jia, Zhiping
    Yu, Dongxiao
    Zhang, Zhiyong
    Li, Bingzhe
    IEEE TRANSACTIONS ON COMPUTERS, 2024, 73 (01) : 30 - 43
  • [6] The Application of Deep Reinforcement Learning to Distributed Spectrum Access in Dynamic Heterogeneous Environments With Partial Observations
    Xu, Yue
    Yu, Jianyuan
    Buehrer, R. Michael
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2020, 19 (07) : 4494 - 4506
  • [7] Federated variational generative learning for heterogeneous data in distributed environments
    Xie W.
    Xiong R.
    Zhang J.
    Jin J.
    Luo J.
    Journal of Parallel and Distributed Computing, 2024, 191
  • [8] Flexible Analysis of User Actions in Heterogeneous Distributed Learning Environments
    Bollen, Lars
    Giemza, Adam
    Hoppe, H. Ulrich
    TIMES OF CONVERGENCE: TECHNOLOGIES ACROSS LEARNING CONTEXTS, PROCEEDINGS, 2008, 5192 : 62 - 73
  • [9] Decentralized approach for distributed service environments
    Jin Yuhan
    Tian Hui
    Liu Zemin
    2008 5TH IEEE CONSUMER COMMUNICATIONS AND NETWORKING CONFERENCE, VOLS 1-3, 2008, : 1144 - 1148
  • [10] Decentralized Training of Foundation Models in Heterogeneous Environments
    Yuan, Binhang
    He, Yongjun
    Davis, Jared Quincy
    Zhang, Tianyi
    Dao, Tri
    Chen, Beidi
    Liang, Percy
    Re, Christopher
    Zhang, Ce
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
12345