Poster: A Novel Shared Memory Framework for Distributed Deep Learning in High-Performance Computing Architecture

被引：4

作者：

Ahn, Shinyoung ^{[1
,2
]}

Kim, Joongheon ^{[3
]}

Kang, Sungwon ^{[1
]}

机构：

[1] Korea Adv Inst Sci & Technol, Daejeon, South Korea

[2] ETRI, Daejeon, South Korea

[3] Chung Ang Univ, Seoul, South Korea

来源：

PROCEEDINGS 2018 IEEE/ACM 40TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING - COMPANION (ICSE-COMPANION | 2018年

关键词：

Distributed deep learning; remote shared memory; parameter sharing; HPC;

D O I：

10.1145/3183440.3195091

中图分类号：

TP31 [计算机软件];

学科分类号：

081202 ; 0835 ;

摘要：

This paper proposes a novel virtual shared memory framework, Soft Memory Box (SMB), which directly shares the memory of remote nodes among distributed processes to improve communication performance/speed via deep learning parameter sharing.

引用

下载

页码：191 / 192

页数：2

共 50 条

[21] High-Performance Distributed Computing with Smartphones
Ishikawa, Nadeem
Nomura, Hayato
Yoda, Yuya
Uetsuki, Osamu
Fukunaga, Keisuke
Nagoya, Seiji
Sawara, Junya
Ishihata, Hiroaki
Senoguchi, Junsuke
EURO-PAR 2023: PARALLEL PROCESSING WORKSHOPS, PT II, EURO-PAR 2023, 2024, 14352 : 229 - 232
[22] A method of deep learning based on distributed memory computing
Li, Di-Fei
Tian, Di
Hu, Xiong-Wei
Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2015, 45 (03): : 921 - 925
[23] A novel switch architecture for high-performance computing and signal processing networks
Sukhtankar, S
Hecht, D
Rosen, W
THIRD IEEE INTERNATIONAL SYMPOSIUM ON NETWORK COMPUTING AND APPLICATIONS, PROCEEDINGS, 2004, : 215 - 222
[24] Deep Learning Framework using Scalable Shared Memory Buffer Framework
Lim, Eun-Ji
Ahn, Shin-Young
2021 INTERNATIONAL CONFERENCE ON ELECTRONICS, INFORMATION, AND COMMUNICATION (ICEIC), 2021,
[25] A HIGH-PERFORMANCE DISTRIBUTED COMPUTING FRAMEWORK FOR PARAMETRIC DESIGN OPTIMIZATION OF RF DEVICES
Stantchev, George M.
Cooke, Simon J.
Petillo, John J.
Ovtchinnikov, Serguei
Burke, Alex
Kostas, Chris
Panagos, Dimitrios
Antonsen, Thomas M., Jr.
2016 43RD IEEE INTERNATIONAL CONFERENCE ON PLASMA SCIENCE (ICOPS), 2016,
[26] Distributed High-Performance Computing Framework for Modeling and Inversion of Geophysical Well Logs
Polyakov, V.
Kocian, R.
Omeragic, D.
Habashy, T.
PROCEEDINGS OF THE FIRST INTERNATIONAL CONFERENCE ON PARALLEL, DISTRIBUTED AND GRID COMPUTING FOR ENGINEERING, 2009, (90): : 374 - 392
[27] NetANNS: A High-Performance Distributed Search Framework Based On In-Network Computing
Zhang, Penghao
Pan, Heng
Li, Zhenyu
Xie, Gaogang
Cui, Penglai
19TH IEEE INTERNATIONAL SYMPOSIUM ON PARALLEL AND DISTRIBUTED PROCESSING WITH APPLICATIONS (ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM 2021), 2021, : 271 - 278
[28] An Extended IMS Framework With a High-Performance and Scalable Distributed Storage and Computing System
Seraoui, Youssef
Raouyane, Brahim
Bellafkih, Mostafa
2017 INTERNATIONAL SYMPOSIUM ON NETWORKS, COMPUTERS AND COMMUNICATIONS (ISNCC), 2017,
[29] A Distributed Cloud Resource Management Framework for High-Performance Computing (HPC) Applications
Govindarajan, Kannan
Kumar, Vivekanandan Suresh
Somasundaram, Thamarai Selvi
2016 EIGHTH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTING (ICOAC), 2017, : 1 - 6
[30] HYDRA: A novel framework for making high-performance computing offload capable
Weinsberg, Yaron
Dolev, Danny
Anker, Tal
Wyckcoff, Pete
31ST IEEE CONFERENCE ON LOCAL COMPUTER NETWORKS, PROCEEDINGS, 2006, : 537 - +

← 1 2 3 4 5 →