Synthesis of Algorithm Considering Communication Structure of Distributed/Parallel Computing

被引:0
|
作者
Miyasaka, Yukio [1 ]
Mittal, Ashish [2 ]
Fujita, Masahiro [1 ]
机构
[1] Univ Tokyo, Tokyo, Japan
[2] Indian Inst Technol, Mumbai, Maharashtra, India
关键词
Distributed/Parallel computing; partial synthesis; algorithm synthesis; communication structure; matrix vector multiplication;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
There are increasing opportunities to calculate with distributed/parallel computing: many-core CPU, GPU, and FPGA. It is, however, generally difficult to come up with an algorithm suitable for distributed/parallel computing. There have been many researches on the automatic partitioning of programs and designs, but they have not performed reconstruction of the data flow in the algorithm level. In this paper, we apply partial synthesis method and synthesize algorithms for distributed/parallel environment automatically. We propose the template-based computing that aims to prevent the communications among the cores and chips to become overhead. With that template, an algorithm is synthesized by using conventional partial synthesis method, which performs synthesis iteratively modifying the template. The synthesis-problem generally becomes infeasible as its size becomes larger. Therefore, we propose the method to reduce the search space by adding constraints. The synthesis is performed for small instances of the target problem at first, and then the additional constraints are considered based on the synthesized algorithm. In the experiment, we synthesized algorithms for matrix vector multiplication with one-way ring -connected nodes to matrix of 32X32.
引用
收藏
页码:45 / 51
页数:7
相关论文
共 50 条
  • [21] Journal of Parallel and Distributed Computing
    [J]. 1600, Academic Press Inc. (106):
  • [22] Heterogeneous parallel and distributed computing
    Sunderam, VS
    Geist, GA
    [J]. PARALLEL COMPUTING, 1999, 25 (13-14) : 1699 - 1721
  • [23] OnRamp to Parallel and Distributed Computing
    Foley, Samantha S.
    Hursey, Joshua
    [J]. PROCEEDINGS OF EDUHPC 2015: WORKSHOP ON EDUCATION FOR HIGH-PERFORMANCE COMPUTING, 2015,
  • [24] A convergence of parallel and distributed computing?
    Blair, GS
    [J]. ABSTRACT MACHINE MODELS FOR PARALLEL AND DISTRIBUTED COMPUTING, 1996, : 1 - 11
  • [25] Virtualization in parallel distributed computing
    Sunderam, V
    [J]. RECENT ADVANCES IN PARALLEL VIRTUAL MACHINE AND MESSAGE PASSING INTERFACE, PROCEEDINGS, 2005, 3666 : 6 - 6
  • [26] A distributed algorithm for optimal concurrent communication and load balancing in parallel systems
    Dralle, U
    Reinefeld, A
    [J]. HIGH-PERFORMANCE COMPUTING AND NETWORKING, 1997, 1225 : 588 - 600
  • [27] A distributed autonomic logistics system with parallel-computing diagnostic algorithm for aircrafts
    Han, Danyang
    Yu, Jinsong
    Song, Yue
    Tang, Diyin
    Dai, Jing
    [J]. 2019 IEEE AUTOTESTCON, 2019,
  • [28] An improved bi-conjugate residual algorithm suitable for distributed parallel computing
    Gu, Tong-xiang
    Zuo, Xian-yu
    Zhang, Li-tao
    Zhang, Wan-qin
    Sheng, Zhi-qiang
    [J]. APPLIED MATHEMATICS AND COMPUTATION, 2007, 186 (02) : 1243 - 1253
  • [29] An improved generalized conjugate residual squared algorithm suitable for distributed parallel computing
    Zuo, Xian-Yu
    Zhang, Li-Tao
    Gu, Tong-Xiang
    [J]. JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 2014, 271 : 285 - 294
  • [30] An efficient distributed algorithm for economic dispatch considering communication asynchrony and time delays
    Wang, Zheng
    Chen, Guo
    Li, Huaqing
    [J]. Energy Conversion and Economics, 2022, 3 (04): : 214 - 226