Synthesis of Algorithm Considering Communication Structure of Distributed/Parallel Computing

被引:0
|
作者
Miyasaka, Yukio [1 ]
Mittal, Ashish [2 ]
Fujita, Masahiro [1 ]
机构
[1] Univ Tokyo, Tokyo, Japan
[2] Indian Inst Technol, Mumbai, Maharashtra, India
关键词
Distributed/Parallel computing; partial synthesis; algorithm synthesis; communication structure; matrix vector multiplication;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
There are increasing opportunities to calculate with distributed/parallel computing: many-core CPU, GPU, and FPGA. It is, however, generally difficult to come up with an algorithm suitable for distributed/parallel computing. There have been many researches on the automatic partitioning of programs and designs, but they have not performed reconstruction of the data flow in the algorithm level. In this paper, we apply partial synthesis method and synthesize algorithms for distributed/parallel environment automatically. We propose the template-based computing that aims to prevent the communications among the cores and chips to become overhead. With that template, an algorithm is synthesized by using conventional partial synthesis method, which performs synthesis iteratively modifying the template. The synthesis-problem generally becomes infeasible as its size becomes larger. Therefore, we propose the method to reduce the search space by adding constraints. The synthesis is performed for small instances of the target problem at first, and then the additional constraints are considered based on the synthesized algorithm. In the experiment, we synthesized algorithms for matrix vector multiplication with one-way ring -connected nodes to matrix of 32X32.
引用
收藏
页码:45 / 51
页数:7
相关论文
共 50 条
  • [1] Distributed and Parallel Algorithm for Computing Betweenness Centrality
    Campuzano-Alvarez, Mirlayne
    Fonseca-Bruzon, Adrian
    [J]. ADVANCES IN ARTIFICIAL INTELLIGENCE - IBERAMIA 2016, 2016, 10022 : 285 - 296
  • [2] Distributed and Parallel Algorithm for Computing Betweenness Centrality
    Campuzano-Alvarez, Mirlayne
    Fonseca-Bruzon, Adrian
    [J]. PROGRESS IN PATTERN RECOGNITION, IMAGE ANALYSIS, COMPUTER VISION, AND APPLICATIONS, CIARP 2016, 2017, 10125 : 184 - 191
  • [3] An algorithm for reducing communication cost in parallel computing
    Ecer, A
    Lemoine, E
    Tarkan, I
    [J]. PARALLEL COMPUTATIONAL FLUID DYNAMICS: TOWARDS TERAFLOPS, OPTIMIZATION, AND NOVEL FORMULATIONS, 2000, : 199 - 206
  • [4] A distributed load balancing algorithm for heterogeneous parallel computing systems
    Decker, T
    Lüling, R
    Tschöke, S
    [J]. INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED PROCESSING TECHNIQUES AND APPLICATIONS, VOLS I-IV, PROCEEDINGS, 1998, : 933 - 940
  • [5] PARALLEL IMPLEMENTATION FOR SAM ALGORITHM BASED ON GPU AND DISTRIBUTED COMPUTING
    Qu, Haicheng
    Zhang, Junping
    Chen, Yushi
    Chen, Hao
    Lin, Zhouhan
    [J]. 2012 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2012, : 4074 - 4077
  • [6] An Efficient Algorithm for Resource Allocation in Parallel and Distributed Computing Systems
    El-Zoghdy, S. F.
    Nofal, M.
    Shohla, M. A.
    El-sawy, A.
    [J]. INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2013, 4 (02) : 251 - 259
  • [7] Synthesis and Generalization of Parallel Algorithms Considering Communication Constraints
    Goda, Akihiro
    Miyasaka, Yukio
    Gharehbaghi, Amir Masoud
    Fujita, Masahiro
    [J]. PROCEEDINGS OF THE TWENTYFIRST INTERNATIONAL SYMPOSIUM ON QUALITY ELECTRONIC DESIGN (ISQED 2020), 2020, : 123 - 128
  • [8] From distributed sequential computing to distributed parallel computing
    Pan, L
    Bic, LF
    Dillencourt, MB
    Lai, MK
    [J]. 2003 INTERNATIONAL CONFERENCE ON PARALLEL PROCESSING WORKSHOPS, PROCEEDINGS, 2003, : 255 - 262
  • [9] Reducing the synchronizing communication overhead for distributed graph-parallel computing
    Zhao, Yue
    Yoshigoe, Kenji
    Li, Hongliang
    Xiong, Ke
    [J]. INTELLIGENT DATA ANALYSIS, 2019, 23 (02) : 313 - 332
  • [10] Multistep Scheduling Algorithm for Parallel and Distributed Processing with Communication Costs
    Yamazaki, Hitoshi
    Konishi, Katumi
    Shin, Seiichi
    Sawada, Kenji
    [J]. 39TH ANNUAL CONFERENCE OF THE IEEE INDUSTRIAL ELECTRONICS SOCIETY (IECON 2013), 2013, : 4482 - 4487