Spatiotemporal Graph and Hypergraph Partitioning Models for Sparse Matrix-Vector Multiplication on Many-Core Architectures

被引:7
|
作者
Abubaker, Nabil [1 ]
Akbudak, Kadir [2 ]
Aykanat, Cevdet [1 ]
机构
[1] Bilkent Univ, Dept Comp Engn, TR-06800 Ankara, Turkey
[2] King Abdullah Univ Sci & Technol, KSA, Extreme Comp Res Ctr, Dept Appl Math & Computat, Thuwal 23955, Saudi Arabia
关键词
Sparse matrix; sparse matrix-vector multiplication; data locality; spatial locality; temporal locality; hypergraph model; bipartite graph model; graph model; hypergraph partitioning; graph partitioning; Intel many integrated core architecture; Intel Xeon Phi; EXPLOITING LOCALITY; PERFORMANCE;
D O I
10.1109/TPDS.2018.2864729
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
There exist graph/hypergraph partitioning-based row/column reordering methods for encoding either spatial or temporal locality for sparse matrix-vector multiplication (SpMV) operations. Spatial and temporal hypergraph models in these methods are extended to encapsulate both spatial and temporal localities based on cut/uncut net categorization obtained from vertex partitioning. These extensions of spatial and temporal hypergraph models encode the spatial locality primarily and the temporal locality secondarily, and vice-versa, respectively. However, the literature lacks models that simultaneously encode both spatial and temporal localities utilizing only vertex partitioning for further improving the performance of SpMV on shared-memory architectures. In order to fill this gap, we propose a novel spatiotemporal hypergraph model that leads to a one-phase spatiotemporal reordering method which encodes both types of locality simultaneously. We also propose a framework for spatiotemporal methods which encodes both types of locality in two dependent phases and two separate phases. The validity of the proposed spatiotemporal models and methods are tested on a wide range of sparse matrices and the experiments are performed on both a 60-core Intel Xeon Phi processor and a Xeon processor. Results show the validity of the methods via almost doubling the Gflop/s performance through enhancing data locality in parallel SpMV operations.
引用
收藏
页码:445 / 458
页数:14
相关论文
共 50 条
  • [21] A Nested Dissection Partitioning Method for Parallel Sparse Matrix-Vector Multiplication
    Boman, Erik G.
    Wolf, Michael M.
    2013 IEEE CONFERENCE ON HIGH PERFORMANCE EXTREME COMPUTING (HPEC), 2013,
  • [22] CACHE-OBLIVIOUS SPARSE MATRIX-VECTOR MULTIPLICATION BY USING SPARSE MATRIX PARTITIONING METHODS
    Yzelman, A. N.
    Bisseling, Rob H.
    SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2009, 31 (04): : 3128 - 3154
  • [23] Sparse Matrix-Vector Multiplication on GPGPUs
    Filippone, Salvatore
    Cardellini, Valeria
    Barbieri, Davide
    Fanfarillo, Alessandro
    ACM TRANSACTIONS ON MATHEMATICAL SOFTWARE, 2017, 43 (04):
  • [24] An Educational Module Illustrating How Sparse Matrix-Vector Multiplication on Parallel Processors Connects to Graph Partitioning
    Rostami, M. Ali
    Buecker, H. Martin
    EURO-PAR 2015: PARALLEL PROCESSING WORKSHOPS, 2015, 9523 : 135 - 146
  • [25] Hypergraph partitioning for sparse matrix-matrix multiplication
    Ballard G.
    Druinsky A.
    Knight N.
    Schwartz O.
    ACM Transactions on Parallel Computing, 2016, 3 (03) : 1 - 34
  • [26] Fast Sparse Matrix-Vector Multiplication on GPUs: Implications for Graph Mining
    Yang, Xintian
    Parthasarathy, Srinivasan
    Sadayappan, P.
    PROCEEDINGS OF THE VLDB ENDOWMENT, 2011, 4 (04): : 231 - 242
  • [27] GPU accelerated sparse matrix-vector multiplication and sparse matrix-transpose vector multiplication
    Tao, Yuan
    Deng, Yangdong
    Mu, Shuai
    Zhang, Zhenzhong
    Zhu, Mingfa
    Xiao, Limin
    Ruan, Li
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2015, 27 (14): : 3771 - 3789
  • [28] Conflict-Free Symmetric Sparse Matrix-Vector Multiplication on Multicore Architectures
    Elafrou, Athena
    Goumas, Georgios
    Koziris, Nectarios
    PROCEEDINGS OF SC19: THE INTERNATIONAL CONFERENCE FOR HIGH PERFORMANCE COMPUTING, NETWORKING, STORAGE AND ANALYSIS, 2019,
  • [29] HYPERGRAPH PARTITIONING BASED MODELS AND METHODS FOR EXPLOITING CACHE LOCALITY IN SPARSE MATRIX- VECTOR MULTIPLICATION
    Akbudak, Kadir
    Kayaaslan, Enver
    Aykanat, Cevdet
    SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2013, 35 (03): : C237 - C262
  • [30] Semi-two-dimensional partitioning for parallel sparse matrix-vector multiplication
    Kayaaslan, Enver
    Ucar, Bora
    Aykanat, Cevdet
    2015 IEEE 29TH INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM WORKSHOPS, 2015, : 1125 - 1134