Global Application States Monitoring Applied to Graph Partitioning Optimization

被引:1
|
作者
Smyk, Adam [1 ]
Tudruj, Marek [1 ,2 ]
Grochal, Lukasz [1 ]
Tudruj, Marek [1 ,2 ]
机构
[1] Polish Japanese Acad Informat Technol, Warsaw, Poland
[2] Polish Acad Scs, Inst Comp Sci, Warsaw, Poland
关键词
distributed program design tools; global application states monitoring; hierarchical graph/mesh partitionig;
D O I
10.1109/ISPDC2018.2018.00021
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
The paper presents how an advanced graph partitioning optimization method was implemented inside a novel distributed program design framework PEGASUS DA which provides system support for automatic global application states monitoring. In PEGASUS DA, execution control design of distributed applications is system-supported by program global state monitoring run-time. This support provides an automatic construction of user-defined relevant strongly consistent global application states, computing global control predicates on the constructed states, evaluation of these predicates and sending asynchronous control signals to application threads and processes to stimulate the desired global state-driven reactions. The presented graph partitioning optimization algorithm is based on user-defined mixed partitioning strategies. It includes a combined use of different graph partitioning methods and different criteria for definition and assessment of produced partitions. It runs on top of basic graph partitioning methods available inside the METIS partitioning tool. The partitioning is executed by distributed processes and threads controlled by global states monitoring provided by the PEGASUS DA framework. Its use allows easy design and testing of different graph optimization strategies, finding graph partitioning optimal methods and algorithm parameters. The graph partitioning methods presented in the paper are illustrated by experiments performed with partitioning of a number of benchmark graphs to show partitioning quality (from 5% to 30% of the improvement has been observed) and execution time assessment of the proposed approach.
引用
收藏
页码:85 / 92
页数:8
相关论文
共 50 条
  • [1] Distributed Application Global States Monitoring in PEGASUS DA Applied to Parallel Graph Partitioning
    Smyk, Adam
    Tudruj, Marek
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2021, 33 (11):
  • [2] Extremal optimization for graph partitioning
    Boettcher, S
    Percus, AG
    PHYSICAL REVIEW E, 2001, 64 (02) : 13
  • [3] Application Driven Graph Partitioning
    Fan, Wenfei
    Jin, Ruochun
    Liu, Muyang
    Lu, Ping
    Luo, Xiaojian
    Xu, Ruiqi
    Yin, Qiang
    Yu, Wenyuan
    Zhou, Jingren
    SIGMOD'20: PROCEEDINGS OF THE 2020 ACM SIGMOD INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, 2020, : 1765 - 1779
  • [4] Path optimization for graph partitioning problems
    Berry, JW
    Goldberg, MK
    DISCRETE APPLIED MATHEMATICS, 1999, 90 (1-3) : 27 - 50
  • [5] Global optimization of multilevel electricity market models including network design and graph partitioning
    Kleinert, Thomas
    Schmidt, Martin
    DISCRETE OPTIMIZATION, 2019, 33 : 43 - 69
  • [6] Application-driven graph partitioning
    Fan, Wenfei
    Xu, Ruiqi
    Yin, Qiang
    Yu, Wenyuan
    Zhou, Jingren
    VLDB JOURNAL, 2023, 32 (01): : 149 - 172
  • [7] Application-driven graph partitioning
    Wenfei Fan
    Ruiqi Xu
    Qiang Yin
    Wenyuan Yu
    Jingren Zhou
    The VLDB Journal, 2023, 32 : 149 - 172
  • [8] Pose Graph Optimization with Hierarchical Conditionally Independent Graph Partitioning
    Tang, Hengbo
    Liu, Yunhui
    Li, Luyang
    2016 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS 2016), 2016, : 3255 - 3260
  • [10] Extremal optimization of graph partitioning at the percolation threshold
    Boettcher, S
    JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, 1999, 32 (28): : 5201 - 5211