Efficient I/O and Storage of Adaptive-Resolution Data

被引:17
|
作者
Kumar, Sidharth [1 ]
Edwards, John [1 ]
Bremer, Peer-Timo [1 ,3 ]
Knoll, Aaron [1 ]
Christensen, Cameron [1 ]
Vishwanath, Venkatram [2 ]
Carns, Philip [2 ]
Schmidt, John A. [1 ]
Pascucci, Valerio [1 ]
机构
[1] Univ Utah, Sci Comp & Imaging Inst, Salt Lake City, UT 84112 USA
[2] Argonne Natl Lab, Argonne, IL 60439 USA
[3] Lawrence Livermore Natl Lab, Livermore, CA USA
关键词
D O I
10.1109/SC.2014.39
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
We present an efficient, flexible, adaptive-resolution I/O framework that is suitable for both uniform and Adaptive Mesh Refinement (AMR) simulations. In an AMR setting, current solutions typically represent each resolution level as an independent grid which often results in inefficient storage and performance. Our technique coalesces domain data into a unified, multiresolution representation with fast, spatially aggregated I/O. Furthermore, our framework easily extends to importance-driven storage of uniform grids, for example, by storing regions of interest at full resolution and nonessential regions at lower resolution for visualization or analysis. Our framework, which is an extension of the PIDX framework, achieves state of the art disk usage and I/O performance regardless of resolution of the data, regions of interest, and the number of processes that generated the data. We demonstrate the scalability and efficiency of our framework using the Uintah and S3D large-scale combustion codes on the Mira and Edison supercomputers.
引用
收藏
页码:413 / 423
页数:11
相关论文
共 50 条
  • [1] Fast neighbor lists for adaptive-resolution particle simulations
    Awile, Omar
    Bueyuekkececi, Ferit
    Reboux, Sylvain
    Sbalzarini, Ivo F.
    COMPUTER PHYSICS COMMUNICATIONS, 2012, 183 (05) : 1073 - 1081
  • [2] Adaptive-resolution octree-based volumetric SLAM
    Vespa, Emanuele
    Funk, Nils
    Kelly, Paul H. J.
    Leutenegger, Stefan
    2019 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2019), 2019, : 654 - 662
  • [3] Adaptive-resolution reinforcement learning with polynomial exploration in deterministic domains
    Bernstein, Andrey
    Shimkin, Nahum
    MACHINE LEARNING, 2010, 81 (03) : 359 - 397
  • [4] Adaptive-resolution reinforcement learning with polynomial exploration in deterministic domains
    Andrey Bernstein
    Nahum Shimkin
    Machine Learning, 2010, 81 : 359 - 397
  • [5] ADARE-HD: Adaptive-Resolution Framework for Efficient Object Detection and Tracking via HD-Computing
    Mejri, Mohamed
    Amarnath, Chandramouli
    Chatterjee, Abhijit
    2024 IEEE 67TH INTERNATIONAL MIDWEST SYMPOSIUM ON CIRCUITS AND SYSTEMS, MWSCAS 2024, 2024, : 811 - 817
  • [6] A Self-Organizing Adaptive-Resolution Particle Method with Anisotropic Kernels
    Hacki, Christoph
    Reboux, Sylvain
    Sbalzarini, Ivo F.
    IUTAM SYMPOSIUM ON PARTICLE METHODS IN FLUID DYNAMICS, 2015, 18 : 40 - 55
  • [7] Channel Estimation for Hybrid Massive MIMO Systems With Adaptive-Resolution ADCs
    Wang, Yalin
    Chen, Xihan
    Cai, Yunlong
    Champagne, Benoit
    Hanzo, Lajos
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2022, 70 (03) : 2131 - 2146
  • [8] Frequency-Domain Adaptive-Resolution Level-Crossing-Sampling ADC
    Wang, Hongying
    Schembari, Filippo
    Staszewski, Robert Bogdan
    Miskowicz, Marek
    2017 3RD INTERNATIONAL CONFERENCE ON EVENT-BASED CONTROL, COMMUNICATION AND SIGNAL PROCESSING (EBCCSP), 2017,
  • [9] An adaptive-resolution signal-specific ADC for sensor-interface applications
    Nasserian, Mahshid
    Peiravi, Ali
    Moradi, Farshad
    ANALOG INTEGRATED CIRCUITS AND SIGNAL PROCESSING, 2019, 98 (01) : 125 - 135
  • [10] Performance of Cell-Free Distributed Antenna System with Adaptive-Resolution ADCs
    Gao, Peng
    Sanada, Yukitoshi
    ITE TRANSACTIONS ON MEDIA TECHNOLOGY AND APPLICATIONS, 2022, 10 (03): : 90 - 99