Efficient I/O and Storage of Adaptive-Resolution Data

被引:17
|
作者
Kumar, Sidharth [1 ]
Edwards, John [1 ]
Bremer, Peer-Timo [1 ,3 ]
Knoll, Aaron [1 ]
Christensen, Cameron [1 ]
Vishwanath, Venkatram [2 ]
Carns, Philip [2 ]
Schmidt, John A. [1 ]
Pascucci, Valerio [1 ]
机构
[1] Univ Utah, Sci Comp & Imaging Inst, Salt Lake City, UT 84112 USA
[2] Argonne Natl Lab, Argonne, IL 60439 USA
[3] Lawrence Livermore Natl Lab, Livermore, CA USA
关键词
D O I
10.1109/SC.2014.39
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
We present an efficient, flexible, adaptive-resolution I/O framework that is suitable for both uniform and Adaptive Mesh Refinement (AMR) simulations. In an AMR setting, current solutions typically represent each resolution level as an independent grid which often results in inefficient storage and performance. Our technique coalesces domain data into a unified, multiresolution representation with fast, spatially aggregated I/O. Furthermore, our framework easily extends to importance-driven storage of uniform grids, for example, by storing regions of interest at full resolution and nonessential regions at lower resolution for visualization or analysis. Our framework, which is an extension of the PIDX framework, achieves state of the art disk usage and I/O performance regardless of resolution of the data, regions of interest, and the number of processes that generated the data. We demonstrate the scalability and efficiency of our framework using the Uintah and S3D large-scale combustion codes on the Mira and Edison supercomputers.
引用
收藏
页码:413 / 423
页数:11
相关论文
共 50 条
  • [21] Solvent-scaling as an alternative to coarse-graining in adaptive-resolution simulations: The adaptive solvent-scaling (AdSoS) scheme
    Kubincova, Alzbeta
    Riniker, Sereina
    Huenenberger, Philippe H.
    JOURNAL OF CHEMICAL PHYSICS, 2021, 155 (09):
  • [22] Joint User Scheduling and Resource Allocation for Millimeter Wave Systems Relying on Adaptive-Resolution ADCs
    Chen, Xihan
    Cai, Yunlong
    Liu, An
    Hanzo, Lajos
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2021, 70 (11) : 12260 - 12265
  • [23] Rapid hologram generation through backward ray tracing and adaptive-resolution wavefront recording plane
    朱建英
    毕勇
    孙敏远
    高伟男
    Chinese Physics B, 2024, 33 (11) : 339 - 343
  • [24] Images of the East African Rift System by Global Adaptive-Resolution Surface-Wave Tomography
    Korostelev, Felicie
    Lu, Yang
    Magrini, Fabrizio
    Boschi, Lapo
    Leroy, Sylvie
    Vetel, William
    JOURNAL OF GEOPHYSICAL RESEARCH-SOLID EARTH, 2022, 127 (06)
  • [25] Grand-canonical-like molecular-dynamics simulations by using an adaptive-resolution technique
    Wang, Han
    Hartmann, Carsten
    Schuette, Christof
    Delle Site, Luigi
    ABSTRACTS OF PAPERS OF THE AMERICAN CHEMICAL SOCIETY, 2013, 246
  • [26] An efficient data layout scheme for better I/O balancing in RAID-6 storage systems
    Ping XIE
    Jian-zhong HUANG
    Er-wei DAI
    Qiang CAO
    Chang-sheng XIE
    Frontiers of Information Technology & Electronic Engineering, 2015, 16 (05) : 335 - 345
  • [27] An efficient data layout scheme for better I/O balancing in RAID-6 storage systems
    Xie, Ping
    Huang, Jian-zhong
    Dai, Er-wei
    Cao, Qiang
    Xie, Chang-sheng
    FRONTIERS OF INFORMATION TECHNOLOGY & ELECTRONIC ENGINEERING, 2015, 16 (05) : 335 - 345
  • [28] An efficient data layout scheme for better I/O balancing in RAID-6 storage systems
    Ping Xie
    Jian-zhong Huang
    Er-wei Dai
    Qiang Cao
    Chang-sheng Xie
    Frontiers of Information Technology & Electronic Engineering, 2015, 16 : 335 - 345
  • [29] Grand-Canonical-like Molecular-Dynamics Simulations by Using an Adaptive-Resolution Technique
    Wang, Han
    Hartmann, Carsten
    Schuette, Christof
    Delle Site, Luigi
    PHYSICAL REVIEW X, 2013, 3 (01):
  • [30] EFFICIENT STORAGE, RETRIEVAL AND ANALYSIS OF POKER HANDS: AN ADAPTIVE DATA FRAMEWORK
    Gorawski, Marcin
    Lorek, Michal
    INTERNATIONAL JOURNAL OF APPLIED MATHEMATICS AND COMPUTER SCIENCE, 2017, 27 (04) : 713 - 726