Extreme Event Analysis in Next Generation Simulation Architectures

被引:3
|
作者
Hamilton, Stephen [1 ]
Burns, Randal [1 ]
Meneveau, Charles [2 ]
Johnson, Perry [2 ]
Lindstrom, Peter [3 ]
Patchett, John [4 ]
Szalay, Alexander S. [5 ]
机构
[1] Johns Hopkins Univ, Dept Comp Sci, Baltimore, MD 21218 USA
[2] Johns Hopkins Univ, Dept Mech Engn, Baltimore, MD 21218 USA
[3] Lawrence Livermore Natl Lab, Livermore, CA 94550 USA
[4] Los Alamos Natl Lab, Los Alamos, NM 87545 USA
[5] Johns Hopkins Univ, Dept Phys & Astron, Baltimore, MD 21218 USA
基金
美国国家科学基金会;
关键词
IDENTIFICATION;
D O I
10.1007/978-3-319-58667-0_15
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Numerical simulations present challenges because they generate petabyte-scale data that must be extracted and reduced during the simulation. We demonstrate a seamless integration of feature extraction for a simulation of turbulent fluid dynamics. The simulation produces on the order of 6 TB per timestep. In order to analyze and store this data, we extract velocity data from a dilated volume of the strong vortical regions and also store a lossy compressed representation of the data. Both reduce data by one or more orders of magnitude. We extract data from user checkpoints in transit while they reside on temporary burst buffer SSD stores. In this way, analysis and compression algorithms are designed to meet specific time constraints so they do not interfere with simulation computations. Our results demonstrate that we can perform feature extraction on a world-class direct numerical simulation of turbulence while it is running and gather meaningful scientific data for archival and post analysis.
引用
收藏
页码:277 / 293
页数:17
相关论文
共 50 条
  • [1] Next Generation ROADM Architectures
    Way, Winston I.
    [J]. 2012 ASIA COMMUNICATIONS AND PHOTONICS CONFERENCE (ACP), 2012,
  • [2] NEXT GENERATION CONTROL ARCHITECTURES
    Tomas, Vinko
    Margeta, Alan
    [J]. POMORSTVO-SCIENTIFIC JOURNAL OF MARITIME RESEARCH, 2006, 20 (02) : 127 - 136
  • [3] Next Generation AESA Radar Architectures
    Mountford, Chris
    [J]. EURAD 2020 THE 17TH EUROPEAN RADAR CONFERENCE, 2021,
  • [4] Next Generation AESA Radar Architectures
    Mountford, Chris
    [J]. EURAD 2020 THE 17TH EUROPEAN RADAR CONFERENCE, 2021,
  • [5] Research the architectures of the next generation network
    Zhang, HJ
    Xu, QF
    Zhong, YX
    [J]. Proceedings of the World Engineers' Convention 2004, Vol A, Network Engineering and Information Society, 2004, : 394 - 397
  • [6] Next Generation Mobile Fronthaul Architectures
    Pfeiffer, Thomas
    [J]. 2015 OPTICAL FIBER COMMUNICATIONS CONFERENCE AND EXHIBITION (OFC), 2015,
  • [7] EM analysis and simulation techniques: Next generation
    [J]. Arima, Takuji (t-arima@cc.tuat.ac.jp), 2016, Institute of Electronics Information Communication Engineers (99):
  • [8] Analysis of Advanced Programming Architectures for Next-Generation Flash Memories
    Ashrafi, Reza A.
    Pusane, Ali E.
    Demirkan, Ismail
    [J]. 2015 23RD SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2015, : 644 - 644
  • [9] Evaluating the Applicability of Cloud Computing Enterprises in Support of the Next Generation of Modeling and Simulation Architectures
    Johnson, Harry E., Sr.
    Tolk, Andreas
    [J]. MILITARY MODELING & SIMULATION SYMPOSIUM (MMS 2013) - 2013 SPRING SIMULATION MULTI-CONFERENCE (SPRINGSIM'13), 2013, 45 (07): : 28 - 35
  • [10] Study of new rare event simulation schemes and their application to extreme scenario generation
    Agarwal, Ankush
    De Marco, Stefano
    Gobet, Emmanuel
    Liu, Gang
    [J]. MATHEMATICS AND COMPUTERS IN SIMULATION, 2018, 143 : 89 - 98