Hardware Reference
In-Depth Information
Chapter 22
Scaling Up Parallel I/O in S3D to
100-K Cores with ADIOS
Scott Klasky, Gary Liu, Hasan Abbasi, and Norbert Podhorszki
Oak Ridge National Laboratory
Jackie Chen and Hemanth Kolla
Sandia National Laboratories
22.1
Science Use Case ::::::::::::::::::::::::::::::::::::::::::::::::: 259
22.2
Software and Hardware :::::::::::::::::::::::::::::::::::::::::: 260
22.2.1
ADIOS-BP ::::::::::::::::::::::::::::::::::::::::::::::: 261
22.2.2
Staged Write Method :::::::::::::::::::::::::::::::::::: 262
22.2.3
Group-Based Hierarchical I/O Control :::::::::::::::::: 262
22.2.4
Aggregation and Subling ::::::::::::::::::::::::::::::: 263
22.2.5
Index Generation :::::::::::::::::::::::::::::::::::::::: 266
22.2.6
Staged Read Method :::::::::::::::::::::::::::::::::::: 266
22.2.7
Staged Opens :::::::::::::::::::::::::::::::::::::::::::: 266
22.2.8
Chunking :::::::::::::::::::::::::::::::::::::::::::::::: 267
22.2.9
Limitations :::::::::::::::::::::::::::::::::::::::::::::: 268
22.3
Conclusion :::::::::::::::::::::::::::::::::::::::::::::::::::::::: 269
Bibliography :::::::::::::::::::::::::::::::::::::::::::::::::::::: 269
22.1 Science Use Case
Combustion is at the heart of the energy conversion process in most trans-
portation and power generation systems, and is likely to remain so for the
foreseeable future. Combustion invariably occurs in turbulent environments,
which involves a complex coupling between fluid dynamics, chemical kinet-
ics and molecular transport phenomena. This coupling is a multi-scale pro-
cess which makes it very critical to understand the fine-scale phenomena in
order to design effectively for desired large-scale operating characteristics.
First principles{based Direct Numerical Simulations (DNS) is one method-
ology of simulating turbulent combustion where all the continuum scales are
suciently resolved. However, the multi-scale nature implies that DNS of tur-
bulent combustion is not feasible without high performance computing. Even
259
