Hardware Reference
In-Depth Information
18.4 Conclusion
The performance mismatch between the computing and I/O components
of current-generation HPC systems has made I/O the critical bottleneck for
scientific applications. It is therefore crucial that software take every advantage
available in moving data between compute, analysis, and storage resources as
eciently as networks will allow. Currently available mechanisms often fail
to perform as well as the hardware infrastructure will allow, suggesting that
improved optimization and perhaps adaptive mechanisms deserve increased
study.
The GLEAN infrastructure was developed to improve I/O performance on
supercomputers. The GLEAN infrastructure hides significant details from the
end user, while at the same time providing them with a flexible interface of-
fering the fastest path to their data and in the end, scientific insight. GLEAN
provides a mechanism to leverage topology-aware data movement for accel-
erating I/O, interface to run simulations for co-analysis, and an interface for
in situ analysis with minimal modifications to the existing application code
base. It has been deployed on production facilities and demonstrated to scale
on 768,000 cores.
Bibliography
[1] F. Alted. Why Modern CPUs Are Starving and What Can Be Done
About It. Computing in Science and Engg., 12(2):68{71, March 2010.
[2] FLASH User Guide. http://flash.uchicago.edu/website/ .
[3] B. Fryxell, K. Olson, P. Ricker, F. X. Timmes, M. Zingale, D. Q. Lamb,
P. MacNeice, R. Rosner, and H. Tufo. FLASH: An Adaptive Mesh Hy-
drodynamics Code for Modelling Astrophysical Thermonuclear Flashes.
Astrophysical Journal Supplement, 131:273{334, 2000.
[4] Kui Gao, Wei-keng Liao, Arifa Nisar, Alok Choudhary, Robert Ross, and
Robert Latham. Using Subfiling to Improve Programming Flexibility
and Performance of Parallel Shared-File I/O. In Proceedings of the 2009
International Conference on Parallel Processing, ICPP '09, pages 470{
477, Washington, DC, USA, 2009. IEEE Computer Society.
[5] Salman Habib, Vitali Morozov, Hal Finkel, Adrian Pope, Katrin Heit-
mann, Kalyan Kumaran, Tom Peterka, Joe Insley, David Daniel, Patri-
cia Fasel, Nicholas Frontiere, and Zarija Lukic. The Universe at Extreme
 
Search WWH ::




Custom Search