Takuto Sato
ABSTRACT
In meteorology, high-resolution simulations using large eddy simulation (LES) models have attracted strong attention. In these LES models, the output data become large, because the spatio-temporal resolution is higher than that of conventional meteorological simulations. Therefore, I/O requirements become much more demanding. In addition, it becomes challenging to analyze the results of these simulations, owing to a large data set size. To overcome these problems, it is necessary to consider hardware and software architectures for in-situ data analysis, for accommodating these I/O requirements. In this study, we propose a large-scale fluid analysis system combining a meteorological LES model and dynamic mode decomposition (DMD). We propose to use a burst buffer as a temporary storage space for storing large-scale output of LES models, and to read these data from DMD. The burst buffer is an all-flash storage system between compute nodes and a parallel file system. The I/O performance of the LES output and DMD input of this workflow is analyzed, and it is shown that the proposed burst buffer is an effective medium for in-situ data analysis.
References
- J. Bent, G. Gibson, G. Grider, B. McClelland, P. Nowoczynski, J. Nunez, M. Polte, and M. Wingate. 2009. PLFS: a checkpoint filesystem for parallel applications. In Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis. 1--12. https://doi.org/10.1145/1654059.1654081Google Scholar
- Wahid Bhimji, Debbie Bard, Melissa Romanus, David Paul, Andrey Ovsyan- nikov, Brian Friesen, Matt Bryson, Joaquin Correa, Glenn K Lockwood, Vakho Tsulaia, et al. 2016. Accelerating science with the NERSC burst buffer early user program. CUG2016 proceedings (2016), 1--15.Google Scholar
- Jose J Camata, Vitor Silva, Patrick Valduriez, Marta Mattoso, and Alvaro LGA Coutinho. 2018. In situ visualization and data analysis for turbidity currents simulation. Computers & Geosciences 110 (2018), 23--31.Google ScholarDigital Library
- Cray [n. d.]. DataWarp User Guide. ([n. d.]). http://docs.cray.com/books/ S-2558--5204/S2558--5204.pdfGoogle Scholar
- Rafael Ferreira da Silva, Scott Callaghan, and Ewa Deelman. 2017. On the Use of Burst Buffers for Accelerating Data-intensive Scientific Workflows. In Pro- ceedings of the 12th Workshop on Workflows in Support of Large-Scale Science (WORKS '17). ACM, New York, NY, USA, Article 2, 9 pages. https://doi.org/10. 1145/3150994.3151000Google Scholar
- Christopher S Daley, Devarshi Ghoshal, Glenn K Lockwood, Sudip Dosanjh, La- vanya Ramakrishnan, and Nicholas J Wright. 2016. Performance characteriza- tion of scientificworkflows for the optimal use of burst buffers. In 11thWorkflows in Support of Large-Scale Science, WORKS'16. 69--73.Google Scholar
- David Ellsworth, Bryan Green, Chris Henze, Patrick Moran, and Timothy Sand- strom. 2006. Concurrent visualization in a production supercomputing environ- ment. IEEE Transactions on Visualization and Computer Graphics 12, 5 (2006), 997--1004.Google ScholarDigital Library
- Ryosaku. Ikeda, Hiroyuki Kusaka, Satoru Iizuka, and Taisuke Boku. 2015. Devel- opment of Urban Meteorological LES model for Thermal Environment at City Scale. In 9th International Conference for Urban Climate. 5.Google Scholar
- JCAHPC [n. d.]. Basic Specification of Oakforest-PACS. ([n. d.]). http://jcahpc. jp/files/OFP-basic.pdfGoogle Scholar
- Ning Liu, Jason Cope, Philip Carns, Christopher Carothers, Robert Ross, Gary Grider, Adam Crume, and Carlos Maltzahn. 2012. On the role of burst buffers in leadership-class storage systems. In 2012 IEEE 28th Symposium on Mass Stor- age Systems and Technologies (MSST). 1--11. https://doi.org/10.1109/MSST.2012. 6232369Google ScholarCross Ref
- Lustre [n. d.]. Lustre File System. http://www.lustre.org. ([n. d.]).Google Scholar
- Keigo Matsuda, Ryo Onishi, and Keiko Takahashi. 2018. Tree-crown-resolving large-eddy simulation coupled with three-dimensional radiative transfer model. Journal of Wind Engineering and Industrial Aerodynamics 173 (2018), 53--66.Google ScholarCross Ref
- Kento Sato, Kathryn Mohror, Adam Moody, Todd Gamblin, Bronis R De Supin- ski, Naoya Maruyama, and Satoshi Matsuoka. 2014. A User-Level InfiniBand- Based File System and Checkpoint Strategy for Burst Buffers. In 2014 14th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing. 21-- 30. https://doi.org/10.1109/CCGrid.2014.24Google ScholarDigital Library
- Wolfram Schenck, Salem El Sayed, Maciej Foszczynski, Wilhelm Homberg, and Dirk Pleiter. 2017. Evaluation and Performance Modeling of a Burst Buffer So- lution. SIGOPS Oper. Syst. Rev. 50, 2 (Jan. 2017), 12--26. https://doi.org/10.1145/ 3041710.3041714Google ScholarDigital Library
- Peter J. Schmid. 2010. Dynamic mode decomposition of numerical and experi- mental data. Journal of Fluid Mechanics 656 (2010), 5--28.Google ScholarCross Ref
- Unidata [n. d.]. What is chunking? ([n. d.]). https://www.unidata.ucar.edu/ software/netcdf/workshops/2011/nc4chunking/WhatIsChunking.htmlGoogle Scholar
- T. Wang, K. Mohror, A. Moody, K. Sato, and W. Yu. 2016. An Ephemeral Burst- Buffer File System for Scientific Applications. In SC '16: Proceedings of the Inter- national Conference for High Performance Computing, Networking, Storage and Analysis. 807--818. https://doi.org/10.1109/SC.2016.68Google Scholar
- Hongfeng Yu, Chaoli Wang, Ray W Grout, Jacqueline H Chen, and Kwan-Liu Ma. 2010. In situ visualization for large-scale combustion simulations. IEEE computer graphics and applications 30, 3 (2010), 45--57.Google Scholar
Index Terms
In-situ Data Analysis System for High Resolution Meteorological Large Eddy Simulation Model
Comments