Simulation Code Optimization for DNS of Turbulence toward Peta-scale Computing

• Project/Area Number: 26390130
• Research Category: Grant-in-Aid for Scientific Research (C)
• Allocation Type: Multi-year Fund
• Section: 一般
• Research Field: Computational science
• Research Institution: Kobe University
• Principal Investigator: YOKOKAWA MITSUO 神戸大学, システム情報学研究科, 教授 (70358307)
• Co-Investigator(Kenkyū-buntansha): 森下 浩二 神戸大学, 計算科学教育センター, 特命助教 (50634648)
• Co-Investigator(Renkei-kenkyūsha): ISHIHARA Takashi 名古屋大学, 大学院工学研究科, 准教授 (10262495)
• Project Period (FY): 2014-04-01 – 2017-03-31
• Project Status: Completed (Fiscal Year 2016)
• Budget Amount: ¥3,510,000 (Direct Cost: ¥2,700,000、Indirect Cost: ¥810,000); Fiscal Year 2016: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000); Fiscal Year 2015: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000); Fiscal Year 2014: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
• Keywords: Direct Simulation / Parallel Computation / Tubulence / Phase Shift Method / K Computer / 直接数値シミュレーション / 並列計算 / エイリアス誤差除去 / スーパーコンピュータ / 一様等方性乱流 / 並列化コード

Outline of Final Research Achievements

A parallel direct numerical simulation (DNS) code was developed on the K computer for solving the Navier-Stokes equations in a box with periodic boundary conditions for three orthogonal axes. The objective of the code is to simulate behaviors of homogeneous, isotropic incompressible turbulent flow, or canonical turbulent flow, which is the most standard flow among turbulent flows without boundary walls. Pesudo-spectral method is used for discretization in 3-dimensional space and forth-order Runge-Kutta method is used for temporal discretization. Hybrid parallelization with both OpenMP and MPI are adopted in the code. The DNS with grid points of 12288 cubed were carried out on the K computer with sustained performance of 2.2% on the 37,376 compute nodes. Simulation data for about Reynolds number 2300 were obtained.

Research Products

• [Journal Article] Energy spectrum in high-resolution direct numerical simulations of turbulence (2016)
  • Author(s): Takashi Ishihara, Koji Morishita, Mitsuo Yokokawa, Atsuya Uno and Yukio Kaneda
  • Journal Title: Phys. Rev. Fluids Volume: 1 Issue: 8 Pages: 1-9
  • DOI: 10.1103/physrevfluids.1.082403
  • NAID: 120005981191
  • Peer Reviewed / Open Access / Acknowledgement Compliant
• [Journal Article] 高レイノルズ数乱流中の渦の組織構造とその時間発展 (2016)
  • Author(s): 石原卓, 宇野篤也, 森下浩二, 横川三津夫, 金田行雄
  • Journal Title: ながれ Volume: 35 Pages: 109-113
  • Peer Reviewed / Open Access
• [Journal Article] Accurate Parallel Algorithm for Tracking Inertial Particles in Large-Scale Direct Numerical Simulations of Turbulence (2015)
  • Author(s): T. Ishihara, K. Enohata, K. Morishita, M. Yokokawa, and K. Ishii
  • Journal Title: Parallel Computing Technologies, LNCS 9251 Volume: 9251 Pages: 522-527
  • DOI: 10.1007/978-3-319-21909-7_51
  • ISBN: 9783319219080, 9783319219097
  • Peer Reviewed / Acknowledgement Compliant
• [Journal Article] 一様等方性乱流の直接数値シミュレーションコードの京コンピュータ向け最適化 (2014)
  • Author(s): 森下浩二，横川三津夫，宇野篤也，石原卓，金田行雄
  • Journal Title: 研究報告ハイパフォーマンスコンピューティング（HPC） Volume: 2014-HPC-147(17) Pages: 1-5
  • NAID: 110009850779
  • Acknowledgement Compliant
• [Presentation] Vortex Clusters and Their Time Evolution in High-Reynolds-Number Turbulence (2016)
  • Author(s): Ishihara, T., Uno, A., Morishita, K., Yokokawa, M., and Kaneda, Y.
  • Organizer: APS Division of Fluid Dynamics Meeting
  • Place of Presentation: Portland, U.S.A.
  • Year and Date: 2016-11-20
  • Int'l Joint Research
• [Presentation] Performance Study on Two-Path Aliasing-Free Calculation of a Spectral DNS Code (2016)
  • Author(s): M. Yokokawa, K. Morishita, A. Uno, T. Ishihara, and Y. Kaneda
  • Organizer: The 23rd Workshop on Sustained Simulation Performance
  • Place of Presentation: Tohoku Univ. (Sendai, Miyagi)
  • Year and Date: 2016-03-16
  • Int'l Joint Research
• [Presentation] 高レイノルズ数乱流中の渦の組織構造とその時間発展 (2015)
  • Author(s): 石原卓，宇野篤也，森下浩二，横川三津夫，金田行雄
  • Organizer: 第29回数値流体力学シンポジウム
  • Place of Presentation: 九州大学（福岡県・福岡市）
  • Year and Date: 2015-12-15
• [Presentation] Energy Spectra of Higher Reynolds Number Turbulence by the DNS with up to 12288^3 Grid Points (2015)
  • Author(s): T. Ishihara, Y. Kaneda, K. Morishita, M. Yokokawa, and A. Uno
  • Organizer: 67th Annual Meeting of the APS Division of Fluid Dynamics
  • Place of Presentation: San Francisco(U.S.A.)
  • Year and Date: 2015-11-23
  • Int'l Joint Research
• [Presentation] Energy Spectrum in High Reynolds Number Turbulence - High Resolution DNS Results (2015)
  • Author(s): K. Morishita, T. Ishihara, Y. Kaneda, M. Yokokawa, and A. Uno
  • Organizer: 67th Annual Meeting of the APS Division of Fluid Dynamics
  • Place of Presentation: San Francisco(U.S.A.)
  • Year and Date: 2015-11-23
  • Int'l Joint Research