Study of a Parallel I/O System with a Portable Data Format for Data-Intensive Applications

• Project/Area Number: 18700074
• Research Category: Grant-in-Aid for Young Scientists (B)
• Allocation Type: Single-year Grants
• Research Field: Computer system/Network
• Research Institution: Kinki University
• Principal Investigator: TSUJITA Yuichi Kinki University, 工学部, 講師 (70360435)
• Project Period (FY): 2006 – 2008
• Project Status: Completed (Fiscal Year 2008)
• Budget Amount: ¥3,950,000 (Direct Cost: ¥3,800,000、Indirect Cost: ¥150,000); Fiscal Year 2008: ¥650,000 (Direct Cost: ¥500,000、Indirect Cost: ¥150,000); Fiscal Year 2007: ¥500,000 (Direct Cost: ¥500,000); Fiscal Year 2006: ¥2,800,000 (Direct Cost: ¥2,800,000)
• Keywords: ネットワークコンピューティング / 並列入出力 / PCクラスタ / MPI / MPI-I / O / Stampi / netCDF / parallel netCDF

Research Abstract

可搬性のあるデータ形式をサポートする大規模並列入出力を実現するため、異機種計算機間通信ライブラリStampiをベースに、可搬性のあるデータ形式をサポートする並列入出力インタフェースであるParallel netCDF(以下、PnetCDF)を計算機間でも透過的に利用可能にする研究開発を行った.その結果、計算機間で並列入出力を利用する際に生じる性能低下を低く抑える改善を行い、大規模なデータを可搬性のあるデータ形式で効率的に入出力を行うことが可能になった.

Research Products

• [Journal Article] Yuichi Tsujita, Implementing A Parallel NetCDF Interface for Seamless Remote I/O Using Multi-dimensional Data (2008)
  • Author(s): Yuichi Tsujita,
  • Journal Title: High Performance Computing for Computational Science-VECPAR 2008, Revised Selected Papers, Lecture Notes in Computer Science Vol. 5336 Pages: 69-82
  • Peer Reviewed
• [Journal Article] Feasibility Study of Effective Remote I/O Using a Parallel NetCDF Interface in a Long-Latency Network (2008)
  • Author(s): Yuichi Tsujita,
  • Journal Title: Proceedings of the International Multi-Conference of Engineers and Computer Scientists 2008 Vol.1 Pages: 242-247
  • Peer Reviewed
• [Journal Article] Implementing A Parallel NetCDF Interface for Seamless Remote I/O Using Multi-dimensional Data (2008)
  • Author(s): Yuichi Tsujita
  • Journal Title: Lecture Notes in Computer Science 5336 Pages: 69-82
  • Peer Reviewed
• [Journal Article] Feasibility Study of Effective Remote I/O Using a Parallel NetCDF Inter face in a Long-Latency Network (2008)
  • Author(s): Yuichi Tsujita
  • Journal Title: Proceedings of the International Multi-Conference of Engineers and Computer Scientists 2008 1 Pages: 242-247
  • Peer Reviewed
• [Journal Article] An Empirical Study of Optimization in Seamless Remote MPI-I/O for Long Latency Network (2007)
  • Author(s): Yuichi Tsujita
  • Journal Title: Lecture Notes in Computer Science Vol. 4757 Pages: 389-390
  • Peer Reviewed
• [Journal Article] Supporting Seamless Remote I/O Using a Parallel NetCDF Interface (2007)
  • Author(s): Yuichi Tsujita
  • Journal Title: Distributed and Parallel Systems-From Cluster to Grid Computing Pages: 81-90
  • Peer Reviewed
• [Journal Article] Implementation of a Parallel NetCDF Interface for Seamless Collective Remote I/O (2007)
  • Author(s): Yuichi Tsujita
  • Journal Title: Proceedings of IADIS International Conference on Applied Computing 2007 Pages: 732-736
  • NAID: 40015422252
  • Peer Reviewed
• [Journal Article] Supporting Seamless Remote I/O Using a Parallel NetCDF Interface (2007)
  • Author(s): Yuichi Tsujita
  • Journal Title: Distributed and Parallel Systems-From Cluster to Grid Computing- Pages: 81-90
  • Peer Reviewed
• [Journal Article] An Empirical Study of Optimization in Seamless Remote MPI-I/O for Long Latency Network (2007)
  • Author(s): Yuichi Tsujita
  • Journal Title: Lecture Notes in Computer Science 4757 Pages: 389-390
  • Peer Reviewed
• [Journal Article] Effective Seamless Remote MPI-I/O with Derived Data Types Using PVFS2 (2006)
  • Author(s): Yuichi Tsujita
  • Journal Title: Vol. 4192 Pages: 230-237
  • Peer Reviewed
• [Journal Article] Effective Seamless Remote MPI-I/O with Derived Data Types Using PVFS2 (2006)
  • Author(s): Yuichi Tsujita
  • Journal Title: Lecture Notes in Computer Science 4192 Pages: 230-137
• [Journal Article] Parallel netCDFインタフェースにとる計算機間集団型人出力機能の実装 (2006)
  • Author(s): 辻田 祐一
  • Journal Title: 情報処理学会研究報告 2006-HPC-108 Vol. 2006,No. 106 Pages: 31-36
• [Presentation] Implementing A ParallelNetCDF Interface for Seamless Remote I/O Using Multi-Dimensional Data (2008)
  • Author(s): Yuichi Tsujita
  • Organizer: VECP AR2008
  • Place of Presentation: Toulouse, France, Jun
• [Presentation] Feasibility Study of Effective Remote I/O Using a Parallel NetCDF Interface in a Long-Latency Network (2008)
  • Author(s): Yuichi Tsujita
  • Organizer: The International Multi-Conference of Engineers and Computer Scientists 2008
  • Place of Presentation: Hong-King, China
• [Presentation] Implementing A Parallel NetCDF Interface for Seamless Remote I/O Using Multi-Dimensional Data (2008)
  • Author(s): Yuichi Tsujita
  • Organizer: VECPAR2008
  • Place of Presentation: フランス(ツールーズ)
• [Presentation] An Empirical Study of Optimization in Seamless Remote MPI-I/O for Long Latency Network (2007)
  • Author(s): Yuichi Tsujita
  • Organizer: 14th Europe an PVM/MPI User's Group Meeting
  • Place of Presentation: Paris, France
  • Year and Date: 2007-10-03
• [Presentation] Implementation of a Parallel NetCDF Interface for Seamless Collective Remote I/O (2007)
  • Author(s): Yuichi Tsujita
  • Organizer: IADIS International C onference on Applied Computing 2007
  • Place of Presentation: Salamanca, Spain
• [Presentation] Parallel netCDFインタフェースによる計算機間集団型入出力機能の実装 (2006)
  • Author(s): 辻田祐一
  • Organizer: 情報処理学会第108回HPC研究会
  • Place of Presentation: 京都大学
  • Year and Date: 2006-10-06
• [Presentation] Supporting Seamless Remote I/O Using A Parallel NetCDF Interface (2006)
  • Author(s): Yuichi Tsujita
  • Organizer: 6th Austrian-Hungarian Workshop on Distributed and Parallel Systems (DAPS YS2006)
  • Place of Presentation: Innsbruck, Austria
• [Presentation] Implementation of a Parallel NetCDF Interface for Seamless Colle ctive Remote I/O (2006)
  • Author(s): Yuichi Tsujita
  • Organizer: 13th European PVM/MPI User's Group Meeting Late and Breaking Results
  • Place of Presentation: Bonn, Germany
• [Presentation] Effective Seamless Remote MPI-I/O with Derived Data Types Using PVFS2 (2006)
  • Author(s): Yuichi Tsujita
  • Organizer: 13th European PVM/MPI User's Group Meeting
  • Place of Presentation: Bonn, Germany