• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Study of highly scalable parallel I/O systems for high performance computing with huge data management

Research Project

Project/Area Number 25330148
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Research Field High performance computing
Research InstitutionInstitute of Physical and Chemical Research

Principal Investigator

Tsujita Yuichi  国立研究開発法人理化学研究所, 計算科学研究機構, 開発研究員 (70360435)

Project Period (FY) 2013-04-01 – 2017-03-31
Project Status Completed (Fiscal Year 2016)
Budget Amount *help
¥4,940,000 (Direct Cost: ¥3,800,000、Indirect Cost: ¥1,140,000)
Fiscal Year 2015: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2014: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2013: ¥2,860,000 (Direct Cost: ¥2,200,000、Indirect Cost: ¥660,000)
Keywordsネットワークコンピューティング / 並列入出力 / PCクラスタ / MPI / 並列ファイルシステム / MPI-IO / アグリゲータ / 並列I/O / マルチスレッド処理 / CPUコア配置
Outline of Final Research Achievements

ROMIO is well known as one of the representative MPI-IO implementations, and it provides high performance parallel I/O. However, it can not achieve enough I/O performance when we have multiple processes per node. In this research work, we have introduced topology-aware treatment in layout of processes that play file I/O and data aggregation task associated with the file I/O task in order to improve I/O performance of ROMIO.
Consequently, we have achieved high scalable parallel I/O in ROMIO using the proposed scheme with any kind of process layout.

Report

(5 results)
  • 2016 Annual Research Report   Final Research Report ( PDF )
  • 2015 Research-status Report
  • 2014 Research-status Report
  • 2013 Research-status Report
  • Research Products

    (5 results)

All 2016 2015 2014

All Journal Article (3 results) (of which Peer Reviewed: 3 results,  Acknowledgement Compliant: 2 results) Presentation (2 results)

  • [Journal Article] Topology-Aware Data Aggregation for High Performance Collective MPI-IO on a Multi-Core Cluster System2016

    • Author(s)
      Yuichi Tsujita, Atsushi Hori, Toyohisa Kameyama, Yutaka Ishikawa
    • Journal Title

      Proceedings of 2016 Fourth International Symposium on Computing and Networking (CANDAR'16)

      Volume: - Pages: 37-46

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Striping Layout Aware Data Aggregation for High Performance I/O on a Lustre File System2015

    • Author(s)
      Yuichi Tsujita 他2名
    • Journal Title

      Proceedings of the International Supercomputing Conference 2015

      Volume: 印刷中

    • Related Report
      2014 Research-status Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Affinity-Aware Optimization of Multithreaded Two-Phase I/O for High Throughput Collective I/O2014

    • Author(s)
      Yuichi Tsujita, 他2名
    • Journal Title

      Proceedings of HPCS2014(採択済み、2014年7月発刊予定)

      Volume: 印刷中

    • Related Report
      2013 Research-status Report
    • Peer Reviewed
  • [Presentation] プロセス配置を考慮した通信の最適化による集団型MPI-IOの高速化2016

    • Author(s)
      辻田祐一、堀敦史、亀山豊久、石川裕
    • Organizer
      第154回情報処理学会ハイパフォーマンスコンピューティング研究会
    • Place of Presentation
      海洋研究開発機構 横浜研究所
    • Year and Date
      2016-04-25
    • Related Report
      2015 Research-status Report
  • [Presentation] Lustreのストライピングアクセスパターンに配慮した集団型MPI-IOの性能向上に向けた試み2015

    • Author(s)
      辻田祐一、堀敦史、石川裕
    • Organizer
      第149回情報処理学会ハイパフォーマンスコンピューティング研究会
    • Place of Presentation
      工学院大学
    • Year and Date
      2015-06-26
    • Related Report
      2015 Research-status Report

URL: 

Published: 2014-07-25   Modified: 2019-07-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi