OpenMN directive fo network parallelism description

• Project/Area Number: 16K12419
• Research Category: Grant-in-Aid for Challenging Exploratory Research
• Allocation Type: Multi-year Fund
• Research Field: Information network
• Research Institution: Osaka University
• Principal Investigator: Shimojo Shinji 大阪大学, サイバーメディアセンター, 教授 (00187478)
• Co-Investigator(Kenkyū-buntansha): 伊達 進 大阪大学, サイバーメディアセンター, 准教授 (20346175)
• Co-Investigator(Renkei-kenkyūsha): KIDO Yoshiyuki 大阪大学, サイバーメディアセンター, 講師 (70506310)
• Project Period (FY): 2016-04-01 – 2019-03-31
• Project Status: Completed (Fiscal Year 2018)
• Budget Amount: ¥3,380,000 (Direct Cost: ¥2,600,000、Indirect Cost: ¥780,000); Fiscal Year 2017: ¥1,690,000 (Direct Cost: ¥1,300,000、Indirect Cost: ¥390,000); Fiscal Year 2016: ¥1,690,000 (Direct Cost: ¥1,300,000、Indirect Cost: ¥390,000)
• Keywords: ネットワークアーキテクチャ / SDN / 並列計算 / ネットワーク制御

Outline of Final Research Achievements

This research proposed and implemented Open MN, network directive, which allows developers to specify parallelism of network resources composing a distributed parallel system, targeting inter-process communication based on MPI in OpenFlow-based Cluster system. In particular, we focus on MPI_Comm_Split operation for MPI collective communications and applied OpenFlow control to the OpenFlow-based interconnect for efficient traffic control.

Academic Significance and Societal Importance of the Research Achievements

高性能計算機システムを構成する相互結合網は、低遅延・広帯域なネットワーク性能が求められる。一般的に、今日の相互結合網はハードウェア的な制御を行われる。そのため、高性能計算機システムの規模が大きくなると、そのコストは大きくなる。本研究では、相互結合網のソフトウェアでのトラフィック制御を行うことで、効率的な高性能計算の実現を目指した挑戦的研究である。本研究での成果は、いまだ実用にむけて改善の余地があるが、挑戦的なアプローチそのものに学術的意義がある。

Research Products

• [Journal Article] UnisonFlow: A Software-Defined Coordination Mechanism for Message-Passing Communication and Computation (2018)
  • Author(s): Keichi Takahashi, Susumu Date, Dashdavaa Khureltulga, Yoshiyuki Kido, Hiroaki Yamanaka, Eiji Kawai, Shinji Shimojo
  • Journal Title: IEEE Access Volume: 印刷中 Pages: 23372-23382
  • DOI: 10.1109/access.2018.2829532
  • Peer Reviewed / Open Access
• [Journal Article] PRAGMA-ENT: An International SDN Testbed for a Cyberinfrastructure in the Pacific Rim (2016)
  • Author(s): Kohei Ichikawa, Pongsakorn U-chupala, Che Huang, Chawanat Nakasan, Te-Lung Liu, Jo-Yu Chang, Li-Chi Ku, Whey-Fone Tsai, Jason Haga, Hiroaki Yamanaka, Eiji Kawai, Yoshiyuki Kido, Susumu Date, Shinji Shimojo, Philip Papadopoulos, Mauricio Tsugawa, Matthew Collins, Kyuho Jeong, Renato Figueiredo, Jose Fortes
  • Journal Title: Concurrency And Computation: Practice And Experience, Wiley InterScience Volume: - Issue: 13 Pages: 1-8
  • DOI: 10.1002/cpe.4138
  • Peer Reviewed / Int'l Joint Research
• [Journal Article] SDN-accelerated HPC Infrastructure for Scientific Research (2016)
  • Author(s): Susumu Date, Hirotake Abe, Dashdavaa Khureltulga, Keichi Takahashi, Yoshiyuki Kido, Yasuhiro Watashiba, Pongsakorn U-chupala, Kohei Ichikawa, Hiroaki Yamanaka, Eiji Kawai, Shinji Shimojo
  • Journal Title: International Journal of Information Technology Volume: 22 Pages: 1-30
  • Peer Reviewed / Open Access
• [Presentation] A Traffic Simulator with Intra-node Parallelism for Designing High-performance Interconnects (2018)
  • Author(s): Yohei Takigawa, Keichi Takahashi, Susumu Date, Yoshiyuki Kido, Shinji Shimojo
  • Organizer: The 2018 International Conference on High Performance Computing & Simulation (HPCS 2018)
  • Int'l Joint Research
• [Presentation] OpenMN：ネットワーク指向型ディレクティブを用いたMPIコミュニケータ分割機構 (2018)
  • Author(s): 木戸善之, 片岡祐介, 伊達進, 下條真司
  • Organizer: 日本ソフトウェア科学会 第16回ディペンダブルシステムワークショップ
• [Presentation] Evaluation of SDN-based Conflict Avoidance between Data Staging and Inter-Process Communication (2017)
  • Author(s): Arata Endo, Ryoichi Jingai, Susumu Date, Yoshiyuki Kido, Shinji Shimojo
  • Organizer: The 2017 International Conference on High Performance Computing & Simulation (HPCS 2017)
  • Int'l Joint Research
• [Presentation] Adaptive Network Resource Reallocation for Hot-spot Avoidance on SDN-based Cluster System (2016)
  • Author(s): Masaharu Shimizu, Yasuhiro Watashiba, Susumu Date, Shinji Shimojo
  • Organizer: NetCloud 2016 workshop, 8th IEEE International Conference on Cloud Computing Technology and Science (CloudCom2016)
  • Place of Presentation: Parc Alvisse Hotel (ルクセンブルグ大公国)
  • Year and Date: 2016-12-12
  • Int'l Joint Research
• [Presentation] Network Access Control Towards Fully-controlled Cloud Infrastructure (2016)
  • Author(s): Takuya Yamada, Keichi Takahashi, Masaya Muraki, Susumu Date, Shinji Shimojo
  • Organizer: 8th IEEE International Conference on Cloud Computing Technology and Science (CloudCom2016)
  • Place of Presentation: Parc Alvisse Hotel (ルクセンブルグ大公国)
  • Year and Date: 2016-12-12
  • Int'l Joint Research
• [Presentation] A Proposal of On-demand Staging leveraging Job Management System and Software Defined Networking (2016)
  • Author(s): Susumu Date, Takashi Yoshikawa, Yasuhiro Watashiba, Yoshiyuki Kido, Shinji Shimojo
  • Organizer: Workshop on Sustained Simulation Performance (WSSP)
  • Place of Presentation: シュツットガルト大学(シュツットガルト市・ドイツ)
  • Year and Date: 2016-12-05
  • Int'l Joint Research