Flow Control Sequence Generator for Fast MPI Communication on an OpenFlow Interconnect

• Project/Area Number: 26330145
• Research Category: Grant-in-Aid for Scientific Research (C)
• Allocation Type: Multi-year Fund
• Section: 一般
• Research Field: High performance computing
• Research Institution: Osaka University
• Principal Investigator: Date Susumu 大阪大学, サイバーメディアセンター, 准教授 (20346175)
• Project Period (FY): 2014-04-01 – 2018-03-31
• Project Status: Completed (Fiscal Year 2017)
• Budget Amount: ¥4,680,000 (Direct Cost: ¥3,600,000、Indirect Cost: ¥1,080,000); Fiscal Year 2016: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000); Fiscal Year 2015: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000); Fiscal Year 2014: ¥2,340,000 (Direct Cost: ¥1,800,000、Indirect Cost: ¥540,000)
• Keywords: MPI / SDN

Outline of Final Research Achievements

This research has realized a parallel distributed computing environment that accelerates MPI execution, taking advantage of network programmability brought by SDN (Software Defined Networking) and MPI program characteristics. In more detail, the proposed method in this paper dynamically controls a sequence of network flows on OpenFlow Controller in a software-programming manner. We have shown that the proposed method in this research is effective to reduction of execution time for MPI collective communications such as MPI_Bcast and MPI_Allreduce.

Research Products

• [Journal Article] UnisonFlow: A Software-Defined Coordination Mechanism for Message-Passing Communication and Computation (2018)
  • Author(s): Keichi Takahashi, Susumu Date, Dashdavaa Khureltulga, Yoshiyuki Kido, Hiroaki Yamanaka, Eiji Kawai, Shinji Shimojo
  • Journal Title: IEEE Access Volume: 印刷中 Pages: 23372-23382
  • DOI: 10.1109/access.2018.2829532
  • Peer Reviewed / Open Access
• [Journal Article] Towards a Software Defined Secure Data Staging Mechanism (2017)
  • Author(s): Susumu Date, Takashi Yoshikawa, Kazunori Nozaki, Yasuhiro Watashiba, Yoshiyuki Kido, Masahiko Takahashi, Masaya Muraki, Shinji Shimojo
  • Journal Title: Sustained Simulation Performance 2017 Volume: - Pages: 15-24
  • DOI: 10.1007/978-3-319-66896-3_2
  • ISBN: 9783319668956, 9783319668963
  • Open Access
• [Journal Article] SDN-accelerated HPC Infrastructure for Scientific Research (2016)
  • Author(s): Susumu Date, Hirotake Abe, Dashdavaa Khureltulga, Keichi Takahashi, Yoshiyuki Kido, Yasuhiro Watashiba, Pongsakorn U-chupala, Kohei Ichikawa, Hiroaki Yamanaka, Eiji Kawai, Shinji Shimojo
  • Journal Title: International Journal of Information Technology Volume: 22 Pages: 1-30
  • Peer Reviewed / Open Access / Acknowledgement Compliant
• [Journal Article] Toward Flexible Supercomputing and Visualization System (2015)
  • Author(s): Susumu Date, Yoshiyuki Kido, Khureltulga Dashdavaa, Keichi Takahashi, Yasuhiro Watashiba, Shinji Shimojo
  • Journal Title: Sustained Simulation Performance 2015 Volume: 1 Pages: 77-03
  • DOI: 10.1007/978-3-319-20340-9_7
  • ISBN: 9783319203393, 9783319203409
  • Peer Reviewed / Acknowledgement Compliant
• [Presentation] PFAnalyzer: A Toolset for Analyzing Application-Aware Dynamic Interconnects (2017)
  • Author(s): Takahashi Keichi, Date Susumu, Khureltulga Dashdavaa, Kido Yoshiyuki, Shimojo Shinji
  • Organizer: The Monitoring and Analysis for High Performance Computing Systems Plus Applications (HPCMASPA) Workshop, Cluster 2017
  • Int'l Joint Research
• [Presentation] Evaluation of SDN-based Conflict Avoidance between Data Staging and Inter-Process Communication (2017)
  • Author(s): Endo Arata, Jingai Ryoichi, Date Susumu, Kido Yoshiyuki, Shimojo Shinji
  • Organizer: The 2017 International Conference on High Performance Computing & Simulation (HPCS 2017)
  • Int'l Joint Research
• [Presentation] Evaluation of SDN-based Conflict Avoidance between Data Staging and Inter-Process Communication (2017)
  • Author(s): Arata Endo, Ryoichi Jingai, Susumu Date, Yoshiyuki Kido, Shinji Shimojo
  • Organizer: The 2017 International Conference on High Performance Computing & Simulation (HPCS 2017)
  • Int'l Joint Research
• [Presentation] MPI通信パターンに基づくSDN制御を高速化するカーネルモジュールの試作と評価 (2016)
  • Author(s): 高橋慧智，Khureltulga Dashdavaa，木戸善之，伊達進，下條真司
  • Organizer: 情報処理学会システムソフトウェアとオペレーティング・システム（OS）研究会
  • Place of Presentation: ホテルモントレ沖縄(沖縄・恩納村)
  • Year and Date: 2016-05-30
• [Presentation] Current Research on SDN and IoT (2015)
  • Author(s): Susumu Date, Yoshiyuki Kido
  • Organizer: Southeast Asia International Joint-Research and Training Program 2015
  • Place of Presentation: Taichung-Keelung, Taiwan
  • Year and Date: 2015-12-07
  • Invited
• [Presentation] Design and Implementation of Control Sequence Generator for SDN-enhanced MPI (2015)
  • Author(s): Baatarsuren Munkhdorj, Keichi Takahashi, Khureltulga Dashdavaa, Yasuhiro Watashiba, Yoshiyuki Kido, Susumu Date, Shinji Shimojo
  • Organizer: The 5th International Workshop on Network-aware Data Management(NDM’15)
  • Place of Presentation: Austin, USA
  • Year and Date: 2015-11-16
  • Int'l Joint Research
• [Presentation] An Empirical Study of SDN-accelerated HPC Infrastructure for Scientific Research (2015)
  • Author(s): Susumu Date, Hirotake Abe, Khureltulga Dashdavaa, Keichi Takahashi, Yoshuyuki Kido, Yasuhiro Watashiba, Pongsakorn U-Chupala, Kohei Ichikawa, Hiroaki Yamanaka, Eiji Kawai, Shinji Shimojo
  • Organizer: International Conference Research and Innovation (ICCCRI) 2015
  • Place of Presentation: Singapore
  • Year and Date: 2015-10-26
  • Int'l Joint Research
• [Presentation] A MPI Concept with Efficient Control of Network Functionality Based on SDN (2015)
  • Author(s): Khureltulga Dashdavaa, Munkhdorj Baatarsuren, Keichi Takahashi, Susumu Date, Yoshiyuki Kido, Shinji Shimojo
  • Organizer: PRAGMA workshop 29
  • Place of Presentation: Depok, Indonesia
  • Year and Date: 2015-10-07
  • Int'l Joint Research
• [Presentation] Concept and Design of SDN-enhanced MPI Framework (2015)
  • Author(s): Keichi Takahashi, Khureltulga Dashdavaa, Baatarsuren Munkhdorj, Yoshiyuki Kido, Susumu Date, Hiroaki Yamanaka, Eiji Kawai, Shinji Shimojo
  • Organizer: The fourth edition of the European Workshop on Software Defined Networks
  • Place of Presentation: Bilbao, Spain
  • Year and Date: 2015-09-30
  • Int'l Joint Research
• [Presentation] Control Sequence Generator for Generic SDN-­enhanced MPI Framework (2015)
  • Author(s): Keichi Takahashi, Baatarsuren Munkhdorj, Khureltulga Dashdavaa, Susumu Date, Yoshiyuki Kido, Shinji Shimojo
  • Organizer: PRAGMA workshop 28
  • Place of Presentation: Nara, Japan
  • Year and Date: 2015-04-08
  • Int'l Joint Research
• [Presentation] Software Defined Infrastructure towards HPC cloud (2015)
  • Author(s): Susumu Date
  • Organizer: The 10th AEARU Workshop on Computer Science and Web Technology
  • Place of Presentation: つくば市筑波大学
  • Year and Date: 2015-02-25 – 2015-02-27
  • Invited
• [Presentation] Quest for Software Defined Infrastructure for New-Generation Computing and Visualization (2014)
  • Author(s): Susumu Date
  • Organizer: Southeast Asia International Joint-Research and Training Service
  • Place of Presentation: 台湾高雄市National Sun Yat-sen University
  • Year and Date: 2014-12-01 – 2014-12-05
  • Invited
• [Presentation] Performance Evaluation of SDN-enhanced MPI_Allreduce on a Cluster System with Fat-tree Interconnect (2014)
  • Author(s): Keichi Takahashi, Dashdavaa Khureltulga, Yasuhiro Watashiba, Yoshiyuki Kido, Susumu Date, Shinji Shimojo
  • Organizer: The International Conference on High Performance Computing and Simulations
  • Place of Presentation: イタリア ボローニャ市The Savoia Hotel Regency
  • Year and Date: 2014-07-21 – 2014-07-25
• [Remarks] 通信特性にfitした実行時プロセス間通信制御技術
  • URL: http://ds-server.ais.cmc.osaka-u.ac.jp/interproc-com/
• [Remarks] Runtime inter-process communication protocol
  • URL: http://ds-server.ais.cmc.osaka-u.ac.jp/interproc-com/
• [Remarks] Runtime inter-process communication control
  • URL: http://ds-server.ais.cmc.osaka-u.ac.jp/en/interproc-com2/