• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Developing a methodology for large-scale graph parallel processing based on program synthesis and transformation

Research Project

Project/Area Number 19K11901
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Review Section Basic Section 60050:Software-related
Research InstitutionMeiji University (2022)
The University of Electro-Communications (2019-2021)

Principal Investigator

Iwasaki Hideya  明治大学, 理工学部, 専任教授 (90203372)

Co-Investigator(Kenkyū-buntansha) 江本 健斗  九州工業大学, 大学院情報工学研究院, 准教授 (00587470)
Project Period (FY) 2019-04-01 – 2023-03-31
Project Status Completed (Fiscal Year 2022)
Budget Amount *help
¥4,290,000 (Direct Cost: ¥3,300,000、Indirect Cost: ¥990,000)
Fiscal Year 2021: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2020: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Fiscal Year 2019: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Keywords大規模グラフ並列処理 / 頂点主体計算 / 部分グラフ主体計算 / プログラム運算 / 大規模グラフ処理 / 領域特化言語 / プログラム変換・合成
Outline of Research at the Start

今日,大規模データ,特にソーシャルネットワーク,道路網ネットワークに代表される大規模グラフデータが身近な存在となっており,それを並列分散処理して効率良く処理することが求められている.本研究は,大規模グラフ並列分散処理を行うプログラムを効率的に開発し,かつ,プログラム毎に適したモデル上での実行が可能なプログラムを開発する手法を確立することを目的とする.
そのため本研究では,従来から提案されている頂点の同期的処理に基づく計算モデルによるプログラムを出発点とし,解決したい問題ごとに適した計算モデルのプログラムを,プログラム変換・合成の技術を用いて段階的に導出することを目指し,その効果を実際に確認する.

Outline of Final Research Achievements

The objective of this research was to develop a methodology both for efficiently developing programs for large-scale graph parallel/distributed processing and for executing programs on their suitable processing models. The following results were obtained. (1) As an adaptive co-existence mechanism between vertex-centric computation and subgraph-centric computation, we designed and developed a system that enables a program to be run initially in the vertex-centric manner and then in the subgraph-centric manner in the course of its computation. (2) We designed a domain-specific language (DSL) that can handle subsets of vertices at a higher level of abstraction than vertex-centric computation, and built a compiler for the DSL. (3) We implemented the basic part of a parallel and distributed processing system that enables both vertex- and subgraph-centric computation, and synchronous/asynchronous execution.

Academic Significance and Societal Importance of the Research Achievements

本研究は,大規模グラフ並列分散処理を,主として頂点主体と部分グラフ主体という代表的なふたつのモデル,さらに実行方式として同期的実行と非同期的実行に注目している.巨大なグラフデータに対する処理への需要が高まって久しいが,どのモデルや処理方式が適しているかは,問題そのものの性質,グラフの形状等に依存しており,実際に処理を行ってみないとわからないという側面がある.本研究による頂点主体計算と部分グラフ主体計算の適応的な共存機構,公平な実行基盤提供するシステム等は,大規模グラフ並列処理プログラムの効率的な開発に寄与するものである.

Report

(5 results)
  • 2022 Annual Research Report   Final Research Report ( PDF )
  • 2021 Research-status Report
  • 2020 Research-status Report
  • 2019 Research-status Report
  • Research Products

    (8 results)

All 2023 2022 2021 2020 2019 Other

All Journal Article (4 results) (of which Int'l Joint Research: 1 results,  Peer Reviewed: 4 results,  Open Access: 4 results) Presentation (3 results) (of which Int'l Joint Research: 1 results) Remarks (1 results)

  • [Journal Article] Fregel: a functional domain-specific language for vertex-centric large-scale graph processing2022

    • Author(s)
      IWASAKI HIDEYA、EMOTO KENTO、MORIHATA AKIMASA、MATSUZAKI KIMINORI、HU ZHENJIANG
    • Journal Title

      Journal of Functional Programming

      Volume: 32

    • DOI

      10.1017/s0956796821000277

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Distributed parallel generation of large-scale random graphs based on Watts–Strogatz model2020

    • Author(s)
      神野 薫, 江本 健斗
    • Journal Title

      Computer Software

      Volume: 37 Issue: 2 Pages: 2_34-2_45

    • DOI

      10.11309/jssst.37.2_34

    • NAID

      130007863812

    • ISSN
      0289-6540
    • Year and Date
      2020-04-23
    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Eliminating unnecesarry communications in the vertex-centric graph processing by the Fregel compiler.2019

    • Author(s)
      加藤直斗, 岩崎英哉
    • Journal Title

      Computer Software

      Volume: 36 Issue: 2 Pages: 2_28-2_46

    • DOI

      10.11309/jssst.36.2_28

    • NAID

      130007666997

    • ISSN
      0289-6540
    • Year and Date
      2019-04-24
    • Related Report
      2019 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] A DSL for graph parallel programming with vertex subsets2019

    • Author(s)
      Kento Emoto, Fumihisa Sadahira
    • Journal Title

      The Journal of Supercomputing

      Volume: 75 Issue: 7 Pages: 1-18

    • DOI

      10.1007/s11227-019-02821-w

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access
  • [Presentation] 大域的グラフ計算記述言語の最適化および辺集合に関する拡張2023

    • Author(s)
      福島 央章, 江本 健斗
    • Organizer
      火の国情報シンポジウム2023論文集
    • Related Report
      2022 Annual Research Report
  • [Presentation] Switching execution between vertex-centric computation and block-centric computation for distributed large-graph processing2021

    • Author(s)
      Ryuichi Takakura, Kento Emoto
    • Organizer
      9th International Symposium on Applied Engineering and Sciences (SAES2021)
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Watts-Strogatz モデルに基づく大規模ランダムグラフの分散並列生成2019

    • Author(s)
      神野 薫, 江本 健斗
    • Organizer
      日本ソフトウェア科学会第36回大会
    • Related Report
      2019 Research-status Report
  • [Remarks] Fregel Project

    • URL

      https://ipl.cs.uec.ac.jp/~iwasaki/Fregel/

    • Related Report
      2022 Annual Research Report

URL: 

Published: 2019-04-18   Modified: 2024-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi