• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Structural Recursion on Bulk Synchronous Parallelism for Efficient Large-Graph Querying

Research Project

Project/Area Number 15K12011
Research Category

Grant-in-Aid for Challenging Exploratory Research

Allocation TypeMulti-year Fund
Research Field Software
Research InstitutionNational Institute of Informatics

Principal Investigator

HU Zhenjiang  国立情報学研究所, アーキテクチャ科学研究系, 教授 (50292769)

Co-Investigator(Kenkyū-buntansha) LI CHONG  国立情報学研究所, 大学共同利用機関等の部局等, 特任研究員 (50745312)
Project Period (FY) 2015-04-01 – 2018-03-31
Project Status Completed (Fiscal Year 2017)
Budget Amount *help
¥2,600,000 (Direct Cost: ¥2,000,000、Indirect Cost: ¥600,000)
Fiscal Year 2016: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Fiscal Year 2015: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Keywords大規模グラフ / 構造的再帰 / グラフ問い合わせ / 並列プログラミング / Graph Processing / Structural Recursion / Parallelization / Pregel / Parallel Programming / Parallelization,
Outline of Final Research Achievements

The ever-increasing size of graph data today creates a critical need for programming models that can deal with large graph efficiently. In this research, we proposed a novel solution to efficient large-graph querying, by combining the expressive power of structural recursion with Pregel, a popular system based on Bulk Synchronous Parallelism for large scale graph processing. We showed that any decomposible structural recursion can be efficiently mapped to Pregel, based on which, we succeeded in parallelization of UnQL, a declarative graph query language. Moreover, we designed and implemented a new domain specific language, called Palgel, which can support both remote reads and writes, allow programmers to use a more declarative syntax called chain access to directly read data on remote vertices, and be efficiently implemented over Pregel.

Report

(4 results)
  • 2017 Annual Research Report   Final Research Report ( PDF )
  • 2016 Research-status Report
  • 2015 Research-status Report
  • Research Products

    (12 results)

All 2017 2016 2015 Other

All Journal Article (3 results) (of which Int'l Joint Research: 3 results,  Peer Reviewed: 3 results,  Open Access: 3 results) Presentation (6 results) (of which Int'l Joint Research: 5 results) Remarks (3 results)

  • [Journal Article] Let High-level Graph Queries Be Parallel Efficient: An Approach Over Structural Recursion On Pregel2016

    • Author(s)
      Chong Li, Le-Duc Tung, Xiaodong Meng, Zhenjiang Hu
    • Journal Title

      Journal of Information Processing

      Volume: 24 Issue: 6 Pages: 928-936

    • DOI

      10.2197/ipsjjip.24.928

    • NAID

      130005282160

    • ISSN
      1882-6652
    • Related Report
      2016 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Towards Systematic Parallelization of Graph Transformations over Pregel2016

    • Author(s)
      Le Dec Tung, Zhenjiang Hu
    • Journal Title

      International Journal of Parallel Programming (IJPP)

      Volume: 印刷中 Issue: 2 Pages: 320-339

    • DOI

      10.1007/s10766-016-0418-5

    • Related Report
      2015 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] How Functional Programming Mattered, National Science Review2015

    • Author(s)
      Zhenjiang Hu, John Hughes, Meng Wang
    • Journal Title

      Oxford Journal

      Volume: Volume2, Issue3 Issue: 3 Pages: 349-270

    • DOI

      10.1093/nsr/nwv042

    • Related Report
      2015 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Presentation] Palgol: A High-Level DSL for Vertex-Centric Graph Processing with Remote Data Access2017

    • Author(s)
      Yongzhe Zhang, Hsiang-Shang Ko, Zhenjiang Hu
    • Organizer
      15th Asian Symposium on Programming Languages and Systems (APLAS 2017)
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Think Like a Vertex, Behave Like a Function!--A Functional DSL for Vertex-centric Big Graph Processing--2016

    • Author(s)
      Kento Emoto, Kiminori Matsuzaki, Zhejiang Hu, Akimasa Morihata, Hideya Iwasaki
    • Organizer
      21st ACM SIGPLAN International Conference on Functional Programming (ICFP 2016)
    • Place of Presentation
      Nara Kasugano International Forum (Nara)
    • Year and Date
      2016-09-18
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] Derivation of Parallel-Efficient Structural Recursive Functions from Declarative Graph Queries (Poster)2016

    • Author(s)
      Chong Li, Le-Duc Tung, Xiaodong Meng, Zhenjiang Hu
    • Organizer
      31st ACM/SIGAPP Symposium on Applied Computing (SAC 2016)
    • Place of Presentation
      Pisa (Italy)
    • Year and Date
      2016-04-04
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] Processing UnQL Graph Queries with Pregel2015

    • Author(s)
      Chong Li, Le-Duc Tung, Xiaodong Meng, Zhenjiang Hu
    • Organizer
      日本ソフトウェア科学会第32回大会
    • Place of Presentation
      早稲田大学(東京都新宿区)
    • Year and Date
      2015-09-08
    • Related Report
      2015 Research-status Report
  • [Presentation] Towards Systematic Parallelization of Graph Transformations over Pregel2015

    • Author(s)
      Le Dec Tung, Zhenjiang Hu
    • Organizer
      8th International Symposium on High-level Parallel Programming and Applications (HLPP 2015)
    • Place of Presentation
      Pisa (Italy)
    • Year and Date
      2015-07-02
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] Pregel meets UnCAL: a Systematic Framework for Transforming Big Graphs2015

    • Author(s)
      Le-Duc Tung
    • Organizer
      31st International Conference on Data Engineering Workshop (ICDEW 2015)
    • Place of Presentation
      Seoul (Korea)
    • Year and Date
      2015-04-13
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Remarks] BiGra: Big-Graphs Querying Made Easy

    • URL

      http://www.prg.nii.ac.jp/members/tungld/bigra.html

    • Related Report
      2017 Annual Research Report 2016 Research-status Report
  • [Remarks] Palgol: A DSL for vertex-centric graph processing

    • URL

      https://bitbucket.org/zyz915/palgol

    • Related Report
      2017 Annual Research Report
  • [Remarks] The SkeTo Project

    • URL

      http://research.nii.ac.jp/~hu/project/skepara.html

    • Related Report
      2015 Research-status Report

URL: 

Published: 2015-04-16   Modified: 2019-03-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi