Developing an algebraic model and program development platform for large-scale graph processing
| Project/Area Number |
26280020
|
|---|
| Research Category |
Grant-in-Aid for Scientific Research (B)
|
| Allocation Type | Partial Multi-year Fund |
|---|
| Section | 一般 |
|---|
| Research Field |
Software
|
|---|
| Research Institution | The University of Electro-Communications |
|---|
Principal Investigator |
Iwasaki Hideya 電気通信大学, 大学院情報理工学研究科, 教授 (90203372)
|
|---|
| Co-Investigator(Kenkyū-buntansha) |
胡 振江 国立情報学研究所, アーキテクチャ科学研究系, 教授 (50292769)
松崎 公紀 高知工科大学, 情報学群, 教授 (30401243)
江本 健斗 九州工業大学, 大学院情報工学研究院, 准教授 (00587470)
|
|---|
| Project Period (FY) |
2014-04-01 – 2019-03-31
|
| Project Status |
Completed (Fiscal Year 2018)
|
| Budget Amount *help |
¥17,030,000 (Direct Cost: ¥13,100,000、Indirect Cost: ¥3,930,000)
Fiscal Year 2017: ¥2,600,000 (Direct Cost: ¥2,000,000、Indirect Cost: ¥600,000)
Fiscal Year 2016: ¥5,590,000 (Direct Cost: ¥4,300,000、Indirect Cost: ¥1,290,000)
Fiscal Year 2015: ¥5,200,000 (Direct Cost: ¥4,000,000、Indirect Cost: ¥1,200,000)
Fiscal Year 2014: ¥3,640,000 (Direct Cost: ¥2,800,000、Indirect Cost: ¥840,000)
|
|---|
| Keywords | プログラミング方法論 / グラフ並列処理 / 領域特化言語 / 代数データ型 / 関数型言語 / 大規模並列処理 / 代数的データ型 |
|---|
| Outline of Final Research Achievements |
In this research, we developed a system named Fregel as an open source software that encourages the programmer to develop efficient parallel applications for large-scale graph processing. Technical contributions of this research can be summarized as follows. First, we abstracted and formalized the synchronous vertex-centric computation as a higher-order function. Second, on the basis of the functional model, we proposed Fregel, a functional domain specific language for declarative-style programming on large graphs. Third, we developed a Fregel compiler that transforms a Fregel program into programs for existing vertex-centric frameworks such as Giraph and Pregel+. This compiler applies optimization methods for a target Fregel program by removing unnecessary communications between vertices on the basis of algebraic properties of the programs. Fourth, we confirmed that Fregel programs compiled by the Fregel compiler can be executed with reasonable performance through some experiments.
|
| Academic Significance and Societal Importance of the Research Achievements |
本研究は，グラフ中に潜む代数的データ型に基づく構造に注目したモデル化を行っている点に，従来の研究にはほとんどみられない学術的な特徴がある．本研究の成果により，従来はプログラマが手で記述していたグラフデータの並列処理に関して，処理の自然な記述を可能とする領域特化言語と，気軽な利用を可能とする並列実行系が一体となり，プログラマの負担が大きく軽減される．さらにプログラムの代数的な性質に基づく最適化処理をコンパイラが内部で自動的に行うため，プログラマは効率のための細部に囚われる必要はなくなる．Webに代表される巨大なグラフデータに対する処理への需要が大きくなっている今日，その意義は大きい．
|
Report
(6 results)
Research Products
(44 results)
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
[Presentation] Parallel Tree Accumulations on MapReduce2014
Author(s)
Kiminori Matsuzaki, Reina Miyazaki
Organizer
7th International Symposium on High-level Parallel Programming and Applications (HLPP 2014)
Place of Presentation
Amsterdam, Netherlands
Year and Date
2014-07-03 – 2014-07-04
Related Report
-
-
-
