2012 Fiscal Year Final Research Report
Peta-scale Data Processing for Large-scale Heterogeneous Clusters
| Project/Area Number |
23700031
|
|---|
| Research Category |
Grant-in-Aid for Young Scientists (B)
|
| Allocation Type | Multi-year Fund |
|---|
| Research Field |
Software
|
|---|
| Research Institution | Tokyo Institute of Technology |
|---|
Principal Investigator |
SATO Hitoshi 東京工業大学, 学術国際情報センター, 特任助教 (00550633)
|
|---|
| Project Period (FY) |
2011 – 2012
|
| Keywords | 並列処理 / 分散処理 / 大規模データ処理 |
|---|
| Research Abstract |
We developed a MapReduce framework for GPU-based heterogeneous clusters as an instance of a future large-scale new platform with heterogeneous many core processors for big data applications. We confirmed performance scalability and overhead of our MapReduce framework by running MapReduce-based graph processing applications using 256 nodes 768GPUs of the TSUBAME2.0 supercomputer. Our results lead the foundation of softwaretechnology for next-generation extreme big data processing.
|
