Studies on Remote Parallel Pipe Mechanism for Wide-Area Distributed Metacomputing
Project/Area Number |
15500044
|
Research Category |
Grant-in-Aid for Scientific Research (C)
|
Allocation Type | Single-year Grants |
Section | 一般 |
Research Field |
Computer system/Network
|
Research Institution | KYUSHU UNIVERSITY |
Principal Investigator |
AMANO Hirofumi Kyushu University, Computing and Communications Center, Associate Professor, 情報基盤センター, 助教授 (80231992)
|
Co-Investigator(Kenkyū-buntansha) |
NANRI Takeshi Kyushu University, Computing and Communications Center, Associate Professor, 情報基盤センター, 助教授 (70284578)
ITOU Eisuke Kyushu University, Computing and Communications Center, Associate Professor, 情報基盤センター, 助教授 (90294991)
KASAHARA Yoshiaki Kyushu University, Computing and Communications Center, Research Associate, 情報基盤センター, 助手 (60284577)
|
Project Period (FY) |
2003 – 2004
|
Project Status |
Completed (Fiscal Year 2004)
|
Budget Amount *help |
¥3,600,000 (Direct Cost: ¥3,600,000)
Fiscal Year 2004: ¥1,200,000 (Direct Cost: ¥1,200,000)
Fiscal Year 2003: ¥2,400,000 (Direct Cost: ¥2,400,000)
|
Keywords | wide-area distributed metacomputing / remote parallel pipe / grid computing / parallel processing / distributed processing / MPI / OpenMP |
Research Abstract |
In wide-area distributed metacomputing by virtually integrated multiple computing resources on WAN, sufficient performance cannot be achieved through conventional LAN-oriented parallel processing methods based on the data-parallel approach. Therefore, this project focused on remote parallel pipe mechanism which performs high-speed parallel data transfer from one parallel program to another parallel program on a remote site like a pipeline, to alleviate the negative effect of the communication latency. In 2003,a prototype system successfully achieved parallel data transfer between multiple MPI programs running on distinct parallel machines. Since this mechanism is not incorporated in the standard MPI functions, it is an original contribution of this project. Network striping technique was also adopted in the prototype to fully exploit the communication band width between parallel computers, and its effectiveness was verified through experiments. In 2004,this prototype was upgraded to an integrated function library which can be used on generic PC clusters. In a typical PC cluster, external communication link is limited to only one node to save the number of global IP addresses assigned, and the parallel pipe approach faces a difficulty in data scattering/gathering and network striping control. The completed library can hide this complicated work from the programmer's view. Other research results are related to IPv6 technology to utilize other nodes having no external link, and authentication mechanism to achieve safe wide-area distributed metacomputing.
|
Report
(3 results)
Research Products
(32 results)