• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to project page

2001 Fiscal Year Final Research Report Summary

Wide-Area Grid Cluster for Parallel Optimization

Research Project

Project/Area Number 12480068
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field 計算機科学
Research InstitutionTokyo Institute of Technology

Principal Investigator

MATSUOKA Satoshi  Global Scientific Information and Computing Center, Tokyo Institute of Technology, Professor, 学術国際情報センター, 教授 (20221583)

Co-Investigator(Kenkyū-buntansha) AIDA Kento  Inter Disciplinary Graduate School of Science and Engineering, Tokyo Institute of Technology, Lecture, 大学院・情報理工学研究科, 講師 (80247212)
DAI You  Graduate School of Science, Dept. of Information Science, Dept. of Mathematical and Computer Sciences, Tokyo Institute of Technology, Lecture, 大学院・情報理工学研究科, 講師 (40244678)
KOJIMA Masakazu  Graduate School of Science, Dept. of Information Science, Dept. of Mathematical and Computer Sciences, Tokyo Institute of Technology, Professor, 大学院・情報理工学研究科, 教授 (90092551)
OGAWA Hirotaka  Graduate School of Science, Dept. of Information Science, Dept. of Mathematical and Computer Sciences, Tokyo Institute of Technology, Assistant, 大学院・情報理工学研究科, 助手 (90302968)
FUJISAWA Katsuki  Kyoto University, Graduate School of Engineering, Department of Architecture and Architectural Systems, Assistant, 大学院・工学研究科, 助手 (40303854)
Project Period (FY) 2000 – 2001
KeywordsGrid / Wide -Area / High -Performance / Ninf / Cluster Numerical Optimization / Semi-Definite Programming / SDP / Non-Convex Quadratic Optimization / SCRM
Research Abstract

We employ the so-called Grid technology to construct a fleet of compute nodes as an aggregation of computing cluster nodes over a wide-area network, and using such "federation of cluster resources" attempt to tackle non-convex quadratic optimization problems of unprecedented scale, and made it accessible from throughout the Internet. More specifically, we developed an algorithm called SCRM (Successive Convex Relaxation Method) which is heavily based on using large numbers of SDP (Semidefinite Programming, SDP) subsolvers, which itself is called SDPA and is a very fast SDP solver using the Interior Point Methods. By efficiently spreading out the SDP solvers over the Grid we showed that we can solve non-convex quadratic problems of very large scale very efficiently, achieving almost linear speedup. For this purpose, we have constructed a fleet of PC clusters spread out throughout several locations, including Titech Oo-okayama Campus, Titech Suzukake-dai Campus, and Kyoto University. We h … More ave been able to achieve nearly 100-fold speedup using 128 processors. The key issue was not only the algorithm but efficient programming using the Ninf GridRPC system, which had to be modified extensively as well as new programming methodologies had to be 4eyeloped in order to cope with massive parallel execution of hundreds of tasks over the Grid.
More specifically, we parallelized SDPA with OpenMP using worksharing methodology to achieve nearly perfect parallel speedup for each cluster on the Grid. Also, we automated the process of selecting the best solver based on the data structure of the problem as well as the "shape" of the non-zero elements in the problem matrix. Then using the 256 nodes worth of clusters spread out over the -country, and using the Ninf GridRPC middleware, we constructed a "optimization solver server", achieving good speedup as mentioned above. The result not only set several world records for benchmark problems but also lead to even larger Grid research in the coming years. Less

  • Research Products

    (40 results)

All Other

All Publications (40 results)

  • [Publications] S.Kim, M.Kojima: "Second Order Cone Programming Relaxation of Nonconvex Quadratic Optimization Problems"Optimization Methods and Software. 26・3. 201-244 (2001)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] M.Fukuda, M.Kojima, K.Murota, K.Nakata: "Exploiting Sparsity in Semidefinite Programming via Matrix Completion 1: General Framework"SIAM Journal on Optimization. 11・3. 647-674 (2002)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] 中田 秀基, 田中 良夫, 松岡 聡, 関口 智嗣: "Grid RPCシステムAPIの提案"情報処理学会ハイパフォーマンスコンピューティング研究. Vol.2001,No.78. (2001)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] 白砂 哲, 中田 秀基, 松岡 聡: "Ninfシステムにおけるフォールトトレランス"情報処理学会ハイパフォーマンスコンピューティング研究会. Vol.2001,No.77. 153-158 (2001)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] K.Fujisawa, M.Fukuda, M.Kojima, K.Nakata: "Numerical Evaluation of the SDPA (SemiDefinite Programming Algorithm)"The High Performance Optimization. 235-253 (1999)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] M.Nakata, H.Nakatsuji, M.Ehara, M.Fukuda, K.Nakata, K.Fujisawa: "Variational calculations of fermion secondorder reduced density matrices by semidefinite programming algorithm"Journal of Chemical Physics. Vol.144,Issue19. 8282-8292 (2001)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] A.Takefusa, S.Matsuoka, H.Casanova, F.Berman: "A Study of Deadline Scheduling for Client-Server Systems on the Computational Grid"10th IEEE International Symposium on High Performance Distributed Computing (HPDC10). 405-416 (2001)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] 秋山 智宏, 中田 秀基, 松岡 聡: "Grid環境におけるモニタリング手法の評価"情報処理学会研究報告(SwoPP2001沖縄). 2001・HPC・87. 159-164 (2001)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] 竹房あつ子, 松岡聡: "Grid計算環境におけるデッドラインスケジューリング手法の性能"情報処理学会 電気通信処理学会 並列シンポジウム JSPP2001 論文集. 263-270 (2001)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] 鈴村 豊太郎, 松岡 聡, 中田 秀基: "高性能広域計算基盤Gridへのポータルシステムの設計と実装"情報処理学会ハイパフォーマンスニンピューティング研究会. Vol.2001,No.77. 171-177 (2001)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Toyotaro Suzumura, Satoshi Matsuoka, Hidemoto Nakada: "A Jini-based Computing Portal System"Proceedings of IEEE/ACM Supercomputing 2001, IEEE Computer Society. (2001)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] 中田 秀基, 田中 良夫, 松岡 聡, 関口 智嗣: "Network Enabled Server の World-wide Grid における性能"情報処理学会論文誌 ハイパフォーマンスコンピューティング研究会. Vol.42,No.77. 153-158 (2001)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] 田中 良夫, 中田 秀基, 平野 基孝, 佐藤 三久, 関口 智嗣: "GlobusによるGrid RPCシステムの実装と評価"情報処理学会ハイパフォーマンスコンピューティング研究会. Vol.2001,No.77. 171-177 (2001)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] M.Sato, Y.Tanaka, M.Hirano, S.Sekiguchi: "OmniRPC : a Grid RPC facility for Cluster and Global Computing in OpenMP"Proc. of WOMPAT. (2001)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Y.Kanno, M.Ohsaki, K.Fujisawa, N.Katoh: "Topology Optimization of Trusses for Specified Multiple Linear Buckling Load Factors by using Semidefinite Programming"Journa of Archtecture, Struct. Constr. Eng.. No.541. 113-119 (2001)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] M.Nakata, K.Fujisawa, M.Fukuda, M.Kojima, K.Murota: "Variational calculations of fermion seconclorder reduced density matrices by semidefinite programming algorithm"Journal of Chemical Physics. Vol.114,Issue19. 8282-8292 (2001)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] K.Fujisawa: "SDPA (Semidefinite Programining Algorithm)"Systems, Control and Information. Vol.44 No.2. 125-131 (2000)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] K.Fujisawa: "SDPA (Semidefinite Programming Algorithm)"Communications of the Operations Research Society of Japan. Vol.45 No.3. 125-131 (2000)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] K.Nakata, K.Fujisawa, M.Fukuda, M.Kojima, K.Murota: "Matrix Completion and Semiclefinite Programming"The Institute of Statical Mathematics Cooporative Research Report. Vol.135. 223-237 (2000)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] K.Fujisawa, A.Takeda, M.Kojima, K.Nakata: "The SDPA (SemiDefinite Programming Algorithm) on the Ninf ( Network based Information Library for the Global Computing)"The Institute of Statical Mathematics Cooporative Research Report. Vol.135. 215-222 (2000)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] A.Takeda, K.Fujisawa, Y.Fukaya, M.Kojima: "A parallel Successive Convex Relaxation Algorithm for Quadratic Optimazation Problems"The Institute of Statical Mathematics Cooporative Research Report. Vol.135. 238-258 (2000)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Henri Casanova, Satoshi Matsuoka, Jack Dongarra: "Network-Enabled Server Systems and the Computational Grid"High Performance Computing Symposium (HPC'01), Advanced Simulation Technologies Conference. April. 22-26 (2001)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Satoshi Matsuoka: "Grid RPC meets Data Grid : Network Enabled Services for Data Farming on the Grid"Proceedings of IEEE Symposium on Cluster Computing and the Grid Brisbane. May 2001. 13-15 (2001)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Youhei Morita, Osarnu Tatebe, Satoshi Matsuoka, Noriyuki Soda, Hiroyuki Sato, Yoshio Tanaka, Satoshi Sekiguchi, S.Kawabata, Yoshiyuki Watase, Masatoshi Imori, Tomio Kobayashi: "Grid Data Farm for Atlas Simulation Data Challenges"Proceedings of International Conference on Computing of High Energy and Nuclear Physics. Set.2001. 699-701 (2001)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] 小島政和, 土谷隆, 水野真治, 矢部博: "内点法"朝倉書店. 285 (2001)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] S.Kim, M. Kojima: "Second Order Cone Programming Relaxation of Nonconvex Quadratic Optimization Problems"Optimization Methods and Software. 201-244 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] M. Fukuda, M. Kojima, K. Murota, K. Nakata: "Exploiting Sparsity in Semidefinite Programming via Matrix Completion General Framework"SJAM Journal on Optimization. 647-674 (2002)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] M. Nakata, H. Nakatsuji, M. Ehara, M. Fukuda, K. Nakata, K. Fujisawa: "Variational calculations of fermion secondorder reduced density matrices by semidefinite programming algorithm"Journal of Chemical Physics. 8282-8292 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] A. Takefusa, S. Matsuoka, H. Casanova, F. Berman: "A Study of Deadline Scheduling for Client-Server Systems on the Computational Grid"10^<th> IEEE International Symposium on High Performance Distributed Computing. 405-416 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] T. Suzumura, S. Matsuoka, H, Nakada: "A Jini-based Computing Portal System"Proc. IEEE/AGM Supercomputing. (2001)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] M. Sato, Y. Tanaka, M. Hirano, S. Sekiguthi: "OmniRPC : a Grid RFC facility for Cluster and Global Computing in OpenMP"Proc. WOMPAT. 113-119 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Y. Kanno, M. Ohsaki, K. Fujisawa, N. Katoh: "Topology' Optimization of Trusses for Specific Multiple Linear ' Bucking Load Factors by using Semidefinited Programming"Journal of Architecture Strut Constr. Eng.. 113-119 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] S. Matsuoka: "Are Global Computing Systems Useful? Comparison of Client-Server Global Computing Systems Ninf, NetSolve Versus CORBA"IEEE International Parallel & Distributed Processing Symposium. 547-556 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] S. Matsuoka: "NetCFD : a Ninf CFD Component for Global Computing, and its Java applet GUI"Prpc HPC Asia 2000. 501-506 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] S. Matsuoka: "Design issues of Network Enabled Server Systems for the Grid"Proc. CRID .2000 : International Workshop on Grid Computing. (2000)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] K. Aida: "Performance Evaluation Model for Scheduling in Global Computing Systems"The International Journal of High Performance Computing Applications. 268-279 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] M. Kojima: "Cones of Matrices and Successive Convex Relaxations of Nonconvex sets"SIAM Journal on Optimization. 750-778 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] M. Kojima: "Discretization arid Localization in Successive Convex Relaxation or Nonconvex Quadratic Optimization Problems"Mathematical Programming. 79-111 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] M. Kojima: "Towards Implementations of Successive Convex Relaxation Methods for Nonconvex Quadratic Optimization Problems"Approximation and Complexity in Numerical Optimization : Continuous and Dscrete Problems. 489-510 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] M. Kojima: "A Parallel Successive Convex Relaxation 'Algorithm' for Quadratic Optimization Problems"The Institute of Statistical Mathematics Cooperative Research Report. 238-258 (2000)

    • Description
      「研究成果報告書概要(欧文)」より

URL: 

Published: 2003-09-17  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi