• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Utilizing distributed parallel computation for computer intensive statistical analysis within a heterogeneous computer environment

Research Project

Project/Area Number 15500189
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field Statistical science
Research InstitutionOita University

Principal Investigator

OCHI Yoshimichi  Oita University, Faculty of Engineering, Professor, 工学部, 教授 (60185618)

Co-Investigator(Kenkyū-buntansha) OBATA Tsuneshi  Oita University, Faculty of Engineering, Assistant Professor, 工学部, 助手 (00244153)
Project Period (FY) 2003 – 2004
Project Status Completed (Fiscal Year 2004)
Budget Amount *help
¥2,600,000 (Direct Cost: ¥2,600,000)
Fiscal Year 2004: ¥900,000 (Direct Cost: ¥900,000)
Fiscal Year 2003: ¥1,700,000 (Direct Cost: ¥1,700,000)
Keywordsdistributed parallel computing / MPI / PVM / task management / computer intensive statistical analysis
Research Abstract

We adopted a form of implementations of Beowulf. type PC cluster for the distributed parallel computation environment and studied the actual implementations and pros and cons of the use of such implementation. In order to install such system, we reorganized the network system and computer resource in our laboratories and established the distributed parallel computation environment with PVM and MPI(here we used "lam" as an actual implementation) with those computers.
We developed a task management method "Time Prediction Model", which control tasks with their expected run time as a manager-worker model and the method was compared with "Work Pool Methods", in order to control tasks within our heterogeneous computing resource. Based on the results given here, we also considered a fundamental design of an integrated application development environment for the distributed parallel environment, which would support computationally intensive statistical investigation, such as Bootstrap and simulation based analyses.
For the algorisms, we first investigated some basic calculation tools, such as matrix multiplications and inversion. Especially for multiplication of larger matrices, several methods, such as column/row wise matrix splitting and Fox algorithm with checker board arrangements are investigated regarding the memory and CPU resource configuration. Furthermore, programs for the bootstrapping and tree based methods were reviewed and their plausibility for the parallel processing, granularity issues and coherency for the task management methods were investigated.
Based on these considerations, we installed a distributed parallel processing simulation platform within the heterogeneous computer resources and confirmed its efficiency for use of computer intensive analysis for real data analysis and their performance evaluation, via analyses of multinomial categorical data with over-dispersion problem.

Report

(3 results)
  • 2004 Annual Research Report   Final Research Report Summary
  • 2003 Annual Research Report
  • Research Products

    (12 results)

All 2004 2003 Other

All Journal Article (9 results) Publications (3 results)

  • [Journal Article] 超過・過小変動を含むカテゴリカルデータにおける共変量効果の評価2004

    • Author(s)
      越智義道
    • Journal Title

      計算機統計学 15・2

      Pages: 143-158

    • NAID

      110001235510

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Annual Research Report 2004 Final Research Report Summary
  • [Journal Article] Exploring Effects of Dispersion Structure for Over-dispersed Categorical Data on Regression Analysis Data on Regression Analysis2004

    • Author(s)
      Yoshimichi Ochi
    • Journal Title

      Proceedings of IBC 2004 XXIInd International Biometric Conference

      Pages: 120-120

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Evaluation of covariate effects for over/under-dispersed categorical data2004

    • Author(s)
      Y.Ochi
    • Journal Title

      Bulletin of the Computational Statistics of Japan Vol.15,No.2

      Pages: 143-158

    • NAID

      110001235510

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Exploring effects of dispersion structure for over-dispersed categorical data on regression analysis data on regression analysis2004

    • Author(s)
      Y.Ochi
    • Journal Title

      Proceedings of IBC 2004 XXIInd International Biometric Conference 120

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Exploring Effects of Dispersion Structure for Over-dispersed Categorical Data on Regression Analysis2004

    • Author(s)
      Yoshimichi Ochi
    • Journal Title

      Proceedings of IBC 2004 XXIInd International Biometric Conference

      Pages: 120-120

    • Related Report
      2004 Annual Research Report
  • [Journal Article] 分散計算環境下でのデータ解析における計算機処理能力の調整2003

    • Author(s)
      黒石健太郎, 越智義道
    • Journal Title

      日本計算機統計学会第17回シンポジウム論文集

      Pages: 15-18

    • NAID

      110001238486

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Assessing Covariate Effects for Over-dispersed Categorical Data with Computer Intensive Methods2003

    • Author(s)
      Yoshimichi Ochi
    • Journal Title

      Bulletin of the International Statistical Institute 54th Session Volume LX, Book 2

      Pages: 182-183

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Adjusting computer processing resource imbalance in distributed parallel computing environment for data analysis2003

    • Author(s)
      Kuroishi, K, Y.Ochi
    • Journal Title

      Proceedings of 17^<th> Symposium of the Japanese Society of computational Statistics

      Pages: 15-18

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Assessing covariate effects for over-dispersed categorical data with computer intensive methods2003

    • Author(s)
      Y.Ochi
    • Journal Title

      Bulletin of the International Statistical Institute 54th Session Volume LX, Book 2

      Pages: 182-183

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Publications] 黒石健太郎, 越智義道: "分散計算環境下でのデータ解析における計算機処理能力の調整"日本計算機統計学会第17回シンポジウム論文集. 15-18 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] Yoshimichi Ochi: "Assessing Covariate Effects for Over-dispersed Categorical Data with Computer Intensive Methods"Bulletin of the International Statistical Institute 54th Session. Volume LX, Book 2. 182-183 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 越智義道: "超過・過小変動を含むカテゴリカルデータにおける共変量効果の評価"計算機統計学. 15・2(印刷中). (2004)

    • Related Report
      2003 Annual Research Report

URL: 

Published: 2003-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi