• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

A study of dynamic optimization of data acquisition system using GRID technology

Research Project

Project/Area Number 15540295
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field Particle/Nuclear/Cosmic ray/Astro physics
Research InstitutionHigh Energy Accelerator Research Organization (2004)
The High Energy Accelerator Research Organization (2003)

Principal Investigator

ITOH Ryosuke  KEK, IPNS, Associate Professor, 素粒子原子核研究所, 助教授 (90193531)

Co-Investigator(Kenkyū-buntansha) NAKAO Mikihiko  KEK, IPNS, Associate Professor, 素粒子原子核研究所, 助教授 (80290857)
HIGUCHI Takeo  KEK, IPNS, Research Associate, 素粒子原子核研究所, 助手 (40353370)
SUZUKI Soh  KEK, CRC, Research Associate, 計算科学センター, 助手 (50280508)
Project Period (FY) 2003 – 2004
Project Status Completed (Fiscal Year 2004)
Budget Amount *help
¥3,700,000 (Direct Cost: ¥3,700,000)
Fiscal Year 2004: ¥1,600,000 (Direct Cost: ¥1,600,000)
Fiscal Year 2003: ¥2,100,000 (Direct Cost: ¥2,100,000)
KeywordsHigh energy physics / Data acquisition system / GRID / データー収集システム / Grid / 最適化
Research Abstract

In a conventional data acquisition system, the function and data flow of event builder and trigger processor are fixed, and there are possibilities of wasting resouces or performance bottleneck depending on the accelerator condition. The purpose of this study is to optimize the usage of the processors and the data flow dynamically by a real time monitoring of the processor load and the data flow rate. In the first year, the monitoring mechanism was developed using a test bench system consisting of 25 PC servers connected via a large GbE switch. The mechanism was realized utilizing Network Shared Memory(NSM) used for the Belle experiment and it was succeeded to make it work. The transfer speed between nodes was also measured using a GRID software called MICH-G2 and was confirmed to be more than 60MB/sec.
In the second year, the development of the optimization mechanism of processor utilization and data flow was done. A dynamic change of processing function on a processor was realized by … More modularizing the processing software and replacing them using a dynamic link with the data acquisition framework. Together with a use of large ring buffers and socket connections implemented on each processing node, it was succeeded to change data flow path and/or processing function on a node without interrupting the data acquisition. As the last step, an algorithms to optimize system-wide performance was trying to be developed, however, we have not yet succeeded to develop the mechanism satisfying the real usage in the data acquisition system. A massive switch of the data flow path and processing software is observed to happen at some boundary during a gradual change in the data flow rate, resulting in a waste of resources. Sometimes a short stop of the data acquisition is observed during the switching. Therefore, we need to continue the effort to improve the optimization algorithm with some new technology like the neural-net.
The mechanism developed for the monitoring of data flow and processor load was used for the real time reconstruction farm of the Belle experiment and it was reported at the international conference on Computing in High Energy Physics 04. Less

Report

(3 results)
  • 2004 Annual Research Report   Final Research Report Summary
  • 2003 Annual Research Report
  • Research Products

    (3 results)

All 2004

All Journal Article (3 results)

  • [Journal Article] Experience with Real Time Reconstruction Farm for Belle Experiment2004

    • Author(s)
      R.Itoh et al.
    • Journal Title

      Proceedings of CHEP04 CD-ROM

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Experience with Real Time Reconstruction Farm for the Belle Experiment2004

    • Author(s)
      R.Itoh et al.
    • Journal Title

      Proceedings of CHEP04 (CD-ROM)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Experience with Real Time Reconstruction Farm for Belle Experiment2004

    • Author(s)
      R.Itoh et al.
    • Journal Title

      Proceedings of CHEP04

    • Related Report
      2004 Annual Research Report

URL: 

Published: 2003-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi