• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Anatomy of benchmarks

Research Project

Project/Area Number 16K12406
Research Category

Grant-in-Aid for Challenging Exploratory Research

Allocation TypeMulti-year Fund
Research Field Computer system
Research InstitutionTokyo Institute of Technology

Principal Investigator

Shudo Kazuyuki  東京工業大学, 情報理工学院, 准教授 (90308271)

Project Period (FY) 2016-04-01 – 2019-03-31
Project Status Completed (Fiscal Year 2018)
Budget Amount *help
¥3,380,000 (Direct Cost: ¥2,600,000、Indirect Cost: ¥780,000)
Fiscal Year 2017: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Fiscal Year 2016: ¥1,820,000 (Direct Cost: ¥1,400,000、Indirect Cost: ¥420,000)
Keywordsベンチマーク / 回帰分析 / 性能モデリング / 確証的因子分析 / 性能評価
Outline of Final Research Achievements

Benchmarking is an indispensable method to evaluate how much computer systems are suitable to our purpose by measuring and comparing them. We proposed a statistical technique to reveal relationships between application benchmarks and performance of system components. Storage systems were also our targets in addition to CPUs, that was planned at the beginning. Our technique enabled us to investigate which basic operations, such as add and memory access, contribute to the benchmarking results and how much they contribute. It is also enabled to estimate how a storage system performs well with emerging storage devices such as Storage Class Memories.

Academic Significance and Societal Importance of the Research Achievements

アプリケーションやアプリケーションを模したベンチマークの性能評価結果が一体何を表しているのかを調べられるようになった。また、ベンチマークスコアを吊り上げるチートと呼ばれる不正行為を検出できる可能性がある。

Report

(4 results)
  • 2018 Annual Research Report   Final Research Report ( PDF )
  • 2017 Research-status Report
  • 2016 Research-status Report
  • Research Products

    (2 results)

All 2018 2016

All Presentation (2 results) (of which Int'l Joint Research: 1 results)

  • [Presentation] 回帰分析を用いたストレージシステムのベンチマーク結果推定2018

    • Author(s)
      曽我樹大, 大西真晶, 首藤一幸
    • Organizer
      第10回データ工学と情報マネジメントに関するフォーラム (DEIM2018)
    • Related Report
      2017 Research-status Report
  • [Presentation] Breakdown of a Benchmark Score Without Internal Analysis of Benchmarking Program2016

    • Author(s)
      Naoki Matagawa, Kazuyuki Shudo
    • Organizer
      arXiv:1610.06307
    • Place of Presentation
      n/a
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research

URL: 

Published: 2016-04-21   Modified: 2020-03-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi