• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Research on construction of high-precision computing environment for massively parallel computers and automatic tuning of computing accuracy

Research Project

Project/Area Number 18K11340
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Review Section Basic Section 60100:Computational science-related
Research InstitutionKogakuin University

Principal Investigator

Tanaka Teruo  工学院大学, 情報学部(情報工学部), 教授 (90622837)

Co-Investigator(Kenkyū-buntansha) 長谷川 秀彦  筑波大学, 図書館情報メディア系(名誉教授), 名誉教授 (20164824)
Project Period (FY) 2018-04-01 – 2024-03-31
Project Status Completed (Fiscal Year 2023)
Budget Amount *help
¥4,420,000 (Direct Cost: ¥3,400,000、Indirect Cost: ¥1,020,000)
Fiscal Year 2021: ¥260,000 (Direct Cost: ¥200,000、Indirect Cost: ¥60,000)
Fiscal Year 2020: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2019: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2018: ¥1,820,000 (Direct Cost: ¥1,400,000、Indirect Cost: ¥420,000)
Keywords高精度計算 / 高性能計算 / 倍々精度演算 / 大規模並列処理 / 自動チューニング / 混合精度計算 / 機械学習 / AVX-512 / 高精度演算
Outline of Final Research Achievements

This is a study of high-precision arithmetic operations required in a large-scale computing environment. (1) Extensions were made to two tools currently under development. The basic arithmetic functions of AVX-512 were added to the double-precision arithmetic library DD-AVX. MPI support was also added to the GMP code generation tool. (2) We analyzed the behavior of high-precision parallel computation algorithms when switching to high-precision computation for problems with poor convergence, such as a large number of conditions. (3) In order to bring out the powerful single-precision computing capability of GPUs, we extended the scope to mixed-precision computation. In particular, we tried to use the method in directive-based descriptions, and the results showed that it can bring out some performance, but the setting parameters are not specified values and need to be optimized.

Academic Significance and Societal Importance of the Research Achievements

より大規模かつ複雑な問題に対処するために高精度演算が重要となる。しかしながら、計算機の専門外の研究者が高精度演算を使いこなすためには、専門知識、あるいは、研究に関係ないコストが必要となる。そのために、前者に対しては、高精度計算の精度に関する調査を行った。また、後者については、倍々精度演算ライブラリDD-AVX、GMP生成ツールXev-GMPの機能拡張を行い、さらに、ディレクティブベース記述でのGPU利用上でのチューニングなどを行ってきた。これらにより、情報学以外の一般工学、社会学などの広い分野の研究者が余分なコストを抑え、高精度演算を利用可能となる道筋になると考えている。

Report

(7 results)
  • 2023 Annual Research Report   Final Research Report ( PDF )
  • 2022 Research-status Report
  • 2021 Research-status Report
  • 2020 Research-status Report
  • 2019 Research-status Report
  • 2018 Research-status Report
  • Research Products

    (33 results)

All 2024 2023 2022 2021 2020 2019 2018

All Journal Article (1 results) Presentation (32 results) (of which Int'l Joint Research: 15 results,  Invited: 1 results)

  • [Journal Article] ソフトウェア自動チューニングにおける反復2次元d-Spline探索法の提案と評価2019

    • Author(s)
      范 谷瑛,関 直人,多部田 敏樹,藤井 昭宏,田中 輝雄
    • Journal Title

      研究報告ハイパフォーマンスコンピューティング(HPC)

      Volume: 2019-HPC-168 Pages: 1-8

    • Related Report
      2018 Research-status Report
  • [Presentation] Acceleration Techniques for Software Auto-Tuning to Hyperparameters on Machine Learning Software2024

    • Author(s)
      Teruo Tanaka
    • Organizer
      2024 Conference on Advanced Topics and Auto Tuning in High-Performance Scientific Computing (ATAT on HPSC)
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] OpenACCを用いた単精度LU 分解のGPU 並列化2024

    • Author(s)
      高山智礼,久木田仁,矢島雄河,藤井昭宏,田中輝雄
    • Organizer
      情報処理学会全国大会
    • Related Report
      2023 Annual Research Report
  • [Presentation] Job level parallel search in software auto-tuning2024

    • Author(s)
      Yuga Yajima, Akihiro Fujii, Teruo Tanaka
    • Organizer
      HPCAsia2024 (Nagoya) Poster Session (2024)
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Fast adjacent communication among with RDMA, MPI-RMA, and Double buffering2024

    • Author(s)
      Kota Yoshimoto, Akihiro Fujii, Teruo Tanaka
    • Organizer
      HPCAsia2024 (Nagoya) Poster Session (2024)
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 機械学習ソフトウェアへのソフトウェア自動チューニングの適用2023

    • Author(s)
      田中輝雄
    • Organizer
      自動チューニング研究会オープンアカデミックセッション (ATOS30)
    • Related Report
      2023 Annual Research Report
  • [Presentation] Parallelization of Automatic Tuning for Hyperparameter Optimization of Pedestrian Route Prediction Applications using Machine Learning2023

    • Author(s)
      Sorataro Fujika, Yuga Yajima, Teruo Tanaka, Akihiro Fujii, Yuka Kato, Satoshi Ohshima, Takahiro Katagiri
    • Organizer
      HPC Asia '23: Proceedings of the International Conference on High Performance Computing in Asia-Pacific Region
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] Applying Automatic Tuning to Hyper-parameter Optimization of Machine Learning Programs for Super-Resolution (Poster)2023

    • Author(s)
      Xuan Yang, Sorataro Fujika, Yuga Yajima, Akihiro Fujii, Teruo Tanaka, Kazutoshi Akita, Norimichi Ukita
    • Organizer
      HPC Asia '23: Proceedings of the International Conference on High Performance Computing in Asia-Pacific Region
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] 複数のGPU向けプログラミングモデルを用いた 倍々精度疎行列ベクトル積の特性分析2023

    • Author(s)
      寺田洋人,慈道亮人,菱沼利彰,藤井昭宏,田中輝雄
    • Organizer
      第85回情報処理学会全国大会
    • Related Report
      2022 Research-status Report
  • [Presentation] 倍々精度SpMVにおけるSIMD利用時のデータレイアウトによる性能分析2023

    • Author(s)
      慈道亮人,寺田洋人,菱沼利彰,藤井昭宏,田中輝雄
    • Organizer
      第85回情報処理学会全国大会
    • Related Report
      2022 Research-status Report
  • [Presentation] FX1000におけるダブルバッファリングとRDMAを用いた隣接通信の性能評価2022

    • Author(s)
      吉本 航太、藤井 昭宏、田中 輝雄
    • Organizer
      第26回 計算工学講演会
    • Related Report
      2022 Research-status Report
  • [Presentation] 倍々精度演算におけるSIMD命令利用時のデータレイアウトによる性能差分析2022

    • Author(s)
      福永晋司,山浦朴人,菱沼利彰,藤井昭宏,田中輝雄
    • Organizer
      情報処理学会第84回全国大会
    • Related Report
      2021 Research-status Report
  • [Presentation] ディレクティブベースのGPUプログラミングモデルを用いた倍々精度演算の性能評価2022

    • Author(s)
      山浦朴人,福永晋司,菱沼利彰,藤井昭宏,田中輝雄
    • Organizer
      情報処理学会第84回全国大会
    • Related Report
      2021 Research-status Report
  • [Presentation] ソフトウェア自動チューニングツール DSICE の構築2022

    • Author(s)
      森戸建太郎,矢島雄河,藤家空太郎,楊  暄,藤井昭宏,田中輝雄
    • Organizer
      情報処理学会第84回全国大会
    • Related Report
      2021 Research-status Report
  • [Presentation] ソフトウェア自動チューニングにおける反復1次元d-spline探索法の複数か所同時適用2022

    • Author(s)
      矢島雄河,森戸建太郎,藤家空太郎,楊  暄,藤井昭宏,田中輝雄
    • Organizer
      情報処理学会第84回全国大会
    • Related Report
      2021 Research-status Report
  • [Presentation] RDMA with Double Buffering for Adjacent Communication2022

    • Author(s)
      Kota Yoshimoto, Akihiro Fujii, Teruo Tanaka
    • Organizer
      The International Conference on High Performance Computing in Asia-Pacific Region (HPC Asia 2022), poster
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Parallelization of Automatic Tuning by Executing Machine Learning Programs in Multiple Jobs2022

    • Author(s)
      Sorataro Fujika, Teruo Tanaka, Akihiro Fujii , Yuka Kato, Satoshi Ohshima, Takahiro Katagiri
    • Organizer
      The International Conference on High Performance Computing in Asia-Pacific Region (HPC Asia 2022), poster
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Fast Adjacent Communication with RDMA and Double Buffering2021

    • Author(s)
      Kota Yoshimoto, Akihiro Fujii, Teruo Tanaka
    • Organizer
      The 20th International Symposium on Advanced Technology (ISAT-20), Lightning Talk session
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Parallelization of Automatic Tuning using Multiple Jobs for Machine Learning Programs2021

    • Author(s)
      Sorataro Fujika, Teruo Tanaka, Akihiro Fujii , Yuka Kato, Satoshi Ohshima, Takahiro Katagiri
    • Organizer
      The 20th International Symposium on Advanced Technology (ISAT-20), Lightning Talk session
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] GPUクラスタを用いて並列化した自動チューニングの機械学習プログラムへの適用と安定性の検証2021

    • Author(s)
      藤家空太郎,多部田敏樹,藤井昭宏,田中輝雄,加藤由花,大島聡史,片桐孝洋
    • Organizer
      情報処理学会,HPC研究会論文集,Vol.2020-HPC-178
    • Related Report
      2020 Research-status Report
  • [Presentation] マルチGPU環境における機械学習ハイパーパラメータの自動チューニング(1)2021

    • Author(s)
      多部田敏樹,藤家空太郎,藤井昭宏,田中輝雄,加藤由花,大島聡史,片桐孝洋
    • Organizer
      情報処理学会第83回全国大会
    • Related Report
      2020 Research-status Report
  • [Presentation] マルチGPU環境における機械学習ハイパーパラメータの自動チューニング(2)2021

    • Author(s)
      藤家空太郎,多部田敏樹,藤井昭宏,田中輝雄,加藤由花,大島聡史,片桐孝洋
    • Organizer
      情報処理学会第83回全国大会
    • Related Report
      2020 Research-status Report
  • [Presentation] Intel Xeonにプロセッサ上における AVX512を用いた倍々精度演算の性能評価2020

    • Author(s)
      土肥樹, 菱沼利彰, 田中輝雄,藤井昭宏
    • Organizer
      応用数学学会年会
    • Related Report
      2020 Research-status Report
  • [Presentation] 複数のパラメータを同時に推定する手法の実装と機械学習ソフトウェアへの適用2020

    • Author(s)
      多部田敏樹, 藤井昭宏, 田中輝雄, 滝沢寛之
    • Organizer
      計算工学講演会論文集, Vol.25
    • Related Report
      2020 Research-status Report
  • [Presentation] An Optimization Technology of Software Auto-Tuning Applied to Machine Learning Software2020

    • Author(s)
      Toshiki Tabeta, Naoto Seki, Akihiro Fujii, Teruo Tanaka, Hiroyuki Takizawa
    • Organizer
      International Conference Series on HPC Technologies in Asia Pacific Region(HPC Asia 2020)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Stable Automatic Tuning Method for Performance Fluctuation2020

    • Author(s)
      Naoto Seki, Toshiki Tabeta, Akihiro Fujii, Teruo Tanaka
    • Organizer
      New Approaches for Software Auto-Tuning and Accuracy Assurance, Part II of II, The SIAM Conference on Parallel Processing for Scientific Computing,(PP2020)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Approach and Application for Performance Parameter Search on AT2019

    • Author(s)
      Naoto Seki, Toshiki Tabeta, Akihiro Fujii, Teruo Tanaka
    • Organizer
      ITBL Booth Poster, Super Computing 19(SC19)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] 性能パラメータ推定における評価対象プログラムの実行時間の揺らぎに対応した自動チューニング手法の提案2019

    • Author(s)
      関直人, 范谷瑛, 多部田敏樹, 藤井昭宏, 田中輝雄
    • Organizer
      情報処理学会,HPC研究会,Vol.2019-HPC-169, No.9, pp.1-8 (2019.5)
    • Related Report
      2019 Research-status Report
  • [Presentation] Enhancement of Performance Parameter Search Method for Multiple Parameter Estimation2019

    • Author(s)
      Teruo Tanaka, Fan Guuing, Akihiro Fujii, Takahiro Katagiri
    • Organizer
      2019 Conference on Advanced Topics and Auto Tuning in High-Performance Scientific Computing (ATAT in HPSC 2019)
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] ソフトウェア自動チューニングにおける複数性能パラメータを同時推定する手法の効率化2019

    • Author(s)
      多部田敏樹,田中輝雄, 藤井昭宏,関 直人,范 谷瑛
    • Organizer
      第81回情報処理学会全国大会
    • Related Report
      2018 Research-status Report
  • [Presentation] 共役勾配法におけるダブルバッファリング利用したRDMA通信の性能評価2019

    • Author(s)
      出蔵英真,藤井昭宏,田中輝雄
    • Organizer
      第81回情報処理学会全国大会
    • Related Report
      2018 Research-status Report
  • [Presentation] Strategy of Precision Switching for Mixed Precision Iterative Method2018

    • Author(s)
      Masaki Suwa, Akihiro Fujii, Teruo Tanaka, Hidehiko Hasegawa
    • Organizer
      10th International Workshop on Parallel Matrix Algorithms and Applications (PMAA 18)
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Two Approaches for Performance Parameter Search on AT in the simulation of the one-dimensional motion of mass points2018

    • Author(s)
      Naoto Seki , Guuing Fan, Akihiro Fujii, Teruo Tanaka
    • Organizer
      Super Computing 2018(SC18), ITBL booth, Poster
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research

URL: 

Published: 2018-04-23   Modified: 2025-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi