• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Research on machine learning system toward prediction of extreme weather

Research Project

Project/Area Number 17H01748
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field High performance computing
Research InstitutionUniversity of Tsukuba

Principal Investigator

Tatebe Osamu  筑波大学, 計算科学研究センター, 教授 (70357432)

Co-Investigator(Kenkyū-buntansha) 日下 博幸  筑波大学, 計算科学研究センター, 教授 (10371478)
日野 英逸  統計数理研究所, モデリング研究系, 准教授 (10580079)
川島 英之  慶應義塾大学, 環境情報学部(藤沢), 准教授 (90407148)
Project Period (FY) 2017-04-01 – 2020-03-31
Project Status Completed (Fiscal Year 2019)
Budget Amount *help
¥18,590,000 (Direct Cost: ¥14,300,000、Indirect Cost: ¥4,290,000)
Fiscal Year 2019: ¥7,930,000 (Direct Cost: ¥6,100,000、Indirect Cost: ¥1,830,000)
Fiscal Year 2018: ¥5,070,000 (Direct Cost: ¥3,900,000、Indirect Cost: ¥1,170,000)
Fiscal Year 2017: ¥5,590,000 (Direct Cost: ¥4,300,000、Indirect Cost: ¥1,290,000)
Keywords分散深層学習 / 極端気象 / 機械学習 / 並列I/O / 並列分散処理 / 気象学 / 並列処理
Outline of Final Research Achievements

Extreme weather like heavy rain, gust of wind and high temperature may damage the human race greatly, however, the prediction requires vast knowledge about the extreme weather. This research aims at developing a machine learning system to efficiently generate the knowledge. This research prepared the weather data to learn the knowledge for sudden heavy rain. It also proposed a prefetching strategy to overcome the poor read performance that causes the poor learning performance. It improves the performance of large-scale distributed deep learning.

Academic Significance and Societal Importance of the Research Achievements

豪雨・突風・高温などの極端気象は人類に甚大な被害をもたらすため、その予測を行うことは人類にとり重要な意味を持っている。その予測のためには、大規模観測データ、シミュレーションデータのデータ解析、機械学習が有効であると考えられている。本研究では、大規模データに対する分散深層学習を行うときに問題となる読込性能のボトルネックの解消を行っており、これにより分散深層学習の効率を上げることが可能となる。本成果は、極端気象の予測だけではなく、あらゆるビッグデータ解析における分散深層学習の効率を上げることとなり、極めて影響範囲が大きい。

Report

(4 results)
  • 2019 Annual Research Report   Final Research Report ( PDF )
  • 2018 Annual Research Report
  • 2017 Annual Research Report
  • Research Products

    (31 results)

All 2020 2019 2018

All Journal Article (21 results) (of which Peer Reviewed: 14 results,  Open Access: 2 results) Presentation (10 results) (of which Int'l Joint Research: 6 results)

  • [Journal Article] Gfarm/BB - Gfarm file system for node-local burst buffer2020

    • Author(s)
      Osamu Tatebe, Shukuko Moriwake, Yoshihiro Oyama
    • Journal Title

      Journal of Computer Science and Technology

      Volume: 35 Issue: 1 Pages: 61-71

    • DOI

      10.1007/s11390-020-9803-z

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Scalable Distributed Metadata Server Based on Nonblocking Transactions2020

    • Author(s)
      Kohei Hiraga, Osamu Tatebe, Hideyuki Kawashima
    • Journal Title

      Journal of Universal Computer Science

      Volume: 26 Pages: 89-106

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Quantitative Assessment of the Contribution of Meteorological Variables to the Prediction of the Number of Heat Stroke Patients for Tokyo2020

    • Author(s)
      Takuto Sato, Hiroyuki Kusaka, Hideitsu Hino
    • Journal Title

      Scientific Online Letters on the Atmosphere (SOLA)

      Volume: -

    • NAID

      130007865612

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Skew-Aware Collective Communication for MapReduce Shuffling2019

    • Author(s)
      Harunobu Daikoku, Hideyuki Kawashima, Osamu Tatebe
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E102.D Issue: 12 Pages: 2389-2399

    • DOI

      10.1587/transinf.2019PAP0019

    • NAID

      130007754478

    • ISSN
      0916-8532, 1745-1361
    • Year and Date
      2019-12-01
    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Journal Article] GHOSTZ PW/GF: Distributed Parallel Homology Search System for Large-scale Metagenomic Analysis2019

    • Author(s)
      Kenta Machida, Osamu Tatebe
    • Journal Title

      Proceedings of the Third IEEE International Workshop on Benchmarking, Performance Tuning and Optimization for Big Data Applications (BPOD 2019)

      Volume: - Pages: 3492-3700

    • DOI

      10.1109/bigdata47090.2019.9006499

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Accelerating Machine Learning I/O by overlapping data staging and mini-batch generations2019

    • Author(s)
      Kazuhiro Serizawa, Osamu Tatebe
    • Journal Title

      Proceedings of the 6th IEEE/ACM International Conference on Big Data Computing, Applications and Technologies

      Volume: - Pages: 31-34

    • DOI

      10.1145/3365109.3368768

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Journal Article] In-situ data analysis system for high resolution meteorological large eddy simulation model2019

    • Author(s)
      Takuto Sato, Osamu Tatebe, Hiroyuki Kusaka
    • Journal Title

      Proceedings of the 6th IEEE/ACM International Conference on Big Data Computing, Applications and Technologies

      Volume: - Pages: 155-158

    • DOI

      10.1145/3365109.3368769

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Integration of TicToc Concurrency Control Protocol with Parallel Write Ahead Logging Protocol2019

    • Author(s)
      Yasuhiro Nakamura, Hideyuki Kawashima, Osamu Tatebe
    • Journal Title

      International Journal of Networking and Computing

      Volume: 9 Issue: 2 Pages: 339-353

    • DOI

      10.15803/ijnc.9.2_339

    • NAID

      130007680128

    • ISSN
      2185-2839, 2185-2847
    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Retrieved Image Refinement by Bootstrap Outlier Test2019

    • Author(s)
      Hayato Watanabe, Hideitsu Hino, Shotaro Akaho, Noboru Murata
    • Journal Title

      Lecture Notes in Computer Science

      Volume: 11678 Pages: 505-517

    • DOI

      10.1007/978-3-030-29888-3_41

    • ISBN
      9783030298876, 9783030298883
    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Active Learning with Interpretable Predictor2019

    • Author(s)
      Yusuke Taguchi, Keisuke Kameyama, Hideitsu Hino
    • Journal Title

      Proceedings of 2019 International Joint Conference on Neural Networks (IJCNN)

      Volume: - Pages: 1-8

    • DOI

      10.1109/ijcnn.2019.8852041

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Journal Article] ノードローカルバーストバッファのためのMPI-IOの設計2019

    • Author(s)
      杉原 航平、建部 修見
    • Journal Title

      研究報告ハイパフォーマンスコンピューティング(HPC)

      Volume: 2019-HPC-168(22) Pages: 1-7

    • Related Report
      2018 Annual Research Report
  • [Journal Article] 深層ニューラルネットワークにおける訓練高速化のための自動最適化2019

    • Author(s)
      芹沢 和洋、建部 修見
    • Journal Title

      研究報告ハイパフォーマンスコンピューティング(HPC)

      Volume: 2019-HPC-168(26) Pages: 1-10

    • Related Report
      2018 Annual Research Report
  • [Journal Article] Integration of Parallel Write Ahead Logging and Cicada Concurrency Control Method2018

    • Author(s)
      Takayuki Tanabe, Hideyuki Kawashima, and Osamu Tatebe
    • Journal Title

      Proceedings of 2nd IEEE International Workshop on Big Data and IoT Security in Smart Computing (BITS)

      Volume: - Pages: 291-296

    • DOI

      10.1109/smartcomp.2018.00018

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed
  • [Journal Article] PPMDS: A Distributed Metadata Server Based on Nonblocking Transactions2018

    • Author(s)
      Kohei Hiraga, Osamu Tatebe, and Hideyuki Kawashima
    • Journal Title

      Proceedings of The Second International Workshop on Data Science Engineering and its Applications

      Volume: - Pages: 202-208

    • DOI

      10.1109/snams.2018.8554478

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Integrating TicToc with Parallel Logging2018

    • Author(s)
      Yasuhiro Nakamura, Hideyuki Kawashima, Osamu Tatebe
    • Journal Title

      Proceedings of the 6th International Workshop on Computer Systems and Architectures

      Volume: - Pages: 105-111

    • DOI

      10.1109/candarw.2018.00028

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Skew-Aware Collective Communication for MapReduce Shuffling2018

    • Author(s)
      Harunobu Daikoku, Hideyuki Kawashima, and Osamu Tatebe
    • Journal Title

      Proceedings of the 6th Workshop on Scalable Cloud Data Management

      Volume: - Pages: 3331-3340

    • DOI

      10.1109/bigdata.2018.8622088

    • NAID

      130007754478

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed
  • [Journal Article] サイエンティフィックビッグデータアプリケーションのためのベンチマークセットの提案2018

    • Author(s)
      岩井 厚樹、建部 修見
    • Journal Title

      研究報告ハイパフォーマンスコンピューティング(HPC)

      Volume: 2018-HPC-165(4) Pages: 1-5

    • Related Report
      2018 Annual Research Report
  • [Journal Article] 高性能計算のための分散オブジェクトストレージのCeph性能評価2018

    • Author(s)
      高橋 宗史、建部 修見
    • Journal Title

      研究報告ハイパフォーマンスコンピューティング(HPC)

      Volume: 2018-HPC-167(15) Pages: 1-8

    • Related Report
      2018 Annual Research Report
  • [Journal Article] コンテナ型仮想化におけるNVMe-oFの性能評価2018

    • Author(s)
      畑中 智之、建部 修見
    • Journal Title

      研究報告ハイパフォーマンスコンピューティング(HPC)

      Volume: 2018-HPC-167(13) Pages: 1-7

    • Related Report
      2018 Annual Research Report
  • [Journal Article] pbdMPIを用いたエントロピー推定プログラムの並列化と性能評価2018

    • Author(s)
      河合祐輔、日野英逸、建部修見
    • Journal Title

      研究報告ハイパフォーマンスコンピューティング(HPC)

      Volume: 2018-HPC-163 Pages: 1-8

    • Related Report
      2017 Annual Research Report
  • [Journal Article] ブートストラップ分布に基づく外れ値検定2018

    • Author(s)
      渡邊隼人、日野英逸、赤穂昭太郎、村田昇
    • Journal Title

      信学技報

      Volume: 117 Pages: 27-33

    • Related Report
      2017 Annual Research Report
  • [Presentation] GHOSTZ PW/GF: Distributed Parallel Homology Search System for Large-scale Metagenomic Analysis2019

    • Author(s)
      Kenta Machida, Osamu Tatebe
    • Organizer
      the Third IEEE International Workshop on Benchmarking, Performance Tuning and Optimization for Big Data Applications (BPOD 2019)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Accelerating Machine Learning I/O by overlapping data staging and mini-batch generations2019

    • Author(s)
      Kazuhiro Serizawa, Osamu Tatebe
    • Organizer
      the 6th IEEE/ACM International Conference on Big Data Computing, Applications and Technologies
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] In-situ data analysis system for high resolution meteorological large eddy simulation model2019

    • Author(s)
      Takuto Sato, Osamu Tatebe, Hiroyuki Kusaka
    • Organizer
      the 6th IEEE/ACM International Conference on Big Data Computing, Applications and Technologies
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Retrieved Image Refinement by Bootstrap Outlier Test2019

    • Author(s)
      Hayato Watanabe, Hideitsu Hino, Shotaro Akaho, Noboru Murata
    • Organizer
      International Conference on Computer Analysis of Images and Patterns (CAIP2019)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Active Learning with Interpretable Predictor2019

    • Author(s)
      Yusuke Taguchi, Keisuke Kameyama, Hideitsu Hino
    • Organizer
      2019 International Joint Conference on Neural Networks (IJCNN)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Gfarm/BB - Gfarm file system for burst buffers2019

    • Author(s)
      Osamu Tatebe
    • Organizer
      CCS-LBNL Workshop
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 熱中症患者搬送者数予測モデルのための温熱要素の調査2018

    • Author(s)
      佐藤拓人, 日下博幸, 日野英逸
    • Organizer
      第57回日本生気象学会大会
    • Related Report
      2018 Annual Research Report
  • [Presentation] 熱中症患者搬送者数予測に資する温熱要素の同定2018

    • Author(s)
      佐藤拓人, 日下博幸, 日野英逸
    • Organizer
      日本ヒートアイランド学会 第13回全国大会
    • Related Report
      2018 Annual Research Report
  • [Presentation] pbdMPIを用いたエントロピー推定プログラムの並列化と性能評価2018

    • Author(s)
      河合祐輔、日野英逸、建部修見
    • Organizer
      第163回ハイパフォーマンスコンピューティング研究会
    • Related Report
      2017 Annual Research Report
  • [Presentation] ブートストラップ分布に基づく外れ値検定2018

    • Author(s)
      渡邊隼人、日野英逸、赤穂昭太郎、村田昇
    • Organizer
      情報論的学習理論研究会
    • Related Report
      2017 Annual Research Report

URL: 

Published: 2017-04-28   Modified: 2021-02-19  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi