• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Programming Model for Non-Volatile Memory toward Extreme Computing

Research Project

Project/Area Number 26540050
Research Category

Grant-in-Aid for Challenging Exploratory Research

Allocation TypeMulti-year Fund
Research Field High performance computing
Research InstitutionNational Institute of Advanced Industrial Science and Technology (2017)
Tokyo Institute of Technology (2014-2016)

Principal Investigator

Sato Hitoshi  国立研究開発法人産業技術総合研究所, 情報・人間工学領域, 主任研究員 (00550633)

Project Period (FY) 2014-04-01 – 2018-03-31
Project Status Completed (Fiscal Year 2017)
Budget Amount *help
¥3,510,000 (Direct Cost: ¥2,700,000、Indirect Cost: ¥810,000)
Fiscal Year 2016: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2015: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2014: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Keywords不揮発性メモリ / GPGPU / 高性能計算 / ビッグデータ
Outline of Final Research Achievements

Emerging NVM (Non-Volitle Memory) devices such as Flash, which have positive aspects of inexpensive cost, high-energy-efficiency, and huge capacity compared with conventional DRAM devices, as well, as negative aspects of low throughput and latency, are widely employed to existing supercomputers and clouds. However, efficient implementation techniques and its productivity to overcome deepening memory hierarchy are open problems, although these NVMs will greatly expand the possibility of processing extremely large-scale datasets that exceed the DRAM capacity of the nodes. In order to address the issues, we investigated the programming model for NVM toward extreme data-intensive computing. Based on our GPU-based MapReduce implementation, we enhanced out-of-core features of the implementation, including various Big Data Kernels such as Sort, PrefixSum, Unique, SetIntersection, and demonstrated efficient performance to datasets that exceed the DRAM capacity of the nodes.

Report

(5 results)
  • 2017 Annual Research Report   Final Research Report ( PDF )
  • 2016 Research-status Report
  • 2015 Research-status Report
  • 2014 Research-status Report
  • Research Products

    (31 results)

All 2018 2017 2016 2015 2014

All Journal Article (10 results) (of which Peer Reviewed: 7 results,  Acknowledgement Compliant: 2 results,  Open Access: 2 results) Presentation (21 results) (of which Int'l Joint Research: 3 results)

  • [Journal Article] AIクラウドでのLinuxコンテナ利用に向けた性能評価2018

    • Author(s)
      佐藤仁,小川宏高
    • Journal Title

      情報処理学会 研究報告ハイパフォーマンスコンピューティング(HPC)

      Volume: 2017-HPC-162 Pages: 1-8

    • Related Report
      2017 Annual Research Report
  • [Journal Article] 不揮発性メモリ3D XPointのAI/ビッグデータ処理への適用に向けた初期評価2018

    • Author(s)
      佐藤仁,溝手竜,小川宏高
    • Journal Title

      情報処理学会 研究報告ハイパフォーマンスコンピューティング(HPC)

      Volume: 2018-HPC-163 Pages: 1-8

    • Related Report
      2017 Annual Research Report
  • [Journal Article] I/O Chunking and Latency Hiding Approach for Out-of-Core Sorting Acceleration Using GPU and Flash NVM2016

    • Author(s)
      Hitoshi Sato, Ryo Mizote, Satoshi Matsuoka, Hirotaka Ogawa
    • Journal Title

      2016 IEEE International Conference on Big Data

      Volume: - Pages: 398-403

    • DOI

      10.1109/bigdata.2016.7840629

    • Related Report
      2016 Research-status Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] GPU-Accelerated Large-scale Distributed Sorting Coping with Device Memory Capacity2016

    • Author(s)
      Hideyuki Shamoto, Koichi Shirahata, Aleksandr Drozd, Hitoshi Sato, Satoshi Matsuoka
    • Journal Title

      IEEE Transactions on Big Data

      Volume: PP Issue: 1 Pages: 1-13

    • DOI

      10.1109/tbdata.2015.2511001

    • Related Report
      2015 Research-status Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Advanced Computing and Optimization Infrastructure for Extremely Large-Scale Graphs on Post Peta-Scale Supercomputers2016

    • Author(s)
      Katsuki Fujisawa , Toyotaro Suzumura, Hitoshi Sato, Koji Ueno, Yuichiro Yasui, Keita Iwabuchi, Toshio Endo
    • Journal Title

      Optimization in the Real World, Toward Solving Real-World Optimization Problems

      Volume: 13 Pages: 1-13

    • DOI

      10.1007/978-981-13-1924-2_11

    • ISBN
      9789811319235, 9789811319242
    • Related Report
      2015 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] NVM-based Hybrid BFS with memory efficient data structure2014

    • Author(s)
      Keita Iwabuchi, Hitoshi Sato, Yuichiro Yasui, Katsuki Fujisawa, Satoshi Matsuoka
    • Journal Title

      The IEEE International Conference on Big Data 2014 (IEEE BigData 2014)

      Volume: - Pages: 529-538

    • DOI

      10.1109/bigdata.2014.7004270

    • Related Report
      2014 Research-status Report
    • Peer Reviewed
  • [Journal Article] Large-scale Distributed Sorting for GPU-based Heterogeneous Supercomputers2014

    • Author(s)
      Hideyuki Shamoto, Koichi Shirahata, Aleksandr Drozd, Hitoshi Sato, Satoshi Matsuoka
    • Journal Title

      2014 IEEE International Conference on BigData

      Volume: - Pages: 510-518

    • DOI

      10.1109/bigdata.2014.7004268

    • Related Report
      2014 Research-status Report
    • Peer Reviewed
  • [Journal Article] Out-of-core GPU Memory Management for MapReduce-based Large-scale Graph Processing2014

    • Author(s)
      Koichi Shirahata, Hitoshi Sato, Satoshi Matsuoka
    • Journal Title

      2014 IEEE International Conference on Cluster Computing

      Volume: - Pages: 221-229

    • DOI

      10.1109/cluster.2014.6968748

    • Related Report
      2014 Research-status Report
    • Peer Reviewed
  • [Journal Article] Hybrid BFS Approach Using Semi-External Memory2014

    • Author(s)
      Keita Iwabuchi, Hitoshi Sato, Ryo Mizote, Yuichiro Yasui, Katsuki Fujisawa, Satoshi Matsuoka
    • Journal Title

      The 3rd High Performance Data Intensive Computing Workshop (HPDIC2014 ) in conjunction with IEEE International Conference on Parallel and Distributed Processing Symposium 2014 (IPDPS2014)

      Volume: - Pages: 1698-1707

    • DOI

      10.1109/ipdpsw.2014.189

    • Related Report
      2014 Research-status Report
    • Peer Reviewed
  • [Journal Article] 将来のスーパーコンピュータにおけるエクストリームなビッグデータ処理にむけたTSUBAME2での取り組み2014

    • Author(s)
      佐藤仁, 上野晃司, 白幡晃一, 社本秀之, 松岡聡
    • Journal Title

      TSUBAME e-Science Journal

      Volume: 12 Pages: 2-7

    • NAID

      40020224484

    • Related Report
      2014 Research-status Report
    • Open Access
  • [Presentation] Building Software Ecosystems for AI Cloud using Singularity HPC Container2018

    • Author(s)
      Hitoshi Sato
    • Organizer
      5th ADAC Workshop
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 分散深層学習とIO2018

    • Author(s)
      佐藤仁
    • Organizer
      Gfarm Workshop 2018
    • Related Report
      2017 Annual Research Report
  • [Presentation] Building Software Ecosystems for AI Cloud2017

    • Author(s)
      Hitoshi Sato, Hirotaka Ogawa, Satoshi Matsuoka
    • Organizer
      xSIG2017
    • Related Report
      2017 Annual Research Report
  • [Presentation] 学際大規模情報基盤共同利用・共同研究拠点第9回シンポジウム2017

    • Author(s)
      佐藤仁
    • Organizer
      将来の大規模メニーコアプロセッサ環境に向けたビッグデータ基盤処理の性能評価
    • Related Report
      2017 Annual Research Report
  • [Presentation] AI クラウドのソフトウェア エコシステム構築に向けた産総研の取り組み2017

    • Author(s)
      佐藤仁
    • Organizer
      GTC Japan 2017
    • Related Report
      2017 Annual Research Report
  • [Presentation] I/O分割による遅延隠蔽を用いたOut-of-coreなGPU Set Intersectionの性能評価2016

    • Author(s)
      佐藤仁,溝手竜,松岡聡,小川宏高
    • Organizer
      情報処理学会 第155回ハイパフォーマンス・コンピューティング
    • Place of Presentation
      長野県松本市
    • Year and Date
      2016-08-08
    • Related Report
      2016 Research-status Report
  • [Presentation] 大規模グラフ処理ライブラリScaleGraphのout-of-coreメモリ拡張2016

    • Author(s)
      岩渕圭太,佐藤仁,松岡聡
    • Organizer
      2016年ハイパフォーマンスコンピューティングと計算科学シンポジウム(HPCS) ポスター
    • Place of Presentation
      宮城県仙台市
    • Year and Date
      2016-06-06
    • Related Report
      2016 Research-status Report
  • [Presentation] GPUアクセラレータと不揮発性メモリを考慮した大規模分散ソート2016

    • Author(s)
      社本秀之,佐藤仁,松岡 聡
    • Organizer
      情報処理学会 第154回ハイパフォーマンスコンピューティング研究発表会
    • Place of Presentation
      横浜
    • Year and Date
      2016-04-25
    • Related Report
      2015 Research-status Report
  • [Presentation] GPUアクセラレータと不揮発性メモリを考慮した大規模分散ソート2016

    • Author(s)
      社本秀之,佐藤仁,松岡聡
    • Organizer
      情報処理学会 第154回ハイパフォーマンス・コンピューティング研究発表会
    • Place of Presentation
      神奈川県横浜市
    • Related Report
      2016 Research-status Report
  • [Presentation] Out-of-core Sorting Acceleration using GPU and Flash NVM2015

    • Author(s)
      Hitoshi Sato, Ryo Mizote, Satoshi Matsuoka
    • Organizer
      The International Conference for High Performance Computing, Networking, Storage, and Analysis (SC15)
    • Place of Presentation
      Austin, USA
    • Year and Date
      2015-11-15
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] Out-of-core Sorting Acceleration using GPU and Flash NVM2015

    • Author(s)
      Hitoshi Sato, Ryo Mizote, Satoshi Matsuoka
    • Organizer
      GTC Japan 2015
    • Place of Presentation
      東京
    • Year and Date
      2015-09-18
    • Related Report
      2015 Research-status Report
  • [Presentation] クラウドバーストバッファによるクラウド・スパコン間連携2015

    • Author(s)
      佐藤仁
    • Organizer
      アカデミックインタークラウドシンポジウム2015 Cloud Week 2015@Hokkaido University
    • Place of Presentation
      札幌
    • Year and Date
      2015-09-07
    • Related Report
      2015 Research-status Report
  • [Presentation] GPUアクセラレータと不揮発性メモリを考慮した外部ソート2015

    • Author(s)
      佐藤仁, 溝手竜, 松岡聡
    • Organizer
      情報処理学会 第150回ハイパフォーマンスコンピューティング研究発表会
    • Place of Presentation
      別府
    • Year and Date
      2015-08-04
    • Related Report
      2015 Research-status Report
  • [Presentation] A distributed implementation of Louvain-style community detection heuristics for large-scale social networks2015

    • Author(s)
      Guanglong Chi,Ken Wakita,Hitoshi Sato
    • Organizer
      情報処理学会 第150回ハイパフォーマンスコンピューティング研究発表会
    • Place of Presentation
      別府
    • Year and Date
      2015-08-04
    • Related Report
      2015 Research-status Report
  • [Presentation] Reliability of NVM devices for I/O acceleration on supercomputing systems2015

    • Author(s)
      Hitoshi Sato, Shuichi Ihara and Satoshi Matsuoka
    • Organizer
      Lustre User Group 2015
    • Place of Presentation
      Denver, USA
    • Year and Date
      2015-04-13
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] Big Data Processing on GPU-based supercomputers2015

    • Author(s)
      Hitoshi Sato
    • Organizer
      GPU COE Achievement Award, GPU Technology Conference
    • Place of Presentation
      San Jose
    • Year and Date
      2015-03-17
    • Related Report
      2014 Research-status Report
  • [Presentation] Extreme Big Data (EBD) Next Generation Big Data Infrastructure Technologies Towards Yottabyte/Year2014

    • Author(s)
      Hitoshi Sato
    • Organizer
      2014 ATIP Workshop: Japanese Research Toward Next-Generation Extreme Computing in conjunction with SC14
    • Place of Presentation
      New Orleans
    • Year and Date
      2014-11-17
    • Related Report
      2014 Research-status Report
  • [Presentation] Extreme Big Data: Convergence of Extreme Computing and Big Data Technologies2014

    • Author(s)
      佐藤仁
    • Organizer
      Japan Lustre User Group 2014
    • Place of Presentation
      東京
    • Year and Date
      2014-10-17
    • Related Report
      2014 Research-status Report
  • [Presentation] 不揮発性メモリを考慮した大規模グラフの高速処理2014

    • Author(s)
      佐藤仁
    • Organizer
      メモリモリープラスワークショップ
    • Place of Presentation
      東京
    • Year and Date
      2014-09-17
    • Related Report
      2014 Research-status Report
  • [Presentation] TSUBAME2におけるGPUを用いた大規模データ処理2014

    • Author(s)
      佐藤仁
    • Organizer
      GPU Technology Conference Japan 2014
    • Place of Presentation
      東京
    • Year and Date
      2014-07-14
    • Related Report
      2014 Research-status Report
  • [Presentation] Abstractions for Convergence of Big Data and HPC in Deep Memory Hierarchy Machines2014

    • Author(s)
      Satoshi Matsuoka, Hitoshi Sato
    • Organizer
      Workshop on Programming Abstractions for Data Locality (PADAL 2014)
    • Place of Presentation
      Lugano, Switzerland
    • Year and Date
      2014-04-28 – 2014-04-29
    • Related Report
      2014 Research-status Report

URL: 

Published: 2014-04-04   Modified: 2023-03-16  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi