• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Creating a Massively Parallel and Distributed Computation Framework by Exploiting Short Idle Periods

Research Project

Project/Area Number 16H02801
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Software
Research InstitutionOsaka University

Principal Investigator

Ino Fumihiko  大阪大学, 情報科学研究科, 教授 (90346172)

Project Period (FY) 2016-04-01 – 2020-03-31
Project Status Completed (Fiscal Year 2019)
Budget Amount *help
¥17,030,000 (Direct Cost: ¥13,100,000、Indirect Cost: ¥3,930,000)
Fiscal Year 2019: ¥2,470,000 (Direct Cost: ¥1,900,000、Indirect Cost: ¥570,000)
Fiscal Year 2018: ¥5,720,000 (Direct Cost: ¥4,400,000、Indirect Cost: ¥1,320,000)
Fiscal Year 2017: ¥3,640,000 (Direct Cost: ¥2,800,000、Indirect Cost: ¥840,000)
Fiscal Year 2016: ¥5,200,000 (Direct Cost: ¥4,000,000、Indirect Cost: ¥1,200,000)
KeywordsGPU / マルチタスク / 並列分散処理 / 高速化
Outline of Final Research Achievements

In this work, we developed software techniques for exploiting milliseconds of idle periods that occur on remote graphics hardware (i.e., GPU) in home and office. The developed techniques are capable of accelerating compute-intensive scientific computation on shared GPUs while providing fast screen updating on the GPUs. We further developed a program translator that automatically generates parallel programs for multi-GPU environments, and demonstrated that the GPUs in home and office are useful for accelerating applications, such as distributed deep learning, that involve communication between computing nodes.

Academic Significance and Societal Importance of the Research Achievements

分散深層学習のような,計算ノード間の通信を伴う応用は,これまで高性能計算センターに設置された,専有のGPUクラスタ上で高速化されてきた.本研究の成果は,家庭やオフィスに設置された計算機群にGPUを追加するだけで,日常業務を処理しながら,ノード間通信を伴う分散深層学習を高速化できることを明らかにしていて,導入コストの低い共創型高性能計算システムの礎となることが期待でき,社会的にも学術的にも意義深い研究成果である.

Report

(5 results)
  • 2019 Annual Research Report   Final Research Report ( PDF )
  • 2018 Annual Research Report
  • 2017 Annual Research Report
  • 2016 Annual Research Report
  • Research Products

    (58 results)

All 2020 2019 2018 2017 2016 Other

All Int'l Joint Research (8 results) Journal Article (10 results) (of which Int'l Joint Research: 2 results,  Peer Reviewed: 9 results,  Open Access: 3 results,  Acknowledgement Compliant: 1 results) Presentation (38 results) (of which Int'l Joint Research: 18 results,  Invited: 4 results) Remarks (2 results)

  • [Int'l Joint Research] Barcelona Supercomputing Center(スペイン)

    • Related Report
      2019 Annual Research Report
  • [Int'l Joint Research] The University of Tennessee(米国)

    • Related Report
      2019 Annual Research Report
  • [Int'l Joint Research] KTH Royal Institute of Technology(スウェーデン)

    • Related Report
      2019 Annual Research Report
  • [Int'l Joint Research] University of Nicosia(キプロス)

    • Related Report
      2019 Annual Research Report
  • [Int'l Joint Research] University of Strathclyde(英国)

    • Related Report
      2019 Annual Research Report
  • [Int'l Joint Research] バルセロナ・スーパーコンピューティング・センター(スペイン)

    • Related Report
      2018 Annual Research Report
  • [Int'l Joint Research] スウェーデン王立工科大学(スウェーデン)

    • Related Report
      2018 Annual Research Report
  • [Int'l Joint Research] テネシー大学(米国)

    • Related Report
      2018 Annual Research Report
  • [Journal Article] Reducing the Amount of Out-of-Core Data Access for GPU-Accelerated Randomized SVD2020

    • Author(s)
      Yuechao Lu, Ichitaro Yamazaki, Fumihiko Ino, Yasuyuki Matsushita, Stanimire Tomov, and Jack Dongarra
    • Journal Title

      Concurrency and Computation: Practice and Experience

      Volume: - Issue: 19

    • DOI

      10.1002/cpe.5754

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Block Randomized Singular Value Decomposition on GPUs2020

    • Author(s)
      Yuechao Lu, Yasuyuki Matsushita, and Fumihiko Ino
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E103-D Issue: 9 Pages: 1949-1959

    • DOI

      10.1587/transinf.2019edp7265

    • NAID

      130007894621

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Memory Efficient Load Balancing for Distributed Large-Scale Volume Rendering Using a Two-Layered Group Structure2019

    • Author(s)
      Marcus Wallden, Stefano Markidis, Masao Okita, and Fumihiko Ino
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E102.D Issue: 12 Pages: 2306-2316

    • DOI

      10.1587/transinf.2019PAP0003

    • NAID

      130007754461

    • ISSN
      0916-8532, 1745-1361
    • Year and Date
      2019-12-01
    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Accelerating the Held-Karp Algorithm for the Symmetric Traveling Salesman Problem2019

    • Author(s)
      Kazuro Kimura, Shinya Higa, Masao Okita, and Fumihiko Ino
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E102.D Issue: 12 Pages: 2329-2340

    • DOI

      10.1587/transinf.2019PAP0008

    • NAID

      130007754460

    • ISSN
      0916-8532, 1745-1361
    • Year and Date
      2019-12-01
    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] PACC: A Directive-based Programming Framework for Out-of-Core Stencil Computation on Accelerators2019

    • Author(s)
      Nobuhiro Miki, Fumihiko Ino, and Kenichi Hagihara
    • Journal Title

      International Journal of High Performance Computing and Networking

      Volume: 13 Issue: 1 Pages: 19-34

    • DOI

      10.1504/ijhpcn.2019.097046

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed
  • [Journal Article] GPU-based Branch-and-Bound Method to Solve Large 0-1 Knapsack Problems with Data-centric Strategies2019

    • Author(s)
      Jingcheng Shen, Kentaro Shigeoka, Fumihiko Ino, and Kenichi Hagihara
    • Journal Title

      Concurrency and Computation: Practice and Experience

      Volume: 31 Issue: 4 Pages: 1-15

    • DOI

      10.1002/cpe.4954

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed
  • [Journal Article] PACC: A Directive-based Programming Framework for Out-of-Core Stencil Computation on Accelerators2018

    • Author(s)
      Nobuhiro Miki, Fumihiko Ino, and Kenichi Hagihara
    • Journal Title

      International Journal of High Performance Computing and Networking

      Volume: 印刷中

    • Related Report
      2017 Annual Research Report
  • [Journal Article] Parallelizing Exact and Approximate String Matching via Inclusive Scan on a GPU2017

    • Author(s)
      Yasuaki Mitani, Fumihiko Ino, and Kenichi Hagihara
    • Journal Title

      IEEE Transactions on Parallel and Distributed Systems

      Volume: 28 Pages: 1989-2002

    • Related Report
      2017 Annual Research Report 2016 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Cache-Aware, In-Place Rotation Method for Texture-Based Volume Rendering2017

    • Author(s)
      Yuji Misaki, Fumihiko Ino, and Kenichi Hagihara
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E100.D Issue: 3 Pages: 452-461

    • DOI

      10.1587/transinf.2016EDP7178

    • NAID

      130005397902

    • ISSN
      0916-8532, 1745-1361
    • Related Report
      2016 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Cache-Aware GPU Optimization for Out-of-Core Cone Beam CT Reconstruction of High-Resolution Volumes2016

    • Author(s)
      Yuechao Lu, Fumihiko Ino, and Kenichi Hagihara
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E99.D Issue: 12 Pages: 3060-3071

    • DOI

      10.1587/transinf.2016EDP7174

    • NAID

      130005170965

    • ISSN
      0916-8532, 1745-1361
    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Presentation] Training Strategies for CNN-based Models to Parse Complex Floor Plans2020

    • Author(s)
      Ruiyun Zhu, Jingcheng Shen, Xiangtian Deng, Marcus Wallden, and Fumihiko Ino
    • Organizer
      9th International Conference on Software and Computer Applications (ICSCA 2020)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Accelerating Human Genome Phenotypic Analysis with Bitwise Search and Batched Computation2020

    • Author(s)
      Yuichiro Miyamoto, Masao Okita, and Fumihiko Ino
    • Organizer
      28th Euromicro International Conference on Parallel, Distributed and Network-based Processing (PDP 2020)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Accelerating Large Seismic Simulation Code with PACC Framework2020

    • Author(s)
      Jingcheng Shen, Fumihiko Ino, Albert Farres, and Mauricio Hanzich
    • Organizer
      11th GPU Technology Conference (GTC 2020)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Applying PACC directives to accelerate out-of-core seismic wave simulation on a GPU2019

    • Author(s)
      Jingcheng Shen, Nobuhiro Miki, Fumihiko Ino, Kenichi Hagihara, Albert Farres, and Mauricio Hanzich
    • Organizer
      PhD Forum in the 33rd IEEE International Symposium on Parallel and Distributed Processing (IPDPS 2019)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Accelerating Distributed Deep Learning on a GPU-Cycle Sharing System2019

    • Author(s)
      Fumihiko Ino
    • Organizer
      Annual Meeting of the Asia Pacific Society for Computing and Information Technology (APSCIT 2019)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Towards Reducing Memory Consumption for Accelerating Genotype Imputation on the GPU2019

    • Author(s)
      Kazuya Tsubaki, Masao Okita, and Fumihiko Ino
    • Organizer
      Annual Meeting of the Asia Pacific Society for Computing and Information Technology (APSCIT 2019)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] GPU-Accelerated Randomized Newton Method for Fast Training Malicious Web Site Classifier2019

    • Author(s)
      Yuechao Lu, Boqi Gao, and Fumihiko Ino
    • Organizer
      18th International Conference on Security and Management (SAM 2019)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Transparent In-memory Cache Management in Apache Spark based on Post-Mortem Analysis2019

    • Author(s)
      Atsuya Nasu, Kenji Yoneo, Masao Okita, and Fumihiko Ino
    • Organizer
      7th IEEE International Conference on Big Data (Big Data 2019)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] ヒトゲノム表現型解析におけるビット並列探索およびプロセス並列処理による高速化2019

    • Author(s)
      宮本悠一朗, 置田真生, 伊野文彦
    • Organizer
      電子情報通信学会コンピュータシステム研究会
    • Related Report
      2019 Annual Research Report
  • [Presentation] Apache Sparkにおけるデータ依存グラフ解析に基づくメモリ内キャッシュ置換手法2019

    • Author(s)
      那須敦也, 置田真生, 伊野文彦
    • Organizer
      情報処理学会研オペレーティングシステム研究会
    • Related Report
      2019 Annual Research Report
  • [Presentation] 省メモリ推論のための深層ニューラルネットワークの圧縮手法2019

    • Author(s)
      岩﨑博生, 伊野文彦
    • Organizer
      人工知能学会第13回汎用人工知能研究会
    • Related Report
      2019 Annual Research Report
  • [Presentation] GPUプログラムにおける静的参照関係を表すハイパーグラフの分割を用いた参照効率のよいデータ配置2019

    • Author(s)
      比嘉慎哉, 置田真生, 萩原兼一, 伊野文彦
    • Organizer
      情報処理学会ハイパフォーマンスコンピューティング研究会
    • Related Report
      2018 Annual Research Report
  • [Presentation] 対称巡回セールスマン問題に対するHeld-Karpアルゴリズムの高速化2019

    • Author(s)
      木村和郎, 比嘉慎哉, 置田真生, 伊野文彦
    • Organizer
      電子情報通信学会コンピュータシステム研究会
    • Related Report
      2018 Annual Research Report
  • [Presentation] A Method for Estimating Task Granularity for Automating GPU Cycle Sharing2018

    • Author(s)
      Keishi Tsukada and Fumihiko Ino
    • Organizer
      7th International Conference on Network,Communication and Computing (ICNCC 2018)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] PACC: A Directive-based Approach for Accelerating Out-of-Core Stencil Applications on the GPU2018

    • Author(s)
      Fumihiko Ino
    • Organizer
      3rd International Workshop on GPU Computing and AI (GCA 2018)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] GPU上で大規模ナップザック問題を解くためのアウトオブコア計算手法2018

    • Author(s)
      沈靖程, 重岡謙太郎, 伊野文彦, 萩原兼一
    • Organizer
      第14回情報科学ワークショップ
    • Related Report
      2018 Annual Research Report
  • [Presentation] 並列プログラム自動生成における間接参照の削減によるベクトル計算機向けメモリ参照効率化2018

    • Author(s)
      石田祐二郎, 置田真生, 伊野文彦, 萩原兼一
    • Organizer
      第14回情報科学ワークショップ
    • Related Report
      2018 Annual Research Report
  • [Presentation] 並列プログラム自動生成におけるベクトル計算機向けメモリ参照効率化のための間接参照の削減2018

    • Author(s)
      石田祐二郎, 置田真生, 伊野文彦, 萩原兼一
    • Organizer
      電子情報通信学会コンピュータシステム研究会
    • Related Report
      2018 Annual Research Report
  • [Presentation] An Out-of-core CPU-GPU Cooperative B&B Solver for the Large Knapsack Problem2018

    • Author(s)
      Jingcheng Shen, Kentaro Shigeoka Fumihiko Ino, and Kenichi Hagihara
    • Organizer
      2nd Cross-disciplinary Workshop on Computing Systems,Infrastructures, and Programming (xSIG 2018)
    • Related Report
      2018 Annual Research Report
  • [Presentation] GPUコンピューティング技術に関わる産学共創の紹介2018

    • Author(s)
      伊野文彦
    • Organizer
      バイオグリッド研究会2018
    • Related Report
      2018 Annual Research Report
    • Invited
  • [Presentation] An Automated Method for Generating Training Sets for Deep Learning Based Image Registration2018

    • Author(s)
      Masato Ito and Fumihiko Ino
    • Organizer
      11th International Joint Conference on Biomedical Engineering Systems and Technologies (BIOSTEC 2018)
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Transparent Avoidance of Redundant Data Transfer on GPU-enabled Apache Spark2018

    • Author(s)
      Ryo Asai, Masao Okita, Fumihiko Ino, and Kenichi Hagihara
    • Organizer
      11th Workshop on General Purpose Processing Using GPU (GPGPU 2018)
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] GPU サイクル共有を自動化するためのタスク粒度推定手法の検討2017

    • Author(s)
      塚田敬司, 伊野文彦, 萩原兼一
    • Organizer
      cross-disciplinary Workshop on Computing Systems, Infrastructures, and Programming (xSIG 2017)
    • Place of Presentation
      虎ノ門ヒルズフォーラム(東京都・港区)
    • Year and Date
      2017-04-25
    • Related Report
      2016 Annual Research Report
  • [Presentation] 並列計算の現状と産業応用について2017

    • Author(s)
      伊野文彦
    • Organizer
      産業・社会向けソリューションを支えるIoTと機械学習シンポジウム
    • Place of Presentation
      京都リサーチパーク(京都府・京都市)
    • Year and Date
      2017-02-10
    • Related Report
      2016 Annual Research Report
    • Invited
  • [Presentation] RLAGPU: High-performance Out-of-Core Randomized Singular Value Decomposition on GPU2017

    • Author(s)
      Yuechao Lu, Fumihiko Ino, Yasuyuki Matsushita, and Kenichi Hagihara
    • Organizer
      8th GPU Technology Conference (GTC 2017)
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] cuShiftOr: String Matching with Prefix Summing on a GPU2017

    • Author(s)
      Fumihiko Ino, Yasuaki Mitani, and Kenichi Hagihara
    • Organizer
      8th GPU Technology Conference (GTC 2017)
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] An Out-of-Core Branch and Bound for Solving the 0-1 Knapsack Problem on a GPU2017

    • Author(s)
      Jingcheng Shen, Kentaro Shigeoka, Fumihiko Ino, and Kenichi Hagihara
    • Organizer
      17th International Conference on Algorithms and Architectures for Parallel Processing (ICA3PP 2017)
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Accelerating Scoring Computation of Smith-Waterman Algorithm with Mixed Word Length2017

    • Author(s)
      Kazuki Yasui and Fumihiko Ino
    • Organizer
      4th International Workshop on High Performance Computing on Bioinformatics (HPCB 2017)
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] GPUサイクル共有を自動化するためのタスク粒度推定手法の検討2017

    • Author(s)
      塚田敬司, 伊野文彦, 萩原兼一
    • Organizer
      1st Cross-disciplinary Workshop on Computing Systems, Infrastructures, and Programming (xSIG 2017)
    • Related Report
      2017 Annual Research Report
  • [Presentation] 深層学習を用いた画像位置合わせのための教師データの自動生成手法2017

    • Author(s)
      伊藤眞人, 伊野文彦, 萩原兼一
    • Organizer
      電子情報通信学会医用画像研究会
    • Related Report
      2017 Annual Research Report
  • [Presentation] GPUサイクル共有を自動化するためのタスク粒度推定手法2017

    • Author(s)
      塚田敬司, 伊野文彦, 萩原兼一
    • Organizer
      情報処理学会ハイパフォーマンスコンピューティング研究会
    • Related Report
      2017 Annual Research Report
  • [Presentation] GPUサイクル共有システムにおいて深層学習フレームワークCNTKを実行する手法の検討2017

    • Author(s)
      塚田敬司, 伊野文彦
    • Organizer
      GPU Technology Conference (GTC Japan 2017)
    • Related Report
      2017 Annual Research Report
  • [Presentation] Towards Automating Multi-dimensional Data Decomposition for Executing a Single-GPU Code on a Multi-GPU System2016

    • Author(s)
      Ryotaro Sakai, Fumihiko Ino, and Kenichi Hagihara
    • Organizer
      4th International Workshop on Computer Systems and Architectures (CSA 2016)
    • Place of Presentation
      Higashihiroshima, Japan
    • Year and Date
      2016-11-25
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] An Extension of OpenACC Directives for Out-of-Core Stencil Computation with Temporal Blocking2016

    • Author(s)
      Nobuhiro Miki, Fumihiko Ino, and Kenichi Hagihara
    • Organizer
      3rd Workshop on Accelerator Programming Using Directives (WACCPD 2016)
    • Place of Presentation
      Salt Lake City, UT, USA
    • Year and Date
      2016-11-14
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] アウトオブコア・ステンシル計算に対する自動テンポラルブロッキングのためのアクセラレータ向けディレクティブPACC2016

    • Author(s)
      三木脩弘, 伊野文彦, 萩原兼一
    • Organizer
      GTC Japan 2016
    • Place of Presentation
      ヒルトン東京お台場(東京都・港区)
    • Year and Date
      2016-10-05
    • Related Report
      2016 Annual Research Report
  • [Presentation] 単一GPUコードをマルチGPU環境で実行するための多次元データ分割手法の検討2016

    • Author(s)
      酒井亮太郎, 伊野文彦, 萩原兼一
    • Organizer
      情報処理学会ハイパフォーマンスコンピューティング研究会
    • Place of Presentation
      キッセイ文化ホール(長野県・松本市)
    • Year and Date
      2016-08-10
    • Related Report
      2016 Annual Research Report
  • [Presentation] アウトオブコア・ステンシル計算に対する自動テンポラルブロッキングのためのアクセラレータ向けディレクティブ2016

    • Author(s)
      三木脩弘, 伊野文彦, 萩原兼一
    • Organizer
      情報処理学会ハイパフォーマンスコンピューティング研究会
    • Place of Presentation
      キッセイ文化ホール(長野県・松本市)
    • Year and Date
      2016-08-08
    • Related Report
      2016 Annual Research Report
  • [Presentation] GPU上の16ビット整数表現によるSmith-Watermanアルゴリズムの高速化の検討2016

    • Author(s)
      安井一貴, 伊野文彦, 萩原兼一
    • Organizer
      第16回ハイパフォーマンスコンピューティングと計算科学シンポジウム
    • Place of Presentation
      東北大学(宮城県・仙台市)
    • Year and Date
      2016-06-13
    • Related Report
      2016 Annual Research Report
  • [Remarks] 大阪大学 大学院情報科学研究科 並列処理工学講座

    • URL

      http://www-ppl.ist.osaka-u.ac.jp/

    • Related Report
      2019 Annual Research Report 2018 Annual Research Report 2017 Annual Research Report
  • [Remarks] 大阪大学大学院情報科学研究科並列処理工学講座

    • Related Report
      2016 Annual Research Report

URL: 

Published: 2016-04-21   Modified: 2021-02-19  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi