• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Big data platform based on Containers with low power consumption

Research Project

Project/Area Number 17K00109
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Research Field Software
Research InstitutionKogakuin University

Principal Investigator

Yamaguchi Saneyasu  工学院大学, 情報学部(情報工学部), 准教授 (50439262)

Project Period (FY) 2017-04-01 – 2020-03-31
Project Status Completed (Fiscal Year 2019)
Budget Amount *help
¥4,420,000 (Direct Cost: ¥3,400,000、Indirect Cost: ¥1,020,000)
Fiscal Year 2019: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Fiscal Year 2018: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Fiscal Year 2017: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Keywordsコンテナ型仮想化 / ビッグデータ / ファイルシステム / コンテナ型仮想化環境 / 情報システム / 仮想化技術
Outline of Final Research Achievements

In this research, I planned to develop a low load, high performance, low power consumption big data processing platform using a container-based virtualized environment. The main purpose of this project was to improve the performance of big data processing applications with a container-based environment. For this purpose, I aimed mainly to develop a system for monitoring the behavior of container-based environments and to construct a file system for a container-based virtualized environment.
In this project, I have met all these purposes. I developed the processing platform, improved the performance of the applications, constructed the monitoring system, and built a file system for container-based environments.

Academic Significance and Societal Importance of the Research Achievements

IoTやAIの様な大規模なデータを扱う応用とクラウド環境が普及し、大規模データ処理を仮想化環境で行う機会が増えている。また、近年はより低負荷高性能なコンテナ型仮想化環境が注目を集めており、この性能の向上が非常に重要な課題となっている。本研究ではこの重要な課題に挑み、性能を向上させ成果を上げている。

Report

(4 results)
  • 2019 Annual Research Report   Final Research Report ( PDF )
  • 2018 Research-status Report
  • 2017 Research-status Report
  • Research Products

    (57 results)

All 2020 2019 2018 2017 Other

All Int'l Joint Research (3 results) Journal Article (4 results) (of which Peer Reviewed: 4 results,  Open Access: 3 results) Presentation (50 results) (of which Int'l Joint Research: 40 results)

  • [Int'l Joint Research] Texas A&M University(米国)

    • Related Report
      2019 Annual Research Report
  • [Int'l Joint Research] Universityof Florida(米国)

    • Related Report
      2019 Annual Research Report
  • [Int'l Joint Research] Texas A&M大学(米国)

    • Related Report
      2018 Research-status Report
  • [Journal Article] Hadoop I/O Performance Improvement by File Layout Optimization2018

    • Author(s)
      Eita FUJISHIMA Kenji NAKASHIMA Saneyasu YAMAGUCHI
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E101.D Issue: 2 Pages: 415-427

    • DOI

      10.1587/transinf.2017EDP7114

    • NAID

      130006328424

    • ISSN
      0916-8532, 1745-1361
    • Related Report
      2017 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Power-Effective File Layout Based on Large Scale Data-Intensive Application in Virtualized Environment2017

    • Author(s)
      Shunsuke Yagai, Masato Oguchi, Miyuki Nakano, Saneyasu Yamaguchi
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E100.D Issue: 12 Pages: 2761-2770

    • DOI

      10.1587/transinf.2017PAP0003

    • NAID

      130006236561

    • ISSN
      0916-8532, 1745-1361
    • Related Report
      2017 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] 遅延時間制御手法の破棄制御によるTCP公平性の向上2017

    • Author(s)
      花井 雅人, 山口 実靖,小林 亜樹
    • Journal Title

      情報処理学会論文誌

      Volume: 58 Pages: 1993-2005

    • NAID

      170000149121

    • Related Report
      2017 Research-status Report
    • Peer Reviewed
  • [Journal Article] Controlling Middleware for Reducing the TCP ACK Packet Backlog at the WLAN Access Point2017

    • Author(s)
      Ai Hayakawa, Masato Oguchi, Saneyasu Yamaguchi
    • Journal Title

      Management Studies

      Volume: 5 Issue: 3 Pages: 219-233

    • DOI

      10.17265/2328-2185/2017.03.007

    • Related Report
      2017 Research-status Report
    • Peer Reviewed / Open Access
  • [Presentation] Improving I/O Performance in Container with OverlayFS with Optimized Synchronization2020

    • Author(s)
      Naoki Mizusawa, Seki Yuya, Jian Tao, Saneyasu Yamaguchi
    • Organizer
      HPC Asia 2020
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A Study on I/O Performance in Highly Consolidated Container-Based Virtualized Environment on OverlayFS with Optimized Synchronization2020

    • Author(s)
      Naoki Mizusawa, Yuya Seki, Jian Tao, Saneyasu Yamaguchi
    • Organizer
      The 14th International Conference on Ubiquitous Information Management and Communication (IMCOM 2020)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] オートスケーリングにおけるコンテナ数変動時のシステムの振る舞いに関する一考察2020

    • Author(s)
      水沢直暉, 岩崎咲月, 山口実靖
    • Organizer
      第12回データ工学と情報マネジメントに関するフォーラム(DEIM2020)
    • Related Report
      2019 Annual Research Report
  • [Presentation] コンテナ環境におけるI/O性能向上に関する一考察2019

    • Author(s)
      水沢直暉,関 優也,Jian Tao,山口実靖
    • Organizer
      情報処理学会第81回全国大会, 1L-08
    • Related Report
      2018 Research-status Report
  • [Presentation] Performance Improvement of File Operations on OverlayFS for Containers2018

    • Author(s)
      Naoki Mizusawa, Joichiro Kon, Yuya Seki, Jian Tao, Saneyasu Yamaguchi
    • Organizer
      The 2nd IEEE International Workshop on Big Data and IoT Security in Smart Computing
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Improving I/O Performance in Container with OverlayFS2018

    • Author(s)
      N. Mizusawa, J. Kon, Y. Seki, J. Tao and S. Yamaguchi
    • Organizer
      2018 IEEE International Conference on Big Data (Big Data), Seattle, WA, USA, 2018 pp. 5395-5395. doi: 10.1109/BigData.2018.8622479
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] TCP Fairness Evaluation with Modified Controlled Delay in the Practical Networks2018

    • Author(s)
      Masato Hanai, Saneyasu Yamaguchi, Aki Kobayashi
    • Organizer
      12th International Conference on Ubiquitous Information Management and Communication (ACM IMCOM 2018)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] I/O Performance Improvement of Secure Big Data Analyses with Application Support on SSD Cache2018

    • Author(s)
      Kenji Nakashima, Joichiro Kon, Saneyasu Yamaguchi
    • Organizer
      12th International Conference on Ubiquitous Information Management and Communication (ACM IMCOM 2018)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] A Caching Filesystem for Increasing Locality in the Second Cache in a Virtualized Environment2018

    • Author(s)
      Yoshida Kotaro, Saneyasu Yamaguchi
    • Organizer
      12th International Conference on Ubiquitous Information Management and Communication (ACM IMCOM 2018)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Saving Power Consumption of Smartphones in the Screen-off State with Disabling the Wi-Fi2018

    • Author(s)
      Tsubasa Murakami, Shun Kurihara, Shoki Fukuda, Masato Oguchi, Saneyasu Yamaguchi
    • Organizer
      2018 IEEE International Conference on Consumer Electronics (ICCE)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Stability Improvement of an Accelerated Android Operating System for Application Observation2018

    • Author(s)
      Shoki Fukuda, Shun Kurihara, Masato Oguchi, Saneyasu Yamaguchi
    • Organizer
      2018 IEEE International Conference on Consumer Electronics (ICCE)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] HTTP/2 Performance Evaluation with Latency and Packet Losses2018

    • Author(s)
      Naoki Oda and Saneyasu Yamaguchi
    • Organizer
      IEEE Consumer Communications & Networking Conference
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Performance Improvement of TCP Communication based on Cooperative Congestion Control in Android Terminals2018

    • Author(s)
      Ayumi Shimada, Saneyasu Yamaguchi, and Masato Oguchi
    • Organizer
      In Proc. the 12th ACM International Conference on Ubiquitous Information Management and Communication (IMCOM2018), 3-2, Langkawi, Malaysia
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] カーネルの時刻管理実装の改変によるアプリケーション観察時間の短縮2017

    • Author(s)
      福田 翔貴,栗原,駿,濱中 真太郎,小口 正人, 山口 実靖
    • Organizer
      The 1st. cross-disciplinary Workshop on Computing Systems, Infrastructures, and Programming
    • Related Report
      2017 Research-status Report
  • [Presentation] Application Switch using DPN for Improving TCP Based Data Center Applications2017

    • Author(s)
      Shinnosuke Nirasawa, Masaki Hara, Akihiro Nakao, Masato Oguchi, Shu Yamamoto, Saneyasu Yamaguchi
    • Organizer
      2nd IFIP/IEEE International Workshop on Analytics for Network and Service Management (AnNet 2017)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] HTTP/2 Communiction Performance on Highly Delayed Network2017

    • Author(s)
      Naoki Oda, Saneyasu Yamaguchi
    • Organizer
      The 13th International Conference on IP + Optical Network (iPOP2017)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Evaluation of Service Identification from IP Flows2017

    • Author(s)
      Masaki Hara, Shinnosuke Nirasawa, Masato Oguchi, Akihiro Nakao, Shu Yamamoto, Saneyasu Yamaguchi
    • Organizer
      The 13th International Conference on IP + Optical Network (iPOP2017)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Performance of TCP-supporting Application Switches2017

    • Author(s)
      Shinnosuke Nirasawa, Masaki Hara, Akihiro Nakao, Shu Yamamoto, Masato Oguchi, Saneyasu Yamaguchi
    • Organizer
      The 13th International Conference on IP + Optical Network (iPOP2017)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] A Study on Promotion of Generational GC in ART2017

    • Author(s)
      Ryusuke Mori, Shintaro Hamanaka, Masato Oguchi, Saneyasu Yamaguchi
    • Organizer
      2017 IEEE International Conference on Consumer Electronics - Taiwan (ICCE-TW)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] File Placing Location Control for Big Data Processing2017

    • Author(s)
      Joichiro Kon, Kenji Nakashima, Eita Fujishima, SaneyasuYamaguchi
    • Organizer
      The 1st USJapan Workshop Enabling Global Collaborations in Big Data Research
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Queue Management and TCP Fairness Improvement2017

    • Author(s)
      Masato Hanai, Saneyasu Yamaguchi, Aki Kobayashi
    • Organizer
      The 1st USJapan Workshop Enabling Global Collaborations in Big Data Research
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] File Placing Control for Improving the I/O Performance of Hadoop in Virtualized Environment2017

    • Author(s)
      Kenji Nakashima, Joichiro Kon, Saneyasu Yamaguchi
    • Organizer
      The 1st USJapan Workshop Enabling Global Collaborations in Big Data Research
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] SSDキャッシュの制御によるシーケンシャルアプリケーションの性能向上2017

    • Author(s)
      中島健司・近丈一郎・山口実靖
    • Organizer
      FIT2017 第16回情報科学技術フォーラム
    • Related Report
      2017 Research-status Report
  • [Presentation] 仮想化環境における下位キャッシュの局所性を高めるファイルシステム2017

    • Author(s)
      吉田光太朗・山口実靖
    • Organizer
      FIT2017 第16回情報科学技術フォーラム
    • Related Report
      2017 Research-status Report
  • [Presentation] 時間加速Android環境におけるシステム安定性に関する一考察2017

    • Author(s)
      福田翔貴・栗原 駿・小口正人・山口実靖
    • Organizer
      FIT2017 第16回情報科学技術フォーラム
    • Related Report
      2017 Research-status Report
  • [Presentation] I/Oスケジュールの制御によるKVSノード追加時間の短縮に関する一考察2017

    • Author(s)
      森光由輝・水野 修・山口実靖
    • Organizer
      FIT2017 第16回情報科学技術フォーラム
    • Related Report
      2017 Research-status Report
  • [Presentation] 巨大ブロックサイズファイルシステムによるセキュアなコンテンツ共有・流通基盤の大規模I/O性能の向上2017

    • Author(s)
      近丈一郎・中島健司・山口実靖
    • Organizer
      FIT2017 第16回情報科学技術フォーラム
    • Related Report
      2017 Research-status Report
  • [Presentation] Memory consumption saving by optimization of promotion condition of generational GC in android2017

    • Author(s)
      Ryusuke Mori, Masato Oguchi, Saneyasu Yamaguchi
    • Organizer
      2017 IEEE 6th Global Conference on Consumer Electronics (GCCE)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Estimation of Power Consumption of Each Application Based on Software Dependency in Android2017

    • Author(s)
      Shun Kurihara and Shoki Fukuda, Masato Oguchi, Saneyasu Yamaguchi
    • Organizer
      2017 IEEE 6th Global Conference on Consumer Electronics (GCCE)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] A STUDY ON REDUCTION OF NODE JOINING TIME BY CONTROLLING EXPIRETIMES2017

    • Author(s)
      Yuki Morimitsu, Saneyasu Yamaguchi, Osamu Mizuno
    • Organizer
      The 16th International Symposium on Advanced Technology (ISAT-16)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] A Large Block Filesystem for Improving I/O Performance of Secure Data Sharing and Distribution Platform2017

    • Author(s)
      Joichiro Kon, Kenji Nakashima, Saneyasu Yamaguchi
    • Organizer
      The 16th International Symposium on Advanced Technology (ISAT-16)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] I/O Performance Improvement on Modern Storage2017

    • Author(s)
      Kenji Nakashima, Joichiro Kon, Saneyasu Yamaguchi
    • Organizer
      The 16th International Symposium on Advanced Technology (ISAT-16)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] A Performance Survey of Web Applications in a Highly Consolidated Server with Container-based Virtualization for Each HTTP Request2017

    • Author(s)
      Yuto Tachibana, Joichiro Kon, Saneyasu Yamaguchi
    • Organizer
      The 16th International Symposium on Advanced Technology (ISAT-16)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] A Caching Filesystem for Increasing Cache Hit Ratio in the Second Cache in a Virtualized Environment2017

    • Author(s)
      Kotaro Yoshida, Saneyasu Yamaguchi
    • Organizer
      The 16th International Symposium on Advanced Technology (ISAT-16)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Performance of File Operations on Docker with OverlayFS2017

    • Author(s)
      Naoki Mizusawa, Joichiro Kon, Kenji Nakashima, Sanayasu Yamaguchi
    • Organizer
      The 16th International Symposium on Advanced Technology (ISAT-16)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] File Storing Performance over Network on Object Storage2017

    • Author(s)
      Shunpei Hayakawa, Joichiro Kon, Kenji Nakashima, Saneyasu Yamaguchi
    • Organizer
      The 16th International Symposium on Advanced Technology (ISAT-16)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] A Study on the Performance of Web Applications Based on RoR in a Highly Consolidated Server with Container-based Virtualization2017

    • Author(s)
      Yuto Tachibana, Joichiro Kon and Saneyasu Yamaguchi
    • Organizer
      the 8th International Workshop on Advances in Networking and Computing (WANC 2017)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] A Deletion Aware Usable Space Control for SD22017

    • Author(s)
      Joichiro Kon, Kenji Nakashima and Saneyasu Yamaguchi
    • Organizer
      the 8th International Workshop on Advances in Networking and Computing (WANC 2017)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Estimation of Power Consumption of Each Application Caused by Device Lock Considering Software Dependency in Smartphones2017

    • Author(s)
      Shun Kurihara, Shoki Fukuda, Masato Oguchi and Saneyasu Yamaguchi
    • Organizer
      the 8th International Workshop on Advances in Networking and Computing (WANC 2017)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Performance Evaluation of File Operations on OverlayFS2017

    • Author(s)
      Naoki Mizusawa, Kenji Nakashima and Saneyasu Yamaguchi
    • Organizer
      the 8th International Workshop on Advances in Networking and Computing (WANC 2017)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Height Estimation based on Sensor Data on Smartphone2017

    • Author(s)
      Yusuke Sato, Shun Kurihara, Shoki Fukuda, Masato Oguchi, Saneyasu Yamaguchi
    • Organizer
      In Proceedings of the 15th International Conference on Advances in Mobile Computing & Multimedia (MoMM2017), Pages 102-106
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] A study on interpretability of decision of machine learning2017

    • Author(s)
      Shohei Shirataki, Saneyasu Yamaguchi
    • Organizer
      2017 IEEE International Conference on Big Data (Big Data), Boston, MA, 2017, pp. 4830-4831.
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] A study on big data I/O performance with modern storage systems2017

    • Author(s)
      Kenji Nakashima, Joichiro Kon, Gil Jae Lee, Jose Fortes, Saneyasu Yamaguchi
    • Organizer
      2017 IEEE International Conference on Big Data (Big Data), Boston, MA, 2017, pp. 4798-4799.
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Highly consolidated servers with container-based virtualization2017

    • Author(s)
      Joichiro Kon, Naoki Mizusawa, Ayaka Umezawa, Saneyasu Yamaguchi, Jian Tao
    • Organizer
      2017 IEEE International Conference on Big Data (Big Data), Boston, MA, 2017, pp. 2472-2479.
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Performance Improvement of Calculation of Static Magnetic Field of Micromagnetic Simulator Using Supercomputer FX102017

    • Author(s)
      Masahiro Arai, Fumiko Akagi, Saneyasu Yamaguchi, Kazuetsu Yoshida
    • Organizer
      the International Conference on High Performance Computing in Asia-Pacific Region
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] 複数の仮想マシン動作時におけるKSMの性能向上に関する一考察2017

    • Author(s)
      野崎優太,山口実靖
    • Organizer
      情報処理学会第80会全国大会
    • Related Report
      2017 Research-status Report
  • [Presentation] オブジェクトストレージにおけるオブジェクト数と性能に関する一考察2017

    • Author(s)
      早川峻平,山口実靖
    • Organizer
      情報処理学会第80会全国大会
    • Related Report
      2017 Research-status Report
  • [Presentation] Real-Time Event Search Corresponding to Place and Time using Social Stream2017

    • Author(s)
      Ruriko Kudo, Miki Enoki, Akihiro Nakao, Shu Yamamoto, Saneyasu Yamaguchi, and Masato Oguchi
    • Organizer
      In Proc. the 3rd IEEE International Conference on Big Data Intelligence and Computing (DataCom2017), pp.1047-1053, Orlando, Florida, USA
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Application Specific Traffic Control using Network Virtualization Node in Large-Scale Disasters2017

    • Author(s)
      Tsumugi Tairaku, Akihiro Nakao, Shu Yamamoto, Saneyasu Yamaguchi, and Masato Oguchi
    • Organizer
      In Proc. the IEEE Workshop Data Science for Networking (DS4N) in conjunction with the IEEE International Conference on Big Data (Big Data 2017), pp.3922-3927, Boston, Massachusetts, USA
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Application Specific Traffic Control in Large-Scale Disasters2017

    • Author(s)
      Tsumugi Tairaku, Akihiro Nakao, Shu Yamamoto, Saneyasu Yamaguchi, and Masato Oguchi
    • Organizer
      In Proc. the IEEE International Conference on Big Data (Big Data 2017), Poster, pp.4756-4758, Boston, Massachusetts, USA
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research

URL: 

Published: 2017-04-28   Modified: 2021-02-19  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi