• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Knowledge discovery from compressed stream data

Research Project

Project/Area Number 26280088
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypePartial Multi-year Fund
Section一般
Research Field Intelligent informatics
Research InstitutionKyushu Institute of Technology

Principal Investigator

Sakamoto Hiroshi  九州工業大学, 大学院情報工学研究院, 教授 (50315123)

Co-Investigator(Kenkyū-buntansha) 山際 伸一  筑波大学, システム情報工学研究科(系), 准教授 (10574725)
榎田 修一  九州工業大学, 大学院情報工学研究院, 教授 (40346862)
Co-Investigator(Renkei-kenkyūsha) TABEI Yasuo  理化学研究所, 革新知能統合研究センター, ユニットリーダー (20589824)
Project Period (FY) 2014-04-01 – 2017-03-31
Project Status Completed (Fiscal Year 2017)
Budget Amount *help
¥12,220,000 (Direct Cost: ¥9,400,000、Indirect Cost: ¥2,820,000)
Fiscal Year 2016: ¥5,330,000 (Direct Cost: ¥4,100,000、Indirect Cost: ¥1,230,000)
Fiscal Year 2015: ¥3,250,000 (Direct Cost: ¥2,500,000、Indirect Cost: ¥750,000)
Fiscal Year 2014: ¥3,640,000 (Direct Cost: ¥2,800,000、Indirect Cost: ¥840,000)
Keywordsストリームデータ / 圧縮伝送 / FPGA / 可逆圧縮 / データ圧縮 / 文法圧縮 / パターン発見 / 特徴抽出 / ストリーム圧縮 / 文字列アルゴリズム / 知識発見 / データマイニング
Outline of Final Research Achievements

The aim of this research is to produce a novel technology for stream data compression realizing the real time processing of stream data to obtain deep knowledge hidden big data stream. In the previous studies, because of the tradeoff between compression ratio and memory consumption, either algorithm requires so huge memory to load whole input or input data must be decomposed into a sequence of small segments so that the algorithm can load it into the restricted memory. In this proposal, we can minimize the nonnegligible tradeoff, and we can expand the throughput of the network constructed by the compression-transmission-decompression algorithm implemented by FPGA. We propose and demonstrate these outcomes to the real world via patent applications, research articles, and industrial demonstrations.

Report

(4 results)
  • 2017 Final Research Report ( PDF )
  • 2016 Annual Research Report
  • 2015 Annual Research Report
  • 2014 Annual Research Report
  • Research Products

    (30 results)

All 2016 2015 2014 Other

All Journal Article (5 results) (of which Peer Reviewed: 5 results,  Open Access: 3 results,  Acknowledgement Compliant: 1 results) Presentation (19 results) (of which Int'l Joint Research: 4 results,  Invited: 1 results) Remarks (4 results) Patent(Industrial Property Rights) (2 results) (of which Overseas: 1 results)

  • [Journal Article] Lazy Management for Frequency Table on Hardware-Based Stream Lossless Data Compression2016

    • Author(s)
      Koichi Marumo, Shinichi Yamagiwa, Ryuta Morita, Hiroshi Sakamoto
    • Journal Title

      Information

      Volume: 7(4) Issue: 4 Pages: 63-63

    • DOI

      10.3390/info7040063

    • NAID

      120007135280

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] siEDM: An Efficient String Index and Search Algorithm for Edit Distance with Moves2016

    • Author(s)
      Yoshimasa Takabatake, Kenta Nakashima, Tetsuji Kuboyama, Yasuo Tabei, Hiroshi Sakamoto
    • Journal Title

      Algorithms

      Volume: 9(2) Issue: 2 Pages: 26-26

    • DOI

      10.3390/a9020026

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Online Grammar Compression for Frequent Pattern Discovery2016

    • Author(s)
      S. Fukunaga, Y. Takabatake, T. I, H. Sakamoto
    • Journal Title

      Proceedings of Machine Learning Research (ICGI 2016)

      Volume: 57 Pages: 93-104

    • NAID

      130008061357

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] Online Pattern Matching for String Edit Distance with Moves2014

    • Author(s)
      Yoshimasa Takabatake, Yasuo Tabei, Hiroshi Sakamoto
    • Journal Title

      SPIRE 2014

      Volume: SPIRE2014 Pages: 203-214

    • DOI

      10.1007/978-3-319-11918-2_20

    • ISBN
      9783319119175, 9783319119182
    • Related Report
      2014 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Improved ESP-index: A Practical Self-index for Highly Repetitive Texts2014

    • Author(s)
      Yoshimasa Takabatake, Yasuo Tabei, Hiroshi Sakamoto
    • Journal Title

      SEA 2014

      Volume: SEA2014 Pages: 338-350

    • DOI

      10.1007/978-3-319-07959-2_29

    • ISBN
      9783319079585, 9783319079592
    • Related Report
      2014 Annual Research Report
    • Peer Reviewed
  • [Presentation] Finding Frequent Patterns from Stream Data with Small Space2016

    • Author(s)
      S. Iwasaki, Y. Takabatake, T. Kuboyama, H. Sakamoto
    • Organizer
      SISA2016
    • Place of Presentation
      タイ王国,アユタヤ市
    • Year and Date
      2016-09-14
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 文法圧縮における逆引き辞書の省スペース化2016

    • Author(s)
      福永祥平, 坂本比呂志
    • Organizer
      第100回SIG-FPAI研究会
    • Place of Presentation
      熊本市
    • Year and Date
      2016-03-27
    • Related Report
      2015 Annual Research Report
  • [Presentation] 定数領域の頻度計算を用いたオンライン文法圧縮アルゴリズム2016

    • Author(s)
      徳永啓太郎, 坂本比呂志
    • Organizer
      第100回SIG-FPAI研究会
    • Place of Presentation
      熊本市
    • Year and Date
      2016-03-27
    • Related Report
      2015 Annual Research Report
  • [Presentation] 文法圧縮を用いた類似度計算の大規模データへの適用2016

    • Author(s)
      大西孝典, 坂本比呂志
    • Organizer
      第100回SIG-FPAI研究会
    • Place of Presentation
      熊本市
    • Year and Date
      2016-03-27
    • Related Report
      2015 Annual Research Report
  • [Presentation] 文法圧縮のハッシュ領域の削減2016

    • Author(s)
      水野仁人,高畠嘉将,坂本比呂志
    • Organizer
      第99回SIG-FPAI研究会
    • Place of Presentation
      仙台市
    • Year and Date
      2016-01-21
    • Related Report
      2015 Annual Research Report
  • [Presentation] ストリームデータからの頻出パターンの近似発見2016

    • Author(s)
      青山友紀, 高畠嘉将,坂本比呂志
    • Organizer
      第99回SIG-FPAI研究会
    • Place of Presentation
      仙台市
    • Year and Date
      2016-01-21
    • Related Report
      2015 Annual Research Report
  • [Presentation] Skill Grouping Method: Mining and Clustering Skill Differences from Body Movement BigData2015

    • Author(s)
      Shinichi Yamagiwa, Yoshinobu Kawahara, Noriyuki Tabuchi, Yoshinobu Watanabe and Takeshi Naruo
    • Organizer
      BigData 2015
    • Place of Presentation
      Santa Clara, CA, USA
    • Year and Date
      2015-10-29
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Online Self-Indexed Grammar Compression2015

    • Author(s)
      Yoshimasa Takabatake, Yasuo Tabei, Hiroshi Sakamoto
    • Organizer
      SPIRE 2015
    • Place of Presentation
      London, UK
    • Year and Date
      2015-09-01
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Stream-Based Lossless Data Compression Hardware Using Adaptive Frequency Table Management2015

    • Author(s)
      Shinichi Yamagiwa, Koichi Marumo, Hiroshi Sakamoto
    • Organizer
      BPOE 2015
    • Place of Presentation
      Kohala, HI, USA
    • Year and Date
      2015-08-31
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] siEDM: 移動付き編集距離の為の効率的な索引2015

    • Author(s)
      高畠嘉将, 中島健太, 田部井靖生, 坂本比呂志
    • Organizer
      第98回SIG-FPAI研究会
    • Place of Presentation
      和歌山市
    • Year and Date
      2015-08-07
    • Related Report
      2015 Annual Research Report
  • [Presentation] ストリーム中の頻出アイテムの発見のためのSimple Algorithmの高速化2015

    • Author(s)
      岩崎暁, 坂本比呂志
    • Organizer
      第98回SIG-FPAI研究会
    • Place of Presentation
      和歌山市
    • Year and Date
      2015-08-07
    • Related Report
      2015 Annual Research Report
  • [Presentation] 文法圧縮のための逆引き辞書の省スペース化2015

    • Author(s)
      高畠嘉将, 坂本比呂志
    • Organizer
      第98回SIG-FPAI研究会
    • Place of Presentation
      和歌山市
    • Year and Date
      2015-08-07
    • Related Report
      2015 Annual Research Report
  • [Presentation] 移動付き編集距離に基づく曖昧検索が可能な圧縮索引2015

    • Author(s)
      中島 健太,前田 幸司,高畠 嘉将,坂本 比呂志
    • Organizer
      第97回 SIG-FPAI研究会
    • Place of Presentation
      別府国際コンベンションセンター
    • Year and Date
      2015-03-22 – 2015-03-23
    • Related Report
      2014 Annual Research Report
  • [Presentation] 移動付き編集距離のオンラインパターンマッチング2015

    • Author(s)
      高畠 嘉将,田部井 靖生,坂本 比呂志
    • Organizer
      第97回 SIG-FPAI研究会
    • Place of Presentation
      別府国際コンベンションセンター
    • Year and Date
      2015-03-22 – 2015-03-23
    • Related Report
      2014 Annual Research Report
  • [Presentation] 文法圧縮に基づく自己索引のオンライン構築について2015

    • Author(s)
      高畠 嘉将,田部井 靖生,坂本 比呂志
    • Organizer
      第96回 SIG-FPAI研究会
    • Place of Presentation
      名古屋工業大学
    • Year and Date
      2015-01-13 – 2015-01-14
    • Related Report
      2014 Annual Research Report
  • [Presentation] 文法圧縮を応用したハミング距離計算の高速化2014

    • Author(s)
      前田幸司, 高畠嘉将, 田部井靖生, 坂本比呂志
    • Organizer
      第95回 SIG-FPAI研究会
    • Place of Presentation
      大阪大学産業科学研究所
    • Year and Date
      2014-10-10
    • Related Report
      2014 Annual Research Report
  • [Presentation] Grammar Compression: Grammatical Inference by Compression and Its Application to Real Data2014

    • Author(s)
      Hiroshi Sakamoto
    • Organizer
      12th International Conference on Grammatical Inference
    • Place of Presentation
      Kyoto University
    • Year and Date
      2014-09-17 – 2014-09-19
    • Related Report
      2014 Annual Research Report
    • Invited
  • [Presentation] 乱択アルゴリズムを用いた頻出文字列の近似数え上げに基づく省スペース文法圧縮2014

    • Author(s)
      宮木 亮洋,坂本 比呂志
    • Organizer
      第94回 SIG-FPAI研究会
    • Place of Presentation
      根室市総合文化会館
    • Year and Date
      2014-07-24
    • Related Report
      2014 Annual Research Report
  • [Presentation] 文法圧縮を応用したハミング距離の短い文字列列挙アルゴリズム2014

    • Author(s)
      前田幸司,高畠嘉将,田部井靖生,坂本比呂志
    • Organizer
      第94回 SIG-FPAI研究会
    • Place of Presentation
      根室市総合文化会館
    • Year and Date
      2014-07-24
    • Related Report
      2014 Annual Research Report
  • [Remarks] 坂本研HP

    • URL

      http://www.donald.ai.kyutech.ac.jp/~hiroshi/index.html

    • Related Report
      2016 Annual Research Report
  • [Remarks] 坂本比呂志

    • URL

      http://www.donald.ai.kyutech.ac.jp/~hiroshi/index.html

    • Related Report
      2015 Annual Research Report
  • [Remarks] 山際伸一

    • URL

      http://www.cs.tsukuba.ac.jp/~yamagiwa/jp/index.php

    • Related Report
      2015 Annual Research Report
  • [Remarks] 榎田修一

    • Related Report
      2015 Annual Research Report
  • [Patent(Industrial Property Rights)] データ圧縮・解凍システム、データ圧縮 方法及びデータ解凍方法並びにデータ圧縮器及びデータ解凍器2016

    • Inventor(s)
      山際伸一・坂本比呂志
    • Industrial Property Rights Holder
      山際伸一・坂本比呂志
    • Industrial Property Rights Type
      特許
    • Filing Date
      2016-03-24
    • Related Report
      2015 Annual Research Report
    • Overseas
  • [Patent(Industrial Property Rights)] データ圧縮・解凍システム、データ圧縮方法及びデータ解凍方法、並びにデータ圧縮器及びデータ解凍器2015

    • Inventor(s)
      坂本比呂志、山際伸一
    • Industrial Property Rights Holder
      坂本比呂志、山際伸一
    • Industrial Property Rights Type
      特許
    • Industrial Property Number
      2015-063449
    • Filing Date
      2015-03-25
    • Related Report
      2014 Annual Research Report

URL: 

Published: 2014-04-04   Modified: 2019-03-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi