Knowledge discovery and data classification based on string compression

• Project/Area Number: 25280086
• Research Category: Grant-in-Aid for Scientific Research (B)
• Allocation Type: Partial Multi-year Fund
• Section: 一般
• Research Field: Intelligent informatics
• Research Institution: Kyushu University
• Principal Investigator: Bannai Hideo 九州大学, システム情報科学研究科(研究院, 准教授 (20323644)
• Co-Investigator(Kenkyū-buntansha): 稲永 俊介 九州大学, システム情報科学研究科(研究院, 准教授 (60448404)
• Research Collaborator: GOTO Keisuke ; NAKASHIMA Yuto ; NISHIMOTO Takaaki
• Project Period (FY): 2013-04-01 – 2017-03-31
• Project Status: Completed (Fiscal Year 2016)
• Budget Amount: ¥14,430,000 (Direct Cost: ¥11,100,000、Indirect Cost: ¥3,330,000); Fiscal Year 2015: ¥4,290,000 (Direct Cost: ¥3,300,000、Indirect Cost: ¥990,000); Fiscal Year 2014: ¥5,590,000 (Direct Cost: ¥4,300,000、Indirect Cost: ¥1,290,000); Fiscal Year 2013: ¥4,550,000 (Direct Cost: ¥3,500,000、Indirect Cost: ¥1,050,000)
• Keywords: 圧縮文字列処理 / SLP / 繰り返し構造 / LZ78 / LZ77 / 連 / 最長共通接頭辞 / 文法圧縮 / 省領域アルゴリズム / 動的索引 / LZ 分解

Outline of Final Research Achievements

We worked mainly on developing compressed string processing algorithms for various problems for extracting characteristics of strings from straight line program (SLP) representation of strings. We developed time and space efficient algorithms for computing runs, Lyndon factorizations, LZ78 factorization, LZ77 factorizations, etc. Furthermore, we affirmatively solved the “runs conjecture”, which was open for 15 years.

Research Products

• [Journal Article] Deterministic sub-linear space LCE data structures with efficient construction (2016)
  • Author(s): Yuka Tanimura, Tomohiro I, Hideo Bannai, Shunsuke Inenaga, Simon Puglisi, Masayuki Takeda
  • Journal Title: Proceedings of the 27th Annual Symposium on Combinatorial Pattern Matching (CPM 2016) Volume: -
  • Peer Reviewed / Int'l Joint Research / Acknowledgement Compliant
• [Journal Article] Constructing LZ78 tries and position heaps in linear time for large alphabets (2015)
  • Author(s): Yuto Nakashima, Tomohiro I ,Shunsuke Inenaga, Hideo Bannai , Masayuki Takeda
  • Journal Title: Inf. Process. Lett. Volume: 115(9) Issue: 9 Pages: 655-659
  • DOI: 10.1016/j.ipl.2015.04.002
  • Peer Reviewed / Int'l Joint Research
• [Journal Article] Compressed automata for dictionary matching (2015)
  • Author(s): Tomohiro I, Takaaki Nishimoto, Shunsuke Inenaga , Hideo Bannai, Masayuki Takeda
  • Journal Title: Theor. Comput. Sci. Volume: 578 Pages: 30-41
  • DOI: 10.1016/j.tcs.2015.01.019
  • Peer Reviewed
• [Journal Article] Inferring Strings from Full Abelian Periods (2015)
  • Author(s): Makoto Nishida, Tomohiro I, Shunsuke Inenaga, Hideo Bannai, Masayuki Takeda
  • Journal Title: Proceedings of the 26th International Symposium on Algorithms and Computation (ISAAC 2015) Volume: LNCS 9472 Pages: 768-779
  • DOI: 10.1007/978-3-662-48971-0_64
  • ISBN: 9783662489703, 9783662489710
  • Peer Reviewed / Int'l Joint Research
• [Journal Article] Efficient Algorithms for Longest Closed Factor Array (2015)
  • Author(s): Hideo Bannai, Shunsuke Inenaga, Tomasz Kociumaka, Arnaud Lefebvre, Jakub Radoszewski, Wojciech Rytter, Shiho Sugimoto and Tomasz Walen
  • Journal Title: SPIRE 2015 Volume: SPIRE 2015 Pages: 95-102
  • DOI: 10.1007/978-3-319-23826-5_10
  • ISBN: 9783319238258, 9783319238265
  • Peer Reviewed / Int'l Joint Research
• [Journal Article] A faster algorithm for computing maximal α-gapped repeats in a string (2015)
  • Author(s): Yuka Tanimura, Yuta Fujishige, Tomohiro I, Shunsuke Inenaga, Hideo Bannai and Masayuki Takeda
  • Journal Title: SPIRE 2015 Volume: SPIRE 2015 Pages: 124-136
  • DOI: 10.1007/978-3-319-23826-5_13
  • ISBN: 9783319238258, 9783319238265
  • Peer Reviewed / Int'l Joint Research
• [Journal Article] Computing Left-Right Maximal Generic Words (2015)
  • Author(s): Takaaki Nishimoto, Yuto Nakashima, Shunsuke Inenaga, Hideo Bannai, Masayuki Takeda
  • Journal Title: Proceedings of The Prague Stringology Conference 2015 (PSC 2015) Volume: - Pages: 5-16
  • Peer Reviewed
• [Journal Article] Semi-dynamic compact index for short patterns and succinct van Emde Boas tree (2015)
  • Author(s): Yoshiaki Matsuoka, Tomohiro I, Shunsuke Inenaga, Hideo Bannai, and Masayuki Takeda
  • Journal Title: CPM 2015 Volume: CPM 2015 Pages: 355-366
  • DOI: 10.1007/978-3-319-19929-0_30
  • ISBN: 9783319199283, 9783319199290
  • Peer Reviewed / Int'l Joint Research
• [Journal Article] LZD Factorization: Simple and Practical Online Grammar Compression with Variable-to-Fixed Encoding (2015)
  • Author(s): Keisuke Goto, Hideo Bannai, Shunsuke Inenaga, and Masayuki Takeda
  • Journal Title: CPM 2015 Volume: CPM 2015 Pages: 219-230
  • DOI: 10.1007/978-3-319-19929-0_19
  • ISBN: 9783319199283, 9783319199290
  • Peer Reviewed
• [Journal Article] An opportunistic text indexing structure based on run length encoding (2015)
  • Author(s): Yuya Tamakoshi, Keisuke Goto, Shunsuke Inenaga, Hideo Bannai, and Masayuki Takeda
  • Journal Title: CIAC 2015 Volume: CIAC 2015 Pages: 390-402
  • DOI: 10.1007/978-3-319-18173-8_29
  • ISBN: 9783319181721, 9783319181738
  • Peer Reviewed
• [Journal Article] Detecting regularities on grammar-compressed strings (2015)
  • Author(s): Tomohiro I, Wataru Matsubara, Kouji Shimohira, Shunsuke Inenaga, Hideo Bannai, Masayuki Takeda, Kazuyuki Narisawa, and Ayumi Shinohara
  • Journal Title: Information and Computation Volume: 240 Pages: 74-89
  • DOI: 10.1016/j.ic.2014.09.009
  • Peer Reviewed
• [Journal Article] A new characterization of maximal repetitions by Lyndon trees (2015)
  • Author(s): Hideo Bannai, Tomohiro I, Shunsuke Inenaga, Yuto Nakashima, Masayuki Takeda, Kazuya Tsuruta
  • Journal Title: SODA 2015 Volume: SODA2015 Pages: 562-571
  • DOI: 10.1137/1.9781611973730.38
  • NAID: 110009977436
  • Peer Reviewed
• [Journal Article] Computing Abelian Covers and Abelian Runs (2014)
  • Author(s): Shohei Matsuda, Shunsuke Inenaga, Hideo Bannai, Masayuki Takeda
  • Journal Title: Proceedings of The Prague Stringology Conference 2014 (PSC 2014) Volume: - Pages: 43-51
  • Peer Reviewed / Open Access
• [Journal Article] Closed Factorization (2014)
  • Author(s): Golnaz Badkobeh, Hideo Bannai, Keisuke Goto, Tomohiro I, Costas S. Iliopoulos, Shunsuke Inenaga, Simon J. Puglisi, Shiho Sugimoto
  • Journal Title: Proceedings of The Prague Stringology Conference 2014 (PSC 2014) Volume: - Pages: 162-168
  • Peer Reviewed / Open Access
• [Journal Article] Inferring Strings from Lyndon Factorization (2014)
  • Author(s): Yuto Nakashima, Takashi Okabe, Tomohiro I, Shunsuke Inenaga, Hideo Bannai, Masayuki Takeda
  • Journal Title: MFCS 2014 Volume: MFCS2014 Pages: 565-576
  • DOI: 10.1007/978-3-662-44465-8_48
  • ISBN: 9783662444641, 9783662444658
  • Peer Reviewed
• [Journal Article] Computing palindromic factorizations and palindromic covers on-line (2014)
  • Author(s): Tomohiro I, Shiho Sugimoto, Shunsuke Inenaga, Hideo Bannai, Masayuki Takeda
  • Journal Title: Proceeding of the 25th Annual Symposium on Combinatorial Pattern Matching (CPM 2014) Volume: LNCS 8486 Pages: 150-161
  • DOI: 10.1007/978-3-319-07566-2_16
  • ISBN: 9783319075655, 9783319075662
  • Peer Reviewed
• [Journal Article] Shortest Unique Substrings Queries in Optimal Time (2014)
  • Author(s): Kazuya Tsuruta, Shunsuke Inenaga, Hideo Bannai, and Masayuki Takeda
  • Journal Title: Proc. the 40th International Conference on Current Trends in Theory and Practice of Computer Science (SOFSEM 2014), Lecture Notes in Computer Science Volume: 8327 Pages: 503-513
  • DOI: 10.1007/978-3-319-04298-5_44
  • ISBN: 9783319042978, 9783319042985
  • Peer Reviewed
• [Journal Article] Faster Compact On-Line Lempel-Ziv Factorization (2014)
  • Author(s): Jun'ichi Yamamoto, Tomohiro I, Hideo Bannai, Shunsuke Inenaga, and Masayuki Takeda
  • Journal Title: Proc. the 31st Symposium on Theoretical Aspects of Computer Science (STACS 2014) Volume: - Pages: 675-686
  • DOI: 10.4230/LIPIcs.STACS.2014.675
  • Peer Reviewed
• [Journal Article] Space Efficient Linear Time Lempel-Ziv Factorization for Small Alphabets (2014)
  • Author(s): Keisuke Goto and Hideo Bannai
  • Journal Title: Proc. Data Compression Conference 2014 (DCC 2014) Volume: DCC2014 Pages: 163-172
  • DOI: 10.1109/dcc.2014.62
  • Peer Reviewed
• [Journal Article] Efficient Lyndon factorization of grammar compressed text (2013)
  • Author(s): Tomohiro I, Yuto Nakashima, Shunsuke Inenaga, Hideo Bannai and Masayuki Takeda
  • Journal Title: In Proc. 24th Annual Symposium on Combinatorial Pattern Matching (CPM 2013), Lecture Notes in Computer Science Volume: 7922 Pages: 153-164
  • DOI: 10.1007/978-3-642-38905-4_16
  • ISBN: 9783642389047, 9783642389054
  • Peer Reviewed
• [Journal Article] Converting SLP to LZ78 in almost linear time (2013)
  • Author(s): Hideo Bannai, Pawel Gawrychowski, Shunsuke Inenaga, and Masayuki Takeda
  • Journal Title: In Proc. 24th Annual Symposium on Combinatorial Pattern Matching (CPM 2013), Lecture Notes in Computer Science Volume: 7922 Pages: 38-49
  • DOI: 10.1007/978-3-642-38905-4_6
  • ISBN: 9783642389047, 9783642389054
  • Peer Reviewed
• [Journal Article] Compressed Automata for Dictionary Matching (2013)
  • Author(s): Tomohiro I, Takaaki Nishimoto, Shunsuke Inenaga, Hideo Bannai and Masayuki Takeda
  • Journal Title: In Proc. the 18th International Conference on Implementation and Application of Automata (CIAA 2013), Lecture Notes in Computer Science Volume: 7982 Pages: 319-330
  • DOI: 10.1007/978-3-642-39274-0_28
  • ISBN: 9783642392733, 9783642392740
  • Peer Reviewed
• [Journal Article] Detecting Regularities on Grammar-compressed Strings (2013)
  • Author(s): Tomohiro I, Wataru Matsubara, Kouji Shimohira, Shunsuke Inenaga, Hideo Bannai, Masayuki Takeda, Kazuyuki Narisawa, Ayumi Shinohara
  • Journal Title: In Proc. the 38th International Symposium on Mathematical Foundations of Computer Science (MFCS 2013), Lecture Notes in Computer Science Volume: 8087 Pages: 571-582
  • DOI: 10.1007/978-3-642-40313-2_51
  • ISBN: 9783642403125, 9783642403132
  • Peer Reviewed
• [Journal Article] Computing Reversed Lempel-Ziv Factorization Online (2013)
  • Author(s): Shiho Sugimoto, Tomohiro I, Shunsuke Inenaga, Hideo Bannai, Masayuki Takeda
  • Journal Title: Proc. The Prague Stringology Conference 2013 (PSC 2013) Volume: PSC2013 Pages: 107-118
  • Peer Reviewed
• [Journal Article] Faster Lyndon Factorization Algorithms for SLP and LZ78 Compressed Text (2013)
  • Author(s): Tomohiro I, Yuto Nakashima, Shunsuke Inenaga, Hideo Bannai and Masayuki Takeda
  • Journal Title: In Proc. the 20th Symposium on String Processing and Information Retrieval (SPIRE 2013), Lecture Notes in Computer Science Volume: 8214 Pages: 174-185
  • DOI: 10.1007/978-3-319-02432-5_21
  • ISBN: 9783319024318, 9783319024325
  • Peer Reviewed
• [Presentation] Deterministic Sub-Linear Space LCE Data Structures With Efficient Construction (2016)
  • Author(s): Yuka Tanimura, Tomohiro I, Hideo Bannai, Shunsuke Inenaga, Simon Puglisi, Masayuki Takeda
  • Organizer: 27th Annual Symposium on Combinatorial Pattern Matching (CPM 2016)
  • Place of Presentation: テルアビブ
  • Year and Date: 2016-06-27
  • Int'l Joint Research
• [Presentation] Inferring Strings from Full Abelian Periods (2015)
  • Author(s): Makoto Nishida, Tomohiro I, Shunsuke Inenaga, Hideo Bannai, Masayuki Takeda
  • Organizer: 26th International Symposium on Algorithms and Computation (ISAAC 2015)
  • Place of Presentation: 名古屋
  • Year and Date: 2015-12-09
  • Int'l Joint Research
• [Presentation] Efficient Algorithms for Longest Closed Factor Array (2015)
  • Author(s): Hideo Bannai, Shunsuke Inenaga, Tomasz Kociumaka, Arnaud Lefebvre, Jakub Radoszewski, Wojciech Rytter, Shiho Sugimoto, Tomasz Walen
  • Organizer: 22nd International Symposium on String Processing and Information Retrieval (SPIRE 2015)
  • Place of Presentation: ロンドン
  • Year and Date: 2015-09-01
  • Int'l Joint Research
• [Presentation] A Faster Algorithm for Computing Maximal alpha-gapped Repeats in a String (2015)
  • Author(s): Yuka Tanimura, Yuta Fujishige, Tomohiro I, Shunsuke Inenaga, Hideo Bannai, Masayuki Takeda
  • Organizer: 22nd International Symposium on String Processing and Information Retrieval (SPIRE 2015)
  • Place of Presentation: ロンドン
  • Year and Date: 2015-09-01
  • Int'l Joint Research
• [Presentation] Computing Left-Right Maximal Generic Words (2015)
  • Author(s): Takaaki Nishimoto, Yuto Nakashima, Shunsuke Inenaga, Hideo Bannai, Masayuki Takeda
  • Organizer: The Prague Stringology Conference 2015 (PSC 2015)
  • Place of Presentation: プラハ
  • Year and Date: 2015-08-24
  • Int'l Joint Research
• [Presentation] Semi-dynamic compact index for short patterns and succinct van Emde Boas tree (2015)
  • Author(s): Yoshiaki Matsuoka, Tomohiro I, Shunsuke Inenaga, Hideo Bannai, and Masayuki Takeda
  • Organizer: 26th Annual Symposium on Combinatorial Pattern Matching (CPM 2015)
  • Place of Presentation: イスキア
  • Year and Date: 2015-06-29
  • Int'l Joint Research
• [Presentation] LZD Factorization: Simple and Practical Online Grammar Compression with Variable-to-Fixed Encoding (2015)
  • Author(s): Keisuke Goto, Hideo Bannai, Shunsuke Inenaga, Masayuki Takeda
  • Organizer: 26th Annual Symposium on Combinatorial Pattern Matching (CPM 2015)
  • Place of Presentation: イスキア
  • Year and Date: 2015-06-29
  • Int'l Joint Research
• [Presentation] An opportunistic text indexing structure based on run length encoding (2015)
  • Author(s): Yuya Tamakoshi, Keisuke Goto, Shunsuke Inenaga, Hideo Bannai, and Masayuki Takeda
  • Organizer: 9th International Conference on Algorithms and Complexity (CIAC 2015)
  • Place of Presentation: パリ
  • Year and Date: 2015-05-20
  • Int'l Joint Research
• [Presentation] Semi-dynamic compact index for short patterns and succinct van Emde Boas tree (2015)
  • Author(s): Yoshiaki Matsuoka, Tomohiro I, Shunsuke Inenaga, Hideo Bannai, Masayuki Takeda
  • Organizer: London Stringology Days/London Algorithmic Workshop 2015
  • Place of Presentation: London, United Kingdom
  • Year and Date: 2015-02-05 – 2015-02-06
• [Presentation] 動的な圧縮索引 (2015)
  • Author(s): 西本 崇晃, 井 智弘, 稲永 俊介, 坂内 英夫, 竹田 正幸
  • Organizer: LAシンポジウム 2014 冬
  • Place of Presentation: 京都大学
  • Year and Date: 2015-01-28 – 2015-01-30
• [Presentation] A new characterization of maximal repetitions by Lyndon trees (2015)
  • Author(s): Hideo Bannai, Tomohiro I, Shunsuke Inenaga, Yuto Nakashima, Masayuki Takeda, Kazuya Tsuruta
  • Organizer: The 26th Annual ACM-SIAM Symposium on Discrete Algorithms (SODA'15)
  • Place of Presentation: San Diego, USA
  • Year and Date: 2015-01-04 – 2015-01-06
• [Presentation] Lyndon木による連の特徴付け (2014)
  • Author(s): 坂内英夫，井 智弘、稲永 俊介，中島 祐人，竹田 正幸，鶴田 和弥
  • Organizer: コンピュテーション研究会
  • Place of Presentation: 崇城大学
  • Year and Date: 2014-12-05
  • Invited
• [Presentation] Computing Abelian Covers and Abelian Runs (2014)
  • Author(s): Shohei Matsuda, Shunsuke Inenaga, Hideo Bannai, Masayuki Takeda
  • Organizer: The Prague Stringology Conference 2014 (PSC 2014)
  • Place of Presentation: Prague, Czech Republic
  • Year and Date: 2014-09-01 – 2014-09-03
• [Presentation] Closed Factorization (2014)
  • Author(s): Golnaz Badkobeh, Hideo Bannai, Keisuke Goto, Tomohiro I, Costas S. Iliopoulos, Shunsuke Inenaga, Simon J. Puglisi, Shiho Sugimoto
  • Organizer: The Prague Stringology Conference 2014 (PSC 2014)
  • Place of Presentation: Prague, Czech Republic
  • Year and Date: 2014-09-01 – 2014-09-03
• [Presentation] Inferring Strings from Lyndon factorization (2014)
  • Author(s): Yuto Nakashima, Takashi Okabe, Tomohiro I, Shunsuke Inenaga, Hideo Bannai, Masayuki Takeda
  • Organizer: The 39th International Symposium on Mathematical Foundations of Computer Science (MFCS 2014)
  • Place of Presentation: Budapest, Hungary
  • Year and Date: 2014-08-25 – 2014-08-29
• [Presentation] Computing palindromic factorizations and palindromic covers on-line (2014)
  • Author(s): Tomohiro I, Shiho Sugimoto, Shunsuke Inenaga, Hideo Bannai, Masayuki Takeda
  • Organizer: The 25th Annual Symposium on Combinatorial Pattern Matching (CPM 2014)
  • Place of Presentation: Moscow, Russia
  • Year and Date: 2014-06-16 – 2014-06-18
• [Presentation] 省スペースオンラインLZ分解 (2014)
  • Author(s): 井 智弘
  • Organizer: 2013 冬の LA シンポジウム
  • Place of Presentation: 京都
• [Presentation] 動的でコンパクトな索引構造 (2014)
  • Author(s): 松岡 禎明
  • Organizer: 2013 冬の LA シンポジウム
  • Place of Presentation: 京都
• [Presentation] 高速かつ省領域な線形時間LZ分解アルゴリズム (2013)
  • Author(s): 後藤啓介
  • Organizer: 第145回アルゴリズム研究会
  • Place of Presentation: 花巻