Real-time Analytics Frameworks for Big Heterogeneous Data in Composite Parallel Computing Environments

• Project/Area Number: 26280037
• Research Category: Grant-in-Aid for Scientific Research (B)
• Allocation Type: Partial Multi-year Fund
• Section: 一般
• Research Field: Multimedia database
• Research Institution: University of Tsukuba
• Principal Investigator: KITAGAWA HIROYUKI 筑波大学, 計算科学研究センター, 教授 (00204876)
• Co-Investigator(Kenkyū-buntansha): 天笠 俊之 筑波大学, システム情報系, 准教授 (70314531) ; 早瀬 康裕 筑波大学, システム情報系, 助教 (40423090) ; 渡辺 知恵美 筑波大学, システム情報系, 助教 (20362832) ; 塩川 浩昭 筑波大学, 計算科学研究センター, 助教 (90775248)
• Co-Investigator(Renkei-kenkyūsha): TAKAHASHI DAISUKE 筑波大学, 計算科学研究センター, 教授 (00292714) ; WATANABE YOUSUKE 名古屋大学, 未来社会創造機構, 准教授 (80532944)
• Project Period (FY): 2014-04-01 – 2017-03-31
• Project Status: Completed (Fiscal Year 2016)
• Budget Amount: ¥17,160,000 (Direct Cost: ¥13,200,000、Indirect Cost: ¥3,960,000); Fiscal Year 2016: ¥4,940,000 (Direct Cost: ¥3,800,000、Indirect Cost: ¥1,140,000); Fiscal Year 2015: ¥5,980,000 (Direct Cost: ¥4,600,000、Indirect Cost: ¥1,380,000); Fiscal Year 2014: ¥6,240,000 (Direct Cost: ¥4,800,000、Indirect Cost: ¥1,440,000)
• Keywords: 大規模不均質データ / データ分析 / 複合型並列計算環境

Outline of Final Research Achievements

The goal is to develop real-time analytics frameworks for big heterogeneous data in composite parallel computing environments. The main research outcomes cover the following topics: data modeling and data description for big heterogeneous data analytics, system architecture implementing the data model, massively parallel GPU-based data analytics, high performance data analytics using many core processors, efficient data analytics using incremental computation, semistructured stream filtering using intrinsic structures and keywords, real-time matching of multiple text streams, keyword query processing of multiple relational streams, and generation of optimal data analytics plans including fine grain and coarse grain data processing.

Research Products

• [Journal Article] SCAN-XP: Parallel Structural Graph Clustering Algorithm on Intel Xeon Phi Coprocessors (2017)
  • Author(s): Tomokatsu Takahashi, Hiroaki Shiokawa, Hiroyuki Kitagawa
  • Journal Title: Proc. 2nd ACM SIGMOD Workshop on Network Data Analytics (NDA 2017) Volume: －
  • Peer Reviewed / Open Access / Acknowledgement Compliant
• [Journal Article] Grid-Index Algorithm for Reverse Rank Queries (2017)
  • Author(s): Yuyang Dong, Hanxiong Chen, Jeffrey Xu Yu, Kazutaka Furuse
  • Journal Title: Proc. 20th International Conference on Extending Database Technology (EDBT 2017 Volume: － Pages: 306-317
  • Peer Reviewed / Open Access / Acknowledgement Compliant
• [Journal Article] Accelerating Set Similarity Joins Using GPUs (2016)
  • Author(s): Mateus S. H. Cruz,Yusuke Kozawa, Toshiyuki Amagasa, Hiroyuki Kitagawa
  • Journal Title: Transactions on Large-Scale Data and Knowledge-Centered Systems XXVIII: Special Issue on Database and Expert Systems Applications (TLDKS) Volume: － Pages: 1-22
  • DOI: 10.1007/978-3-662-53455-7_1
  • ISBN: 9783662534540, 9783662534557
  • Peer Reviewed / Open Access / Acknowledgement Compliant
• [Journal Article] Local Attention Analysis and Prediction of Online News Articles in Twitter (2016)
  • Author(s): Saki Nagaki, Yuto Yamaguchi, Toshiyuki Amagasa, and Hiroyuki Kitagawa
  • Journal Title: International Workshop On Mobile Ubiquitous Systems, Infrastructures, Communications, And Applications (MUSICAL 2016) Volume: － Pages: 131-136
  • DOI: 10.1145/3004010.3004042
  • Peer Reviewed / Open Access / Acknowledgement Compliant
• [Journal Article] JsFlow: Integration of Massive Streams and Batches via JSON-based Dataflow Algebra (2016)
  • Author(s): Hirotoshi Cho, Hiroaki Shiokawa and Hiroyuki Kitagawa
  • Journal Title: Proc. 19th International Conference on Network-Based Information Systems (NBiS 2016) Volume: － Pages: 188-195
  • DOI: 10.1109/nbis.2016.1
  • Peer Reviewed / Open Access / Acknowledgement Compliant
• [Journal Article] GPU Acceleration of Content-based Image Retrieval based on SIFT Descriptors (2016)
  • Author(s): Yuta Kusamura, Yusuke Kozawa, Toshiyuki Amagasa, and Hiroyuki Kitagaw
  • Journal Title: Proc. the 5th International Workshop on Advances in Data Engineering and Mobile Computing in conjunction with NBiS2016(DEMoC2016) Volume: － Pages: 342-347
  • DOI: 10.1109/nbis.2016.55
  • Peer Reviewed / Open Access / Acknowledgement Compliant
• [Journal Article] An Improved Method of Keyword Search over Relational Data Streams by Aggressive Candidate Network Consolidation (2016)
  • Author(s): Savong Bou, Toshiyuki Amagasa, Hiroyuki Kitagawa
  • Journal Title: Proc. 27th International Conference on Database and Expert Systems Applications (DEXA 2016) Volume: － Pages: 336-351
  • DOI: 10.1007/978-3-319-44403-1_21
  • ISBN: 9783319444024, 9783319444031
  • Peer Reviewed / Open Access / Acknowledgement Compliant
• [Journal Article] Collaborative Filtering with Implicit Feedbacks by Discounting Positive Feedbacks (2016)
  • Author(s): Kento Kawai, Hiroyuki Kitagawa
  • Journal Title: Proc. 2nd IEEE International Conference on Multimedia Big Data (IEEE BigMM 2016) Volume: － Pages: 41-48
  • DOI: 10.1109/bigmm.2016.30
  • Peer Reviewed / Open Access / Acknowledgement Compliant
• [Journal Article] オンラインニュースに関連するツイートのリアルタイムな収集 (2016)
  • Author(s): 大西 誠, 北川 博之
  • Journal Title: 日本データベース学会和文論文誌 Volume: Vol.14 ,No.4
  • Peer Reviewed / Acknowledgement Compliant
• [Journal Article] Facet-value Extraction Scheme from Textual Contents in XML Data (2015)
  • Author(s): Takahiro Komamizu, Toshiyuki Amagasa, and Hiroyuki Kitagawa
  • Journal Title: International Journal of Web Information Systems (IJWIS) Volume: Vol. 11 Issue: 3 Pages: 270-290
  • DOI: 10.1108/ijwis-04-2015-0012
  • Peer Reviewed / Acknowledgement Compliant
• [Journal Article] Path-based Keyword Search over XML Streams (2015)
  • Author(s): Savong Bou, Toshiyuki Amagasa, and Hiroyuki Kitagawa
  • Journal Title: International Journal of Web Information Systems (IJWIS) Volume: Vol. 11 Issue: 3 Pages: 347-369
  • DOI: 10.1108/ijwis-04-2015-0013
  • Peer Reviewed / Acknowledgement Compliant
• [Journal Article] GPUを用いたCanopyクラスタリングの高速化 (2015)
  • Author(s): 林 史尊, 小澤 佑介, 天笠 俊之, 北川 博之
  • Journal Title: 日本データベース学会論文誌 Volume: Vol. 13-J, No. 2 Pages: 13-18
  • NAID: 40020372348
  • Peer Reviewed / Open Access / Acknowledgement Compliant
• [Journal Article] Extracting Facets from Textual Contents for Faceted Search over XML Data (2014)
  • Author(s): Takahiro Komamizu, Toshiyuki Amagasa and Hiroyuki Kitagawa
  • Journal Title: Proc. 16th International Conference on Information Integration and Web-based Applications & Services (iiWAS 2014) Volume: - Pages: 420-429
  • DOI: 10.1145/2684200.2684294
  • Peer Reviewed / Acknowledgement Compliant
• [Journal Article] Filtering XML Streams by XPath and Keywords (2014)
  • Author(s): Savong Bou, Toshiyuki Amagasa and Hiroyuki Kitagawa
  • Journal Title: Proc. 16th International Conference on Information Integration and Web-based Applications & Services (iiWAS 2014) Volume: - Pages: 410-419
  • DOI: 10.1145/2684200.2684309
  • Peer Reviewed / Acknowledgement Compliant
• [Presentation] Grid-Index Algorithm for Reverse Rank Queries (2017)
  • Author(s): Yuyang Dong, Hanxiong Chen, Jeffrey Xu Yu, Kazutaka Furuse, Hiroyuki Kitagawa
  • Organizer: 20th International Conference on Extending Database Technology (EDBT 2017)
  • Place of Presentation: Congress Center of the San Servolo Island(イタリア・ベニス)
  • Year and Date: 2017-03-21
  • Int'l Joint Research
• [Presentation] 大規模グラフに対する逐次的なノードの枝刈りを用いたObjectRankの高速化 (2017)
  • Author(s): 佐藤 朋紀, 塩川 浩昭, 北川 博之
  • Organizer: 情報処理学会第79回全国大会 (IPSJ全国大会 2017)
  • Place of Presentation: 名古屋大学(愛知県名古屋市）
  • Year and Date: 2017-03-16
• [Presentation] メニーコアプロセッサを用いた集合間類似結合の高速化 (2017)
  • Author(s): 菅野 健太, 天笠 俊之, 北川 博之
  • Organizer: 情報処理学会第79回全国大会 (IPSJ全国大会 2017)
  • Place of Presentation: 名古屋大学(愛知県名古屋市）
  • Year and Date: 2017-03-16
• [Presentation] ストリーム処理とバッチ処理の統合と実行最適化 (2017)
  • Author(s): 長 裕敏, 塩川 浩昭, 北川 博之
  • Organizer: 第9回データ工学と情報マネジメントに関するフォーラム (DEIM 2017)
  • Place of Presentation: 高山グリーンホテル（岐阜県高山市）
  • Year and Date: 2017-03-06
• [Presentation] メニーコアプロセッサを用いた構造的類似度に基づくグラフクラスタリングの高速化 (2017)
  • Author(s): 高橋 知克, 塩川 浩昭, 北川 博之
  • Organizer: 第9回データ工学と情報マネジメントに関するフォーラム (DEIM 2017)
  • Place of Presentation: 高山グリーンホテル（岐阜県高山市）
  • Year and Date: 2017-03-06
• [Presentation] SIFT特徴量を用いた画像検索のGPUによる高速化 (2017)
  • Author(s): 草村 優太, 天笠 俊之, 北川 博之
  • Organizer: 第9回データ工学と情報マネジメントに関するフォーラム (DEIM 2017)
  • Place of Presentation: 高山グリーンホテル（岐阜県高山市）
  • Year and Date: 2017-03-06
• [Presentation] 大規模グラフに対するObjectRankの高速化 (2017)
  • Author(s): 佐藤 朋紀, 塩川 浩昭, 山口 祐人, 北川 博之
  • Organizer: 第9回データ工学と情報マネジメントに関するフォーラム (DEIM 2017)
  • Place of Presentation: 高山グリーンホテル（岐阜県高山市）
  • Year and Date: 2017-03-06
• [Presentation] SCAN-XP: Parallel Structural Graph Clustering Algorithm on Intel Xeon Phi Coprocessors (2017)
  • Author(s): Tomokatsu Takahashi, Hiroaki Shiokawa, Hiroyuki Kitagawa
  • Organizer: 2nd ACM SIGMOD Workshop on Network Data Analytics (NDA 2017)
  • Place of Presentation: Hilton Chicago(アメリカ合衆国・シカゴ)
  • Int'l Joint Research
• [Presentation] Local Attention Analysis and Prediction of Online News Articles in Twitter (2016)
  • Author(s): Saki Nagaki, Yuto Yamaguchi, Toshiyuki Amagasa, and Hiroyuki Kitagawa
  • Organizer: International Workshop On Mobile Ubiquitous Systems, Infrastructures, Communications, And Applications (MUSICAL 2016)
  • Place of Presentation: 広島国際会議場(広島県広島市）
  • Year and Date: 2016-11-28
  • Int'l Joint Research
• [Presentation] データの動的な変化に対応可能な対話的外れ値分析 (2016)
  • Author(s): 坂詰知完, 北川博之, 天笠俊之
  • Organizer: 第9回Webとデータベースに関するフォーラム (WebDB Forum 2016)
  • Place of Presentation: 慶應義塾大学(神奈川県横浜市）
  • Year and Date: 2016-09-13
• [Presentation] GPU Acceleration of Content-based Image Retrieval based on SIFT Descriptors (2016)
  • Author(s): Yuta Kusamura, Yusuke Kozawa, Toshiyuki Amagasa, and Hiroyuki Kitagawa
  • Organizer: 5th International Workshop on Advances in Data Engineering and Mobile Computing in conjunction with NBiS2016 (DEMoC 2016)
  • Place of Presentation: Technical University of Ostrava(チェコ・オストラバ）
  • Year and Date: 2016-09-07
  • Int'l Joint Research
• [Presentation] JsFlow: Integration of Massive Streams and Batches via JSON-based Dataflow Algebra (2016)
  • Author(s): Hirotoshi Cho, Hiroaki Shiokawa and Hiroyuki Kitagawa
  • Organizer: 19th International Conference on Network-Based Information Systems (NBiS 2016)
  • Place of Presentation: Technical University of Ostrava(チェコ・オストラバ）
  • Year and Date: 2016-09-07
  • Int'l Joint Research
• [Presentation] An Improved Method of Keyword Search over Relational Data Streams by Aggressive Candidate Network Consolidation (2016)
  • Author(s): Savong Bou, Toshiyuki Amagasa, Hiroyuki Kitagawa
  • Organizer: 27th International Conference on Database and Expert Systems Applications (DEXA 2016)
  • Place of Presentation: Instituto Superior de Engenharia do Porto(ポルトガル・ポルト)
  • Year and Date: 2016-09-05
  • Int'l Joint Research
• [Presentation] Collaborative Filtering with Implicit Feedbacks by Discounting Positive Feedbacks (2016)
  • Author(s): Kento Kawai, Hiroyuki Kitagawa
  • Organizer: 2nd IEEE International Conference on Multimedia Big Data (IEEE BigMM 2016)
  • Place of Presentation: Howard Civil Service International House(台湾・台北）
  • Year and Date: 2016-04-20
  • Int'l Joint Research
• [Presentation] Collaborative Filtering with Implicit Feedbacks by Discounting Positive Feedbacks (2016)
  • Author(s): Kent Kawai, Hiroyuki Kitagawa
  • Organizer: 2nd IEEE International Conference on Multimedia Big Data (IEEE BigMM 2016),
  • Place of Presentation: Howard Civil Service International House（台湾・台北）
  • Year and Date: 2016-04-20
  • Int'l Joint Research
• [Presentation] GPUを用いた類似画像検索の高速化 (2016)
  • Author(s): 草村 優太，小澤 佑介，天笠 俊之，北川 博之
  • Organizer: 情報処理学会第78回全国大会 (IPSJ全国大会 2016)
  • Place of Presentation: 慶應義塾大学矢上キャンパス（神奈川県横浜市）
  • Year and Date: 2016-03-10
• [Presentation] GPUを用いたラベル伝搬法によるグラフクラスタリングの高速化 (2016)
  • Author(s): 小澤 佑介，天笠 俊之，北川 博之
  • Organizer: 第8回データ工学と情報マネジメントに関するフォーラム (DEIM 2016)
  • Place of Presentation: ヒルトン福岡シーホーク（福岡県福岡市）
  • Year and Date: 2016-02-29
• [Presentation] Efficient Keyword Search over Relational Data Streams (2016)
  • Author(s): Savong Bou, Toshiyuki Amagasa and Hiroyuki Kitagawa
  • Organizer: 第8回データ工学と情報マネジメントに関するフォーラム (DEIM 2016)
  • Place of Presentation: ヒルトン福岡シーホーク（福岡県福岡市）
  • Year and Date: 2016-02-29
• [Presentation] オンラインニュースとツイートのリアルタイムマッチング手法 (2016)
  • Author(s): 大西 誠，山口 祐人，北川 博之
  • Organizer: 第8回データ工学と情報マネジメントに関するフォーラム (DEIM 2016)
  • Place of Presentation: ヒルトン福岡シーホーク（福岡県福岡市）
  • Year and Date: 2016-02-29
• [Presentation] 高水準言語で記述可能なストリーム処理とバッチ処理の統合フレームワーク (2016)
  • Author(s): 長 裕敏，塩川 浩昭, 北川 博之
  • Organizer: 第8回データ工学と情報マネジメントに関するフォーラム (DEIM 2016)
  • Place of Presentation: ヒルトン福岡シーホーク（福岡県福岡市）
  • Year and Date: 2016-02-29
• [Presentation] Real-Time Relevance Matching of News and Tweets (2015)
  • Author(s): Sei Onishi, Yuto Yamaguchi, and Hiroyuki Kitagawa
  • Organizer: 23th International Conference on Cooperative Information Systems (CoopIS 2015)
  • Place of Presentation: Hotel Aldemar Amilia Mare Resort （ギリシャ・ロードス）
  • Year and Date: 2015-10-28
  • Int'l Joint Research
• [Presentation] Parallel Canopy Clustering on GPUs (2015)
  • Author(s): Yusuke Kozawa, Fumitaka Hayashi, Toshiyuki Amagasa, and Hiroyuki Kitagawa
  • Organizer: 26th International Conference on Database and Expert Systems Applications (DEXA 2015)
  • Place of Presentation: Universitat Politecnica de Valencia （スペイン・バレンシア）
  • Year and Date: 2015-09-01
  • Int'l Joint Research
• [Presentation] GPU Acceleration of Set Similarity Joins (2015)
  • Author(s): Mateus S. H. Cruz, Yusuke Kozawa, Toshiyuki Amagasa, and Hiroyuki Kitagawa
  • Organizer: 26th International Conference on Database and Expert Systems Applications (DEXA 2015)
  • Place of Presentation: Universitat Politecnica de Valencia （スペイン・バレンシア）
  • Year and Date: 2015-09-01
  • Int'l Joint Research
• [Presentation] Continuous Angle-based Outlier Detection on High-dimensional Data Streams (2015)
  • Author(s): Hao Ye, Hiroyuki Kitagawa, and Jun Xiao
  • Organizer: the 19th International Database Engineering & Applications Symposium (IDEAS 2015)
  • Place of Presentation: 慶應義塾大学日吉キャンパス（神奈川県横浜市）
  • Year and Date: 2015-07-13
  • Int'l Joint Research
• [Presentation] 半構造データに対するストリーム処理とバッチ処理の統合フレームワーク (2015)
  • Author(s): 長 裕敏, 王 岩, 北川 博之, 天笠 俊之
  • Organizer: 情報処理学会第77回全国大会 (IPSJ全国大会 2015)
  • Place of Presentation: 京都大学吉田キャンパス（京都府）
  • Year and Date: 2015-03-19
• [Presentation] オンラインニュースに関連するツイートのリアルタイムな収集 (2015)
  • Author(s): 大西 誠, 北川 博之
  • Organizer: 第7回データ工学と情報マネジメントに関するフォーラム (DEIM 2015)
  • Place of Presentation: 磐梯熱海ホテル華の湯（福島県）
  • Year and Date: 2015-03-04
• [Presentation] An Improved Method of Keyword Search over Relational Data Streams (2015)
  • Author(s): Savong Bou, Toshiyuki Amagasa, and Hiroyuki Kitagawa
  • Organizer: 第7回データ工学と情報マネジメントに関するフォーラム (DEIM 2015)
  • Place of Presentation: 磐梯熱海ホテル華の湯（福島県）
  • Year and Date: 2015-03-02
• [Presentation] Efficient Set Similarity Join on Graphics Processors (2015)
  • Author(s): Silqueira Hickson Cruz Mateus, 小澤 佑介, 天笠 俊之, 北川 博之
  • Organizer: 第7回データ工学と情報マネジメントに関するフォーラム (DEIM 2015)
  • Place of Presentation: 磐梯熱海ホテル華の湯（福島県）
  • Year and Date: 2015-03-02