• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Real-time Analytics Frameworks for Big Heterogeneous Data in Composite Parallel Computing Environments

Research Project

Project/Area Number 26280037
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypePartial Multi-year Fund
Section一般
Research Field Multimedia database
Research InstitutionUniversity of Tsukuba

Principal Investigator

KITAGAWA HIROYUKI  筑波大学, 計算科学研究センター, 教授 (00204876)

Co-Investigator(Kenkyū-buntansha) 天笠 俊之  筑波大学, システム情報系, 准教授 (70314531)
早瀬 康裕  筑波大学, システム情報系, 助教 (40423090)
渡辺 知恵美  筑波大学, システム情報系, 助教 (20362832)
塩川 浩昭  筑波大学, 計算科学研究センター, 助教 (90775248)
Co-Investigator(Renkei-kenkyūsha) TAKAHASHI DAISUKE  筑波大学, 計算科学研究センター, 教授 (00292714)
WATANABE YOUSUKE  名古屋大学, 未来社会創造機構, 准教授 (80532944)
Project Period (FY) 2014-04-01 – 2017-03-31
Project Status Completed (Fiscal Year 2016)
Budget Amount *help
¥17,160,000 (Direct Cost: ¥13,200,000、Indirect Cost: ¥3,960,000)
Fiscal Year 2016: ¥4,940,000 (Direct Cost: ¥3,800,000、Indirect Cost: ¥1,140,000)
Fiscal Year 2015: ¥5,980,000 (Direct Cost: ¥4,600,000、Indirect Cost: ¥1,380,000)
Fiscal Year 2014: ¥6,240,000 (Direct Cost: ¥4,800,000、Indirect Cost: ¥1,440,000)
Keywords大規模不均質データ / データ分析 / 複合型並列計算環境
Outline of Final Research Achievements

The goal is to develop real-time analytics frameworks for big heterogeneous data in composite parallel computing environments. The main research outcomes cover the following topics: data modeling and data description for big heterogeneous data analytics, system architecture implementing the data model, massively parallel GPU-based data analytics, high performance data analytics using many core processors, efficient data analytics using incremental computation, semistructured stream filtering using intrinsic structures and keywords, real-time matching of multiple text streams, keyword query processing of multiple relational streams, and generation of optimal data analytics plans including fine grain and coarse grain data processing.

Report

(4 results)
  • 2016 Annual Research Report   Final Research Report ( PDF )
  • 2015 Annual Research Report
  • 2014 Annual Research Report
  • Research Products

    (42 results)

All 2017 2016 2015 2014

All Journal Article (14 results) (of which Peer Reviewed: 14 results,  Open Access: 9 results,  Acknowledgement Compliant: 14 results) Presentation (28 results) (of which Int'l Joint Research: 12 results)

  • [Journal Article] SCAN-XP: Parallel Structural Graph Clustering Algorithm on Intel Xeon Phi Coprocessors2017

    • Author(s)
      Tomokatsu Takahashi, Hiroaki Shiokawa, Hiroyuki Kitagawa
    • Journal Title

      Proc. 2nd ACM SIGMOD Workshop on Network Data Analytics (NDA 2017)

      Volume: -

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] Grid-Index Algorithm for Reverse Rank Queries2017

    • Author(s)
      Yuyang Dong, Hanxiong Chen, Jeffrey Xu Yu, Kazutaka Furuse
    • Journal Title

      Proc. 20th International Conference on Extending Database Technology (EDBT 2017

      Volume: - Pages: 306-317

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] Accelerating Set Similarity Joins Using GPUs2016

    • Author(s)
      Mateus S. H. Cruz,Yusuke Kozawa, Toshiyuki Amagasa, Hiroyuki Kitagawa
    • Journal Title

      Transactions on Large-Scale Data and Knowledge-Centered Systems XXVIII: Special Issue on Database and Expert Systems Applications (TLDKS)

      Volume: - Pages: 1-22

    • DOI

      10.1007/978-3-662-53455-7_1

    • ISBN
      9783662534540, 9783662534557
    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] Local Attention Analysis and Prediction of Online News Articles in Twitter2016

    • Author(s)
      Saki Nagaki, Yuto Yamaguchi, Toshiyuki Amagasa, and Hiroyuki Kitagawa
    • Journal Title

      International Workshop On Mobile Ubiquitous Systems, Infrastructures, Communications, And Applications (MUSICAL 2016)

      Volume: - Pages: 131-136

    • DOI

      10.1145/3004010.3004042

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] JsFlow: Integration of Massive Streams and Batches via JSON-based Dataflow Algebra2016

    • Author(s)
      Hirotoshi Cho, Hiroaki Shiokawa and Hiroyuki Kitagawa
    • Journal Title

      Proc. 19th International Conference on Network-Based Information Systems (NBiS 2016)

      Volume: - Pages: 188-195

    • DOI

      10.1109/nbis.2016.1

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] GPU Acceleration of Content-based Image Retrieval based on SIFT Descriptors2016

    • Author(s)
      Yuta Kusamura, Yusuke Kozawa, Toshiyuki Amagasa, and Hiroyuki Kitagaw
    • Journal Title

      Proc. the 5th International Workshop on Advances in Data Engineering and Mobile Computing in conjunction with NBiS2016(DEMoC2016)

      Volume: - Pages: 342-347

    • DOI

      10.1109/nbis.2016.55

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] An Improved Method of Keyword Search over Relational Data Streams by Aggressive Candidate Network Consolidation2016

    • Author(s)
      Savong Bou, Toshiyuki Amagasa, Hiroyuki Kitagawa
    • Journal Title

      Proc. 27th International Conference on Database and Expert Systems Applications (DEXA 2016)

      Volume: - Pages: 336-351

    • DOI

      10.1007/978-3-319-44403-1_21

    • ISBN
      9783319444024, 9783319444031
    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] Collaborative Filtering with Implicit Feedbacks by Discounting Positive Feedbacks2016

    • Author(s)
      Kento Kawai, Hiroyuki Kitagawa
    • Journal Title

      Proc. 2nd IEEE International Conference on Multimedia Big Data (IEEE BigMM 2016)

      Volume: - Pages: 41-48

    • DOI

      10.1109/bigmm.2016.30

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] オンラインニュースに関連するツイートのリアルタイムな収集2016

    • Author(s)
      大西 誠, 北川 博之
    • Journal Title

      日本データベース学会和文論文誌

      Volume: Vol.14 ,No.4

    • Related Report
      2015 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Facet-value Extraction Scheme from Textual Contents in XML Data2015

    • Author(s)
      Takahiro Komamizu, Toshiyuki Amagasa, and Hiroyuki Kitagawa
    • Journal Title

      International Journal of Web Information Systems (IJWIS)

      Volume: Vol. 11 Issue: 3 Pages: 270-290

    • DOI

      10.1108/ijwis-04-2015-0012

    • Related Report
      2015 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Path-based Keyword Search over XML Streams2015

    • Author(s)
      Savong Bou, Toshiyuki Amagasa, and Hiroyuki Kitagawa
    • Journal Title

      International Journal of Web Information Systems (IJWIS)

      Volume: Vol. 11 Issue: 3 Pages: 347-369

    • DOI

      10.1108/ijwis-04-2015-0013

    • Related Report
      2015 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] GPUを用いたCanopyクラスタリングの高速化2015

    • Author(s)
      林 史尊, 小澤 佑介, 天笠 俊之, 北川 博之
    • Journal Title

      日本データベース学会論文誌

      Volume: Vol. 13-J, No. 2 Pages: 13-18

    • NAID

      40020372348

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] Extracting Facets from Textual Contents for Faceted Search over XML Data2014

    • Author(s)
      Takahiro Komamizu, Toshiyuki Amagasa and Hiroyuki Kitagawa
    • Journal Title

      Proc. 16th International Conference on Information Integration and Web-based Applications & Services (iiWAS 2014)

      Volume: - Pages: 420-429

    • DOI

      10.1145/2684200.2684294

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Filtering XML Streams by XPath and Keywords2014

    • Author(s)
      Savong Bou, Toshiyuki Amagasa and Hiroyuki Kitagawa
    • Journal Title

      Proc. 16th International Conference on Information Integration and Web-based Applications & Services (iiWAS 2014)

      Volume: - Pages: 410-419

    • DOI

      10.1145/2684200.2684309

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Presentation] Grid-Index Algorithm for Reverse Rank Queries2017

    • Author(s)
      Yuyang Dong, Hanxiong Chen, Jeffrey Xu Yu, Kazutaka Furuse, Hiroyuki Kitagawa
    • Organizer
      20th International Conference on Extending Database Technology (EDBT 2017)
    • Place of Presentation
      Congress Center of the San Servolo Island(イタリア・ベニス)
    • Year and Date
      2017-03-21
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 大規模グラフに対する逐次的なノードの枝刈りを用いたObjectRankの高速化2017

    • Author(s)
      佐藤 朋紀, 塩川 浩昭, 北川 博之
    • Organizer
      情報処理学会第79回全国大会 (IPSJ全国大会 2017)
    • Place of Presentation
      名古屋大学(愛知県名古屋市)
    • Year and Date
      2017-03-16
    • Related Report
      2016 Annual Research Report
  • [Presentation] メニーコアプロセッサを用いた集合間類似結合の高速化2017

    • Author(s)
      菅野 健太, 天笠 俊之, 北川 博之
    • Organizer
      情報処理学会第79回全国大会 (IPSJ全国大会 2017)
    • Place of Presentation
      名古屋大学(愛知県名古屋市)
    • Year and Date
      2017-03-16
    • Related Report
      2016 Annual Research Report
  • [Presentation] ストリーム処理とバッチ処理の統合と実行最適化2017

    • Author(s)
      長 裕敏, 塩川 浩昭, 北川 博之
    • Organizer
      第9回データ工学と情報マネジメントに関するフォーラム (DEIM 2017)
    • Place of Presentation
      高山グリーンホテル(岐阜県高山市)
    • Year and Date
      2017-03-06
    • Related Report
      2016 Annual Research Report
  • [Presentation] メニーコアプロセッサを用いた構造的類似度に基づくグラフクラスタリングの高速化2017

    • Author(s)
      高橋 知克, 塩川 浩昭, 北川 博之
    • Organizer
      第9回データ工学と情報マネジメントに関するフォーラム (DEIM 2017)
    • Place of Presentation
      高山グリーンホテル(岐阜県高山市)
    • Year and Date
      2017-03-06
    • Related Report
      2016 Annual Research Report
  • [Presentation] SIFT特徴量を用いた画像検索のGPUによる高速化2017

    • Author(s)
      草村 優太, 天笠 俊之, 北川 博之
    • Organizer
      第9回データ工学と情報マネジメントに関するフォーラム (DEIM 2017)
    • Place of Presentation
      高山グリーンホテル(岐阜県高山市)
    • Year and Date
      2017-03-06
    • Related Report
      2016 Annual Research Report
  • [Presentation] 大規模グラフに対するObjectRankの高速化2017

    • Author(s)
      佐藤 朋紀, 塩川 浩昭, 山口 祐人, 北川 博之
    • Organizer
      第9回データ工学と情報マネジメントに関するフォーラム (DEIM 2017)
    • Place of Presentation
      高山グリーンホテル(岐阜県高山市)
    • Year and Date
      2017-03-06
    • Related Report
      2016 Annual Research Report
  • [Presentation] SCAN-XP: Parallel Structural Graph Clustering Algorithm on Intel Xeon Phi Coprocessors2017

    • Author(s)
      Tomokatsu Takahashi, Hiroaki Shiokawa, Hiroyuki Kitagawa
    • Organizer
      2nd ACM SIGMOD Workshop on Network Data Analytics (NDA 2017)
    • Place of Presentation
      Hilton Chicago(アメリカ合衆国・シカゴ)
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Local Attention Analysis and Prediction of Online News Articles in Twitter2016

    • Author(s)
      Saki Nagaki, Yuto Yamaguchi, Toshiyuki Amagasa, and Hiroyuki Kitagawa
    • Organizer
      International Workshop On Mobile Ubiquitous Systems, Infrastructures, Communications, And Applications (MUSICAL 2016)
    • Place of Presentation
      広島国際会議場(広島県広島市)
    • Year and Date
      2016-11-28
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] データの動的な変化に対応可能な対話的外れ値分析2016

    • Author(s)
      坂詰知完, 北川博之, 天笠俊之
    • Organizer
      第9回Webとデータベースに関するフォーラム (WebDB Forum 2016)
    • Place of Presentation
      慶應義塾大学(神奈川県横浜市)
    • Year and Date
      2016-09-13
    • Related Report
      2016 Annual Research Report
  • [Presentation] GPU Acceleration of Content-based Image Retrieval based on SIFT Descriptors2016

    • Author(s)
      Yuta Kusamura, Yusuke Kozawa, Toshiyuki Amagasa, and Hiroyuki Kitagawa
    • Organizer
      5th International Workshop on Advances in Data Engineering and Mobile Computing in conjunction with NBiS2016 (DEMoC 2016)
    • Place of Presentation
      Technical University of Ostrava(チェコ・オストラバ)
    • Year and Date
      2016-09-07
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] JsFlow: Integration of Massive Streams and Batches via JSON-based Dataflow Algebra2016

    • Author(s)
      Hirotoshi Cho, Hiroaki Shiokawa and Hiroyuki Kitagawa
    • Organizer
      19th International Conference on Network-Based Information Systems (NBiS 2016)
    • Place of Presentation
      Technical University of Ostrava(チェコ・オストラバ)
    • Year and Date
      2016-09-07
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] An Improved Method of Keyword Search over Relational Data Streams by Aggressive Candidate Network Consolidation2016

    • Author(s)
      Savong Bou, Toshiyuki Amagasa, Hiroyuki Kitagawa
    • Organizer
      27th International Conference on Database and Expert Systems Applications (DEXA 2016)
    • Place of Presentation
      Instituto Superior de Engenharia do Porto(ポルトガル・ポルト)
    • Year and Date
      2016-09-05
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Collaborative Filtering with Implicit Feedbacks by Discounting Positive Feedbacks2016

    • Author(s)
      Kento Kawai, Hiroyuki Kitagawa
    • Organizer
      2nd IEEE International Conference on Multimedia Big Data (IEEE BigMM 2016)
    • Place of Presentation
      Howard Civil Service International House(台湾・台北)
    • Year and Date
      2016-04-20
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Collaborative Filtering with Implicit Feedbacks by Discounting Positive Feedbacks2016

    • Author(s)
      Kent Kawai, Hiroyuki Kitagawa
    • Organizer
      2nd IEEE International Conference on Multimedia Big Data (IEEE BigMM 2016),
    • Place of Presentation
      Howard Civil Service International House(台湾・台北)
    • Year and Date
      2016-04-20
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] GPUを用いた類似画像検索の高速化2016

    • Author(s)
      草村 優太,小澤 佑介,天笠 俊之,北川 博之
    • Organizer
      情報処理学会第78回全国大会 (IPSJ全国大会 2016)
    • Place of Presentation
      慶應義塾大学矢上キャンパス(神奈川県横浜市)
    • Year and Date
      2016-03-10
    • Related Report
      2015 Annual Research Report
  • [Presentation] GPUを用いたラベル伝搬法によるグラフクラスタリングの高速化2016

    • Author(s)
      小澤 佑介,天笠 俊之,北川 博之
    • Organizer
      第8回データ工学と情報マネジメントに関するフォーラム (DEIM 2016)
    • Place of Presentation
      ヒルトン福岡シーホーク(福岡県福岡市)
    • Year and Date
      2016-02-29
    • Related Report
      2015 Annual Research Report
  • [Presentation] Efficient Keyword Search over Relational Data Streams2016

    • Author(s)
      Savong Bou, Toshiyuki Amagasa and Hiroyuki Kitagawa
    • Organizer
      第8回データ工学と情報マネジメントに関するフォーラム (DEIM 2016)
    • Place of Presentation
      ヒルトン福岡シーホーク(福岡県福岡市)
    • Year and Date
      2016-02-29
    • Related Report
      2015 Annual Research Report
  • [Presentation] オンラインニュースとツイートのリアルタイムマッチング手法2016

    • Author(s)
      大西 誠,山口 祐人,北川 博之
    • Organizer
      第8回データ工学と情報マネジメントに関するフォーラム (DEIM 2016)
    • Place of Presentation
      ヒルトン福岡シーホーク(福岡県福岡市)
    • Year and Date
      2016-02-29
    • Related Report
      2015 Annual Research Report
  • [Presentation] 高水準言語で記述可能なストリーム処理とバッチ処理の統合フレームワーク2016

    • Author(s)
      長 裕敏,塩川 浩昭, 北川 博之
    • Organizer
      第8回データ工学と情報マネジメントに関するフォーラム (DEIM 2016)
    • Place of Presentation
      ヒルトン福岡シーホーク(福岡県福岡市)
    • Year and Date
      2016-02-29
    • Related Report
      2015 Annual Research Report
  • [Presentation] Real-Time Relevance Matching of News and Tweets2015

    • Author(s)
      Sei Onishi, Yuto Yamaguchi, and Hiroyuki Kitagawa
    • Organizer
      23th International Conference on Cooperative Information Systems (CoopIS 2015)
    • Place of Presentation
      Hotel Aldemar Amilia Mare Resort (ギリシャ・ロードス)
    • Year and Date
      2015-10-28
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Parallel Canopy Clustering on GPUs2015

    • Author(s)
      Yusuke Kozawa, Fumitaka Hayashi, Toshiyuki Amagasa, and Hiroyuki Kitagawa
    • Organizer
      26th International Conference on Database and Expert Systems Applications (DEXA 2015)
    • Place of Presentation
      Universitat Politecnica de Valencia (スペイン・バレンシア)
    • Year and Date
      2015-09-01
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] GPU Acceleration of Set Similarity Joins2015

    • Author(s)
      Mateus S. H. Cruz, Yusuke Kozawa, Toshiyuki Amagasa, and Hiroyuki Kitagawa
    • Organizer
      26th International Conference on Database and Expert Systems Applications (DEXA 2015)
    • Place of Presentation
      Universitat Politecnica de Valencia (スペイン・バレンシア)
    • Year and Date
      2015-09-01
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Continuous Angle-based Outlier Detection on High-dimensional Data Streams2015

    • Author(s)
      Hao Ye, Hiroyuki Kitagawa, and Jun Xiao
    • Organizer
      the 19th International Database Engineering & Applications Symposium (IDEAS 2015)
    • Place of Presentation
      慶應義塾大学日吉キャンパス(神奈川県横浜市)
    • Year and Date
      2015-07-13
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 半構造データに対するストリーム処理とバッチ処理の統合フレームワーク2015

    • Author(s)
      長 裕敏, 王 岩, 北川 博之, 天笠 俊之
    • Organizer
      情報処理学会第77回全国大会 (IPSJ全国大会 2015)
    • Place of Presentation
      京都大学吉田キャンパス(京都府)
    • Year and Date
      2015-03-19
    • Related Report
      2014 Annual Research Report
  • [Presentation] オンラインニュースに関連するツイートのリアルタイムな収集2015

    • Author(s)
      大西 誠, 北川 博之
    • Organizer
      第7回データ工学と情報マネジメントに関するフォーラム (DEIM 2015)
    • Place of Presentation
      磐梯熱海ホテル華の湯(福島県)
    • Year and Date
      2015-03-04
    • Related Report
      2014 Annual Research Report
  • [Presentation] An Improved Method of Keyword Search over Relational Data Streams2015

    • Author(s)
      Savong Bou, Toshiyuki Amagasa, and Hiroyuki Kitagawa
    • Organizer
      第7回データ工学と情報マネジメントに関するフォーラム (DEIM 2015)
    • Place of Presentation
      磐梯熱海ホテル華の湯(福島県)
    • Year and Date
      2015-03-02
    • Related Report
      2014 Annual Research Report
  • [Presentation] Efficient Set Similarity Join on Graphics Processors2015

    • Author(s)
      Silqueira Hickson Cruz Mateus, 小澤 佑介, 天笠 俊之, 北川 博之
    • Organizer
      第7回データ工学と情報マネジメントに関するフォーラム (DEIM 2015)
    • Place of Presentation
      磐梯熱海ホテル華の湯(福島県)
    • Year and Date
      2015-03-02
    • Related Report
      2014 Annual Research Report

URL: 

Published: 2014-04-04   Modified: 2018-03-22  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi