A Study on Distributed Real-Time Stream Processing Infrastructure with Advanced Operators

• Project/Area Number: 22700090
• Research Category: Grant-in-Aid for Young Scientists (B)
• Allocation Type: Single-year Grants
• Research Field: Media informatics/Database
• Research Institution: University of Tsukuba
• Principal Investigator: KAWASHIMA Hideyuki 筑波大学, システム情報系, 講師 (90407148)
• Project Period (FY): 2010 – 2011
• Project Status: Completed (Fiscal Year 2011)
• Budget Amount: ¥4,030,000 (Direct Cost: ¥3,100,000、Indirect Cost: ¥930,000); Fiscal Year 2011: ¥1,690,000 (Direct Cost: ¥1,300,000、Indirect Cost: ¥390,000); Fiscal Year 2010: ¥2,340,000 (Direct Cost: ¥1,800,000、Indirect Cost: ¥540,000)
• Keywords: ストリームデータ処理

Research Abstract

This study tried to develop a distributed real-time stream processing infrastructure with advanced operators. As for such operators, Bayesian neworks and media data management are developed. In addition, I conducted research on fast data persisting, high availability scheme, encrypted stream processing, and stream join operators.

Research Products

• [Journal Article] センサデータベースマネージャにおける問合せ処理とデータ圧縮の同時最適化 (2012)
  • Author(s): 猿渡俊介, 川島英之, 高木潤一郎, 倉田成人, 森川博之
  • Journal Title: 情報処理学会論文誌「新たな展開を迎えるITS、モバイル通信とユビキタスコンピューティング」特集号 Volume: 53(1) Pages: 320-335
  • NAID: 110008736788
  • URL: http://ci.nii.ac.jp/naid/110008736788
  • Peer Reviewed
• [Journal Article] ストリーム処理エンジン向け動的再構成可能プロセッサアーキテクチャの設計 (2011)
  • Author(s): 三好健文, 寺田裕太, 川島英之, 吉永努
  • Journal Title: 情報処理学会論文誌:データベース Volume: Vol.4, No.2 Pages: 35-51
  • NAID: 40019597812
  • Peer Reviewed
• [Journal Article] ウィンドウ結合演算子のFPGAによる実現 (2011)
  • Author(s): 三好健文, 寺田裕太, 川島英之, 吉永努
  • Journal Title: 電子情報通信学会論文誌 Volume: J94-B(10) Pages: 1313-1322
  • NAID: 110008749646
  • URL: http://ci.nii.ac.jp/naid/110008749646
  • Peer Reviewed
• [Journal Article] センサデータベースマネージャにおける問合せ処理とデータ圧縮の同時最適化 (2011)
  • Author(s): 猿渡俊介, 川島英之, 高木潤一郎, 倉田成人, 森川博之
  • Journal Title: 情報処理学会論文誌 Volume: 53 Pages: 320-335
  • NAID: 110008736788
  • Peer Reviewed
• [Journal Article] 分散ストリーム処理システムにおける高信頼化方式の提案 (2010)
  • Author(s): 塩川浩昭, 北川博之, 川島英之, 渡辺陽介
  • Journal Title: 電子情報通信学会論文誌 Volume: Vol.J93-D, No.6 Pages: 767-780
  • NAID: 110007618351
  • URL: http://ci.nii.ac.jp/naid/110007618351
  • Peer Reviewed
• [Journal Article] A Character-string Processor embedded in Service-friendly Router for Future Internet (2010)
  • Author(s): Yasutsugu Nagatomi, Michihiro Koibuchi, Hideyuki Kawashima, Koichi Inoue, Hiroaki Nishi
  • Journal Title: Proc.5th International Symposium on Embedded Multicore Systems-on-Chip, in conjunction with the 39th International Conference on Parallel Processing (ICPP 2010) Volume: (電子出版)
  • Peer Reviewed
• [Journal Article] Hardware Architecture for Supporting High-speed Database Insertion on Serviceoriented Router for Future Internet (2010)
  • Author(s): Tomoaki Makino, Michihiro Koibuchi, Hideyuki Kawashima, Koichi Inoue, Hiroaki Nishi
  • Journal Title: Proc.the 2010 International Conference on Parallel and Distributed Processing Techniques and Applications (PDPTA'10) Volume: (電子出版)
  • Peer Reviewed
• [Presentation] An Efficient Stream Archiving Method by Operator Merge and Write Control (2012)
  • Author(s): Taiga Abe, Hideyuki Kawashima and Hiroyuki Kitagawa
  • Organizer: Proc. The 5th. International Workshop on Data Management for Wireless and Pervasive Communications (DMWPC)
  • Place of Presentation: Fukuoka, Japan
• [Presentation] Efficient Invocation of Transaction Sequences Triggered by Data Streams (2011)
  • Author(s): Masafumi Oyamada, Hideyuki Kawashima, Hiroyuki Kitagawa
  • Organizer: The 2nd International Workshop on Streaming Media Delivery and Management Systems (SMDMS 2011)
  • Place of Presentation: バルセロナ,スペイン
  • Year and Date: 2011-10-26
• [Presentation] A Video Manager for Relational Stream Processing Systems (2011)
  • Author(s): Tsubasa Takahashi, Hideyuki Kawashima, Hiroyuki Kitagawa
  • Organizer: The 2nd International Workshop on Streaming Media Delivery and Management Systems (SMDMS 2011)
  • Place of Presentation: バルセロナ,スペイン
  • Year and Date: 2011-10-26
• [Presentation] データストリーム管理基盤技術 (2011)
  • Author(s): 川島英之
  • Organizer: 電子情報通信学会 超長期保管メモリ時限研究会(ULLDS)
  • Place of Presentation: 東京大学山上会館(東京都)(招待講演)
  • Year and Date: 2011-03-30
• [Presentation] Data Stream Processing for Real-Time Analysis (2011)
  • Author(s): 川島英之
  • Organizer: The 1st Data Intensive Science Workshop
  • Place of Presentation: 東京大学山上会館(東京都)(招待講演)
  • Year and Date: 2011-03-08
• [Presentation] An Implementation of Handshake Join on FPGA (2011)
  • Author(s): Yasin Oge, Takefumi Miyoshi, Hideyuki Kawashima and Tsutomu Yoshinaga
  • Organizer: Proc. Second International Conference on Networking and Computing (ICNC 2011)
  • Place of Presentation: Osaka, Japan
• [Presentation] Efficient Invocation of Transaction Sequences Triggered by Data Streams (2011)
  • Author(s): Masafumi Oyamada, Hideyuki Kawashima, and Hiroyuki Kitagawa
  • Organizer: The 2nd International Workshop on Streaming Media Delivery and Management Systems (SMDMS 2011), Proceedings of 3PGCIC
  • Place of Presentation: Barcelona, Spain
• [Presentation] A Video Manager for Relational Stream Processing Systems (2011)
  • Author(s): Tsubasa Takahashi, Hideyuki Kawashima, and Hiroyuki Kitagawa
  • Organizer: The 2nd International Workshop on Streaming Media Delivery and Management Systems (SMDMS 2011), Proceedings of 3PGCIC
  • Place of Presentation: Barcelona, Spain
• [Presentation] リアルタイム分析を支援するデータストリーム処理 (2010)
  • Author(s): 川島英之
  • Organizer: 早稲田大学グローバル COEプログラム「アンビエントSoC教育研究の国際拠点」
  • Place of Presentation: 早稲田大学(東京都)(招待講演)
  • Year and Date: 2010-12-18
• [Presentation] 先端的データストリーム処理概説 (2010)
  • Author(s): 川島英之
  • Organizer: グリッド評議会 金融分科会
  • Place of Presentation: 産業技術総合研究所 秋葉原事業所(東京都)(招待講演)
  • Year and Date: 2010-07-09
• [Presentation] 能動的情報源に挑むデータストリーム処理技術の動向 (2010)
  • Author(s): 川島英之
  • Organizer: 第4回 広域センサネットワークとオーバレイネットワークに関するワークショップ
  • Place of Presentation: 東京工業大学大岡山キャンパス(東京都)(招待講演)
  • Year and Date: 2010-04-28
• [Presentation] Complex Event Processing over Uncertain Data Streams (2010)
  • Author(s): Hideyuki Kawashima, Hiroyuki Kitagawa, and Xin Li
  • Organizer: Proc. International Conference on P2P, Parallel, Grid, Cloud and Internet Computing (3PGCIC)
  • Place of Presentation: Fukuoka, Japan