KANSEI-based Active Multimedia Provision System for Video and Audio Data

2010 Fiscal Year Final Research Report

• Project/Area Number: 21700117
• Research Category: Grant-in-Aid for Young Scientists (B)
• Allocation Type: Single-year Grants
• Research Field: Media informatics/Database
• Research Institution: Keio University
• Principal Investigator: KURABAYASHI Shuichi Keio University, 環境情報学部, 専任講師 (70458959)
• Project Period (FY): 2009 – 2010
• Keywords: コンテンツ・アーカイブ / 情報システム / ソフトウェア学 / ディレクトリ・情報検索 / ユーザインターフェース

Research Abstract

The principal investigator has developed KANSEI-based active multimedia provision system environment for video and audio data. As a concrete outcome of this research, the principal investigator implemented and published a practical system software, called "MediaMatrix", which is applicable to actual time-series media data, under the open source license. In DASFAA 2010 (The 15th International Conference on Database Systems for Advanced Applications) which is a prominent international conference in the database field, the principal investigator has made a demonstration about MediaMatrix system, and has received Best Demo Award. As international deployment of this research, the principal investigator has organized an international joint research of the KANSEI-based active multimedia provision system among the following three universities : University of California at San Diego, University of Washington Bothell, and University of Ljubljana in Slovenija.

Research Products

• [Journal Article] JoinSee : A Real-Time and Collaborative Hyper-Media System for Participatory Performances in the Opera of Meaning (2010)
  • Author(s): Kurabayashi, S., Dubnov, S., Kiyoki, Y.
  • Journal Title: Information Modelling and Knowledge Bases Vol.XXI Pages: 258-262
  • Peer Reviewed
• [Presentation] A personalized recommender system model using a colour-impression-based image retrieval and ranking method (2011)
  • Author(s): Sasa, A., Krisper, M., Kiyoki, Y., Kurabayashi, S., Chen, X.
  • Organizer: Proc.Sixth Intl.Conf.on Internet and Web Applications and Services (ICIW 2011)
  • Place of Presentation: St.Maarten, Netherlands
  • Year and Date: 20110320-20110325
• [Presentation] エディトリアル・デザインに関するテンプレートを用いたクエリ入力支援機能を有するe-Books検索エンジン (2011)
  • Author(s): 小池悠佳, 倉林修一
  • Organizer: 第3回データ工学と情報マネジメントに関するフォーラム(DEIM2010)
  • Place of Presentation: 静岡県
  • Year and Date: 20110227-20110301
• [Presentation] タブレット端末を対象とした複合検索語ナビゲーション機能を有するタイピング・フリー検索機構 (2011)
  • Author(s): 島岡諒, 倉林修一
  • Organizer: 第3回データ工学と情報マネジメントに関するフォーラム(DEIM2010)
  • Place of Presentation: 静岡県
  • Year and Date: 20110227-20110301
• [Presentation] 時系列印象変化抽出機構による音楽検索データベースシステムの実現 (2011)
  • Author(s): 市瀬綾, 倉林修一, 清木康
  • Organizer: 第3回データ工学と情報マネジメントに関するフォーラム(DEIM2010)
  • Place of Presentation: 静岡県
  • Year and Date: 20110227-20110301
• [Presentation] 学習者の状況・嗜好に応じた教材配信機能を有する体験連動型マルチリンガル外国語e-Learningシステム (2011)
  • Author(s): 加嵜長門, 倉林修一, 清木康
  • Organizer: 第3回データ工学と情報マネジメントに関するフォーラム(DEIM2010)
  • Place of Presentation: 静岡県
  • Year and Date: 20110227-20110301
• [Presentation] 色彩に応じたレシピ検索・共有ソーシャルコミュニティ・システム (2011)
  • Author(s): 小松万里子, 倉林修一, 清木康
  • Organizer: 第3回データ工学と情報マネジメントに関するフォーラム(DEIM2010)
  • Place of Presentation: 静岡県
  • Year and Date: 20110227-20110301
• [Presentation] 文書印象表現単語とフォントの感性的相関量計量による動的文書装飾システム (2011)
  • Author(s): 石井千賀, 倉林修一, 清木康
  • Organizer: 第3回データ工学と情報マネジメントに関するフォーラム(DEIM2010)
  • Place of Presentation: 静岡県
  • Year and Date: 20110227-20110301
• [Presentation] A Media-Mashup Engine with Interactive Cross-Media Association and Personalization Mechanisms (2010)
  • Author(s): Fukai, H., Ichinose, A., Kurabayashi, S., Kiyoki, Y.
  • Organizer: In Proceedings of the IASTED International Symposium on Software Engineering and Applications pp.396-403
  • Place of Presentation: Marina del Rey, California, USA
  • Year and Date: 20101108-20101110
• [Presentation] Ubiquitous language learning environments-on campus, in the city, abroad (2010)
  • Author(s): Waragai, I., Ohta, T., Raindl, M., Kurabayashi, S., Kiyoki, Y., Tokuda, H.
  • Organizer: In Proceedings of the European Association for Computer Assisted Language Learning (EUROCALL2010) pp.231-232
  • Place of Presentation: Bordeaux, France
  • Year and Date: 20100908-20100911
• [Presentation] Morphing Parallelization Strategy to Support On-the-Fly Video Analysis (2010)
  • Author(s): Fukuda, M., Kurabayashi, S., Hall, J., Kiyoki, Y.
  • Organizer: In Proceedings of the 2010 International Conference on Parallel and Distributed Processing Techniques and Applications-PDPTA 2010 pp.541-547
  • Place of Presentation: Las Vegas, USA
  • Year and Date: 20100712-20100715
• [Presentation] Multimedia Data Analysis on a Massively Distributed Parallelization Network of Anonymous Web Clients (2010)
  • Author(s): Hall, J., Kurabayashi, S., Kiyoki, Y.
  • Organizer: Proc.2010 IEEE Intl.Symp.on Mining and Web (MAW10) pp.615-620
  • Year and Date: 20100420-20100423
• [Presentation] MediaMatrix : A Video Stream Retrieval System with Mechanisms for Mining Contexts of Query Examples (2010)
  • Author(s): Kurabayashi, S., Kiyoki, Y.
  • Organizer: Proc.15th Intl.Conf.on Database Systems for Advanced Applications (DASFAA2010) pp.452-455
  • Year and Date: 20100401-20100404
• [Presentation] 動画像ストリームを対象とした内容検索・配信のためのアクティブルール記述・実行手法 (2010)
  • Author(s): 倉林修一, 清木康
  • Organizer: 情報処理学会創立50周年記念(第72回)全国大会 6 pages
  • Place of Presentation: 東京都
  • Year and Date: 20100308-20100312
• [Presentation] 色彩と音楽のクロス・メディア連結機構による自動音楽生成システムの実現 (2010)
  • Author(s): 春日優希, 倉林修一, 清木康
  • Organizer: 第2回データ工学と情報マネジメントに関するフォーラム(DEIM2010) 4 pages
  • Place of Presentation: 兵庫県
  • Year and Date: 20100228-20100302
• [Presentation] A Context-Based Whole Video Retrieval System with Dynamic Video Stream Analysis Mechanisms (2009)
  • Author(s): Kurabayashi, S., Ueno, T., Kiyoki, Y.
  • Organizer: Proc.11th IEEE Intl.Symp.on Multimedia (ISM2009) pp.505-510
  • Place of Presentation: San Diego, California, USA
  • Year and Date: 20091214-20091216
• [Presentation] Cross-Media Association Engine for Evaluating Emotive Effects of Advertisement Video Data Streams (2009)
  • Author(s): Hiruma, T., Kurabayashi, S., Kiyoki, Y.
  • Organizer: In Proceedings of the IASTED International Symposium on Software Engineering and Applications pp.258-261
  • Place of Presentation: Cambridge, Massachusetts, USA
  • Year and Date: 20091102-20091104
• [Presentation] An Adaptive Search System using Heterogeneous Document Vector Spaces (2009)
  • Author(s): Takano, K., Kurabayashi, S., Chen, X., Kiyoki, Y.
  • Organizer: In Proceedings of the 2009 IEEE Pacific Rim Conference on Communications, Computers and Signal Processing (PACRIM 2009) pp.193-198
  • Place of Presentation: Victoria, Canada
  • Year and Date: 20090823-20090826
• [Remarks] HP:
  • URL: http://web.sfc.keio.ac.jp/~kurabaya
• [Remarks] 受賞:Best Demo Award, Shuichi Kurabayashi and Yasushi Kiyoki : "MediaMatrix : A Video Stream Retrieval System with Mechanisms for Mining Contexts of Query Examples," In Proceedings of the 15th International Conference on Database Systems for Advanced Applications (DASFAA2010), pp.452-455, Japan, April 1-4, 2010.
• [Remarks] 受賞:学生奨励賞,春日優希, 倉林修一, 清木康,色彩と音楽のクロス・メディア連結機構による自動音楽生成システムの実現,第2回データ工学と情報マネジメントに関するフォーラム(DEIM2010)論文集,6 pages, Feb.28-Mar.2nd, 2010.