The development and practice of interactive Puppet Theater System for hearing-impaired people

2013 Fiscal Year Final Research Report

• Project/Area Number: 23300309
• Research Category: Grant-in-Aid for Scientific Research (B)
• Allocation Type: Single-year Grants
• Section: 一般
• Research Field: Educational technology
• Research Institution: Tama Art University
• Principal Investigator: KUSUNOKI Fusako 多摩美術大学, 美術学部, 教授 (40192025)
• Co-Investigator(Kenkyū-buntansha): MIZOGUCHI Hiroshi 東京理科大学, 理工学部, 教授 (00262113) ; NAMATAME Miki 筑波技術大学, 産業デザイン学部, 教授 (20320624) ; INAGAKI Shigenori 神戸大学, 人間発達環境学研究科, 教授 (70176387)
• Co-Investigator(Renkei-kenkyūsha): TERANO Takao 東京工業大学, 総合理工学研究科, 教授 (20227523)
• Project Period (FY): 2011-04-01 – 2014-03-31
• Keywords: 聴覚障碍 / インタラクティブコンテンツ / 人形劇 / インクルーシブデザイン

Research Abstract

We developed Interactive Puppet Theater. Interactive Puppet Theater is a puppet show system that is designed for appreciation by hearing-impaired people. This system have two characteristics to allow the hearing impaired people to enjoy a puppet show.First, to ensure that aural information is conveyed, we project the dialogues (textual data) onto the background of the puppet show. Then, using Kinect, we allow the audience to participate in the story through physical movements. We experimented it with normal students and hearing-impaired students.The result of the questionnaire based their answers proved that the system had the possibility to enable normal students and hearing-impaired students to enough enjoy Interactive Puppet Theater.

Research Products

• [Journal Article] Evaluation of Interactive Puppet Theater based on inclusive design methods a case study of students at elementary school for the deaf (2013)
  • Author(s): Egusa, R., Wada, K., Adachi, T., Goseki, M., Namatame, M., Kusunoki, F., Mizoguchi, H., & Inagaki, S
  • Journal Title: Proceedings of the 12th International Conference on Interaction Design and Children Pages: 467-470
  • DOI: 10.1145/2485760.2485821
  • Peer Reviewed
• [Journal Article] Evaluation of the dialogue information function of Interactive Puppet Theater : a puppet-show system for deaf children (2013)
  • Author(s): Egusa, R., Wada, K., Adachi, T., Goseki, M., Namatame, M., Kusunoki, F., Mizoguchi, H., & Inagaki, S
  • Journal Title: Proceedings of the 10th International Conference on Advances in Computer Entertainment Technology Pages: 536-539
  • DOI: 10.1007/978-3-319-03161-3_47
  • Peer Reviewed
• [Journal Article] インクルーシブデザインに基づいたインタラクティブな人形劇の開発と実践 (2013)
  • Author(s): 楠房子・和田久美子・江草遼平・後関政史・足立孝之・溝口博・生田目美紀・稲垣成哲
  • Journal Title: 電子情報通信学会論文誌 Volume: 第J96-D巻, 第1号 Pages: 61-69
  • Peer Reviewed
• [Journal Article] インタラクティブ人形劇における身体動作を媒介とした物語参加機能の改善 (2013)
  • Author(s): 江草遼平・足立孝之・中山智裕・楠房子・生田目美紀・溝口博・稲垣成哲
  • Journal Title: 日本科学教育学会研究会研究報告 Volume: 第28号, 第2巻 Pages: 77-80
• [Journal Article] インクルーシブデザインに基づいた台詞投影機能と物語参加機能を備えた人形劇の評価 (2013)
  • Author(s): 江草遼平・足立孝之・中山智裕・楠房子・生田目美紀・溝口博・稲垣成哲
  • Journal Title: 情報処理学会研究報告 Volume: 第2014-DCC-6巻.17号 Pages: 1-8
• [Journal Article] Evaluation of the universal puppet theater based on inclusive design method (2012)
  • Author(s): Wada, K., Egusa R., Namatame, M., Kusunoki, F., Mizoguchi, H., & Inagaki, S
  • Journal Title: In Proceedings of 4th IEEE International Conference on Digital Game and Intelligent Toy Enhanced Learning, Japan : IEEE Pages: 135-137
  • DOI: 10.1109/DIGITEL.2012.37
  • Peer Reviewed
• [Journal Article] Evaluation of the puppet theater based on inclusive design method : a case study of fourth-year elementary school student with normal hearing (2012)
  • Author(s): Egusa, R., Wada, K., Namatame, M., Kusunoki, F., Mizoguchi, H., & Inagaki, S
  • Journal Title: Proceedings of the 11th International Conference on Interaction Design and Children, Bremen, German : ACM Pages: 216-219
  • DOI: 10.1145/2307096.2307129
  • Peer Reviewed
• [Journal Article] Development of an interactive puppet show system for the hearing-impaired people (2012)
  • Author(s): Egusa, R., Wada, K., Namatame, M., Kusunoki, F., Mizoguchi, H., & Inagaki, S
  • Journal Title: Proceedings of the 4th International Conference on Creative Content Technologies Pages: 69-71
  • Peer Reviewed
• [Journal Article] Puppet theater system for normal-hearing and hearing-impaired people (2012)
  • Author(s): Adachi, T., Egusa, R., Goseki, M., Mizoguchi, H., Namatame, M., Kusunoki, F., & Inagaki, S
  • Journal Title: Proceedings of the 9th International Conference on Advances in Computer Entertainment Technology Pages: 461-464
  • DOI: 10.1007/978-3-642-34292-9_35
  • Peer Reviewed
• [Presentation] 台詞投影機能と物語分岐機能とにより聴覚障害者と健常者とが共に楽しめる人形劇 (2012)
  • Author(s): 後関政史・足立孝之・溝口博・楠房子・江草遼平・生田目美紀・稲垣成哲
  • Organizer: 日本科学教育学会第36回年会
  • Place of Presentation: 東京理科大学
  • Year and Date: 2012-08-28
• [Presentation] 健常者と聴覚障害者が共に人形劇を楽しめるシステム ～台詞・背景投影と物語分岐選択～ (2012)
  • Author(s): 足立孝之・後関政史・溝口博・楠房子・江草遼平・生田目美紀・稲垣成哲
  • Organizer: 日本科学教育学会第36回年会
  • Place of Presentation: 東京理科大学
  • Year and Date: 2012-08-27
• [Presentation] イ ンクルーシブデザイン手法に基づいた物語理解支援システム (2011)
  • Author(s): 江草遼平・和田久美子・生田目美紀・楠房子・溝口博・稲垣成哲
  • Organizer: 日本科学教育学会第35回年会
  • Place of Presentation: 東京工業大学
  • Year and Date: 2011-08-23