The development and practice of interactive Puppet Theater System for hearing-impaired people

• Project/Area Number: 23300309
• Research Category: Grant-in-Aid for Scientific Research (B)
• Allocation Type: Single-year Grants
• Section: 一般
• Research Field: Educational technology
• Research Institution: Tama Art University
• Principal Investigator: KUSUNOKI Fusako 多摩美術大学, 美術学部, 教授 (40192025)
• Co-Investigator(Kenkyū-buntansha): MIZOGUCHI Hiroshi 東京理科大学, 理工学部, 教授 (00262113) ; NAMATAME Miki 筑波技術大学, 産業デザイン学部, 教授 (20320624) ; INAGAKI Shigenori 神戸大学, 人間発達環境学研究科, 教授 (70176387)
• Co-Investigator(Renkei-kenkyūsha): TERANO Takao 東京工業大学, 総合理工学研究科, 教授 (20227523)
• Project Period (FY): 2011-04-01 – 2014-03-31
• Project Status: Completed (Fiscal Year 2013)
• Budget Amount: ¥15,860,000 (Direct Cost: ¥12,200,000、Indirect Cost: ¥3,660,000); Fiscal Year 2013: ¥3,900,000 (Direct Cost: ¥3,000,000、Indirect Cost: ¥900,000); Fiscal Year 2012: ¥4,680,000 (Direct Cost: ¥3,600,000、Indirect Cost: ¥1,080,000); Fiscal Year 2011: ¥7,280,000 (Direct Cost: ¥5,600,000、Indirect Cost: ¥1,680,000)
• Keywords: 聴覚障碍 / インタラクティブコンテンツ / 人形劇 / インクルーシブデザイン / ユニバーサルデザイン / 聴覚障害 / kinect

Research Abstract

We developed Interactive Puppet Theater. Interactive Puppet Theater is a puppet show system that is designed for appreciation by hearing-impaired people. This system have two characteristics to allow the hearing impaired people to enjoy a puppet show.First, to ensure that aural information is conveyed, we project the dialogues (textual data) onto the background of the puppet show. Then, using Kinect, we allow the audience to participate in the story through physical movements. We experimented it with normal students and hearing-impaired students.The result of the questionnaire based their answers proved that the system had the possibility to enable normal students and hearing-impaired students to enough enjoy Interactive Puppet Theater.

Research Products

• [Journal Article] Evaluation of Interactive Puppet Theater based on inclusive design methods a case study of students at elementary school for the deaf (2013)
  • Author(s): Egusa, R., Wada, K., Adachi, T., Goseki, M., Namatame, M., Kusunoki, F., Mizoguchi, H., & Inagaki, S
  • Journal Title: Proceedings of the 12th International Conference on Interaction Design and Children Pages: 467-470
  • DOI: 10.1145/2485760.2485821
  • Peer Reviewed
• [Journal Article] Evaluation of the dialogue information function of Interactive Puppet Theater : a puppet-show system for deaf children (2013)
  • Author(s): Egusa, R., Wada, K., Adachi, T., Goseki, M., Namatame, M., Kusunoki, F., Mizoguchi, H., & Inagaki, S
  • Journal Title: Proceedings of the 10th International Conference on Advances in Computer Entertainment Technology Volume: 10 Pages: 536-539
  • DOI: 10.1007/978-3-319-03161-3_47
  • ISBN: 9783319031606, 9783319031613
  • Peer Reviewed
• [Journal Article] インクルーシブデザインに基づいたインタラクティブな人形劇の開発と実践 (2013)
  • Author(s): 楠房子・和田久美子・江草遼平・後関政史・足立孝之・溝口博・生田目美紀・稲垣成哲
  • Journal Title: 電子情報通信学会論文誌 Volume: 第J96-D巻, 第1号 Pages: 61-69
  • NAID: 110009577690
  • Peer Reviewed
• [Journal Article] インタラクティブ人形劇における身体動作を媒介とした物語参加機能の改善 (2013)
  • Author(s): 江草遼平・足立孝之・中山智裕・楠房子・生田目美紀・溝口博・稲垣成哲
  • Journal Title: 日本科学教育学会研究会研究報告 Volume: 第28号, 第2巻 Pages: 77-80
  • NAID: 130006655663
• [Journal Article] インクルーシブデザインに基づいた台詞投影機能と物語参加機能を備えた人形劇の評価 (2013)
  • Author(s): 江草遼平・足立孝之・中山智裕・楠房子・生田目美紀・溝口博・稲垣成哲
  • Journal Title: 情報処理学会研究報告 Volume: 第2014-DCC-6巻.17号 Pages: 1-8
  • NAID: 110009658845
• [Journal Article] valuation of Interactive Puppet Theater based on inclusive design methods a case study of students at elementary school for the deaf (2013)
  • Author(s): Egusa, R., Wada, K., Adachi, T., Goseki, M., Namatame, M., Kusunoki, F., Mizoguchi, H., & Inagaki, S.
  • Journal Title: the 12th International Conference on Interaction Design and Children Volume: 12 Pages: 467-470
  • Peer Reviewed
• [Journal Article] インクルーシブデザインに基づいたインタラクティブな人形劇の開発と実践 (2013)
  • Author(s): 楠房子,和田久美子,江草遼平,後関政史,足立孝之,溝口博,生田目美紀,稲垣成哲
  • Journal Title: 日本電子情報通信学会誌 Volume: J96-D(１) Pages: 61-69
  • NAID: 110009577690
  • Peer Reviewed
• [Journal Article] Evaluation of the universal puppet theater based on inclusive design method (2012)
  • Author(s): Wada, K., Egusa R., Namatame, M., Kusunoki, F., Mizoguchi, H., & Inagaki, S
  • Journal Title: In Proceedings of 4th IEEE International Conference on Digital Game and Intelligent Toy Enhanced Learning, Japan : IEEE Pages: 135-137
  • DOI: 10.1109/digitel.2012.37
  • Peer Reviewed
• [Journal Article] Evaluation of the puppet theater based on inclusive design method : a case study of fourth-year elementary school student with normal hearing (2012)
  • Author(s): Egusa, R., Wada, K., Namatame, M., Kusunoki, F., Mizoguchi, H., & Inagaki, S
  • Journal Title: Proceedings of the 11th International Conference on Interaction Design and Children, Bremen, German : ACM Volume: 11 Pages: 216-219
  • DOI: 10.1145/2307096.2307129
  • Peer Reviewed
• [Journal Article] Development of an interactive puppet show system for the hearing-impaired people (2012)
  • Author(s): Egusa, R., Wada, K., Namatame, M., Kusunoki, F., Mizoguchi, H., & Inagaki, S
  • Journal Title: Proceedings of the 4th International Conference on Creative Content Technologies Pages: 69-71
  • Peer Reviewed
• [Journal Article] Puppet theater system for normal-hearing and hearing-impaired people (2012)
  • Author(s): Adachi, T., Egusa, R., Goseki, M., Mizoguchi, H., Namatame, M., Kusunoki, F., & Inagaki, S
  • Journal Title: Proceedings of the 9th International Conference on Advances in Computer Entertainment Technology Pages: 461-464
  • DOI: 10.1007/978-3-642-34292-9_35
  • ISBN: 9783642342912, 9783642342929
  • Peer Reviewed
• [Journal Article] Development of an interactive puppet show system for the hearing-impaired people (2012)
  • Author(s): Egusa, R., Wada, K., Namatame, M., Kusunoki, F., Mizoguchi, H., & Inagaki, S.
  • Journal Title: proceedings of the 4th International Conference on Creative Content Technologies Volume: 4 Pages: 69-71
  • Peer Reviewed
• [Journal Article] Puppet Show for Entertaining Hearing-Impaired,ogether with Normal-Hearing People - A novel application of human sensing technology to inclusive education (2012)
  • Author(s): Goseki M., Egusa R., Adachi T., Mizoguchi H., Namatame M.,Kusunoki F.,Inagaki S.
  • Journal Title: International Conference on Innovative Engineering Systems Volume: 1 Pages: 7-9
  • Peer Reviewed
• [Journal Article] Evaluation of the Universal Puppet Theater Based on Inclusive Design Method (2012)
  • Author(s): Wada K., Egusa R., Namatame M., Kusunoki F., Mizoguchi H., Inagaki S.
  • Journal Title: IEEE Fourth International Conference On Digital Game And Intelligent Toy Enhanced Learning Volume: 4 Pages: 135-137
  • Peer Reviewed
• [Journal Article] Evaluation of the Universal Puppet Theater based on Inclusive Design Method (2012)
  • Author(s): WADA Kumiko, EGUSA Ryohei, NAMATAME Miki, KUSUNOKI Fusako, MIZOGUCHI Hiroshi, INAGAKI Shigenori
  • Journal Title: Fourth IEEE International Conference on Digital Game and Intelligent Toy Enhanced Learning, Volume: 2012 Pages: 135-137
  • Peer Reviewed
• [Journal Article] インクルーシブデザイン手法に基づいたユニバーサル・パペット・シアターの予備的評価―大学生の健常者を対象として― (2012)
  • Author(s): 江草遼平・和田久美子・生田目美紀・楠房子・稲垣成哲・溝口博
  • Journal Title: 教育システム情報学会研究会 Volume: 26-6 Pages: 21-26
• [Journal Article] インクルーシブデザイン手法に基づいた物語理解支援システム (2011)
  • Author(s): 江草遼平, 和田久美子,生田目美紀,楠房子,溝口博,稲垣成哲
  • Journal Title: 日本科学教育学会年会論文集 Volume: 35 Pages: 456-457
• [Presentation] 台詞投影機能と物語分岐機能とにより聴覚障害者と健常者とが共に楽しめる人形劇 (2012)
  • Author(s): 後関政史・足立孝之・溝口博・楠房子・江草遼平・生田目美紀・稲垣成哲
  • Organizer: 日本科学教育学会第36回年会
  • Place of Presentation: 東京理科大学
  • Year and Date: 2012-08-28
• [Presentation] 健常者と聴覚障害者が共に人形劇を楽しめるシステム ～台詞・背景投影と物語分岐選択～ (2012)
  • Author(s): 足立孝之・後関政史・溝口博・楠房子・江草遼平・生田目美紀・稲垣成哲
  • Organizer: 日本科学教育学会第36回年会
  • Place of Presentation: 東京理科大学
  • Year and Date: 2012-08-27
• [Presentation] Evaluation of the Universal Puppet Theater Based on Inclusive Design Method (2012)
  • Author(s): Kumiko Wada, Ryohei Egusa, Miki Namatame, Fusako Kusunoki, Hiroshi Mizoguchi, and Shigenori Inagaki
  • Organizer: In Proceedings of the Fourth IEEE International Conference on Digital Game and Intelligent Toy Enhanced Learning (DIGITEL '12)
  • Place of Presentation: Kagawa International Conference Hall
• [Presentation] Development of an Interactive Puppet Show System for the Hearing-Impaired People (2012)
  • Author(s): Ryohei Egusa, Kumiko Wada, Miki Namatame, Fusako Kusunoki, Hiroshi Mizoguti, Shigenori Inagaki
  • Organizer: In Proceedings of the Fourth IEEE International Conference on Creative Content Technologies(CONTENT 2012)
  • Place of Presentation: Hotel Novotel Nice Cap 3000
• [Presentation] イ ンクルーシブデザイン手法に基づいた物語理解支援システム (2011)
  • Author(s): 江草遼平・和田久美子・生田目美紀・楠房子・溝口博・稲垣成哲
  • Organizer: 日本科学教育学会第35回年会
  • Place of Presentation: 東京工業大学
  • Year and Date: 2011-08-23
• [Presentation] インタラクティブ人形劇における身体動作を媒介とした物語参加機能の改善
  • Author(s): 江草遼平・足立孝之・中山智裕・楠房子・生田目美紀・溝口博・稲垣成哲
  • Organizer: 日本科学教育学会研究会
  • Place of Presentation: 大分大学
• [Presentation] インクルーシブデザインに基づいた台詞投影機能と物語参加機能を備えた人形劇の評価
  • Author(s): 江草遼平・足立孝之・中山智裕・楠房子・生田目美紀・溝口博・稲垣成哲
  • Organizer: 情報処理学会研究会
  • Place of Presentation: 和歌山大学南紀熊野サテライト
• [Presentation] 健常者と聴覚障害者が共に人形劇を楽しめるシステム ～台詞・背景投影と物語分岐選択～
  • Author(s): 足立孝之・後関政史・溝口博・楠房子・江草遼平・生田目美紀・稲垣成哲
  • Organizer: 日本科学教育学会第36回年会
  • Place of Presentation: 東京理科大学