Design of a mobile theater using sensing technology for hearing disabled people's support

• Project/Area Number: 26282061
• Research Category: Grant-in-Aid for Scientific Research (B)
• Allocation Type: Partial Multi-year Fund
• Section: 一般
• Research Field: Educational technology
• Research Institution: Tama Art University
• Principal Investigator: KUSUNOKI Fusako 多摩美術大学, 美術学部, 教授 (40192025)
• Co-Investigator(Kenkyū-buntansha): 溝口 博 東京理科大学, 理工学部, 教授 (00262113) ; 生田目 美紀 筑波技術大学, 学内共同利用施設等, 教授 (20320624) ; 稲垣 成哲 神戸大学, 人間発達環境学研究科, 教授 (70176387)
• Project Period (FY): 2014-04-01 – 2017-03-31
• Project Status: Completed (Fiscal Year 2016)
• Budget Amount: ¥12,610,000 (Direct Cost: ¥9,700,000、Indirect Cost: ¥2,910,000); Fiscal Year 2016: ¥2,990,000 (Direct Cost: ¥2,300,000、Indirect Cost: ¥690,000); Fiscal Year 2015: ¥3,120,000 (Direct Cost: ¥2,400,000、Indirect Cost: ¥720,000); Fiscal Year 2014: ¥6,500,000 (Direct Cost: ¥5,000,000、Indirect Cost: ¥1,500,000)
• Keywords: ユニバーサルデザイン / 聴覚障碍 / モバイルシアター / センシング / 情報保障 / 人形劇 / インタラクション / 聴覚障害 / エンターティメント / インタクティブデザイン / ユーザビリティ / インタラクティブデザイン

Outline of Final Research Achievements

n this research, we will develop and practice "mobile theater", which is portable and can enjoy both healthy children and hearing-impaired children. The objectives of this research are the following three points (1) Establishment of automatic follow-up display method of doll's dialogue (2) Interaction using physicality so that children can participate in puppet theater and immerse them into stories Development of possible interfaces (3) Design of fun and emotional digital puppet theater content. In this research, we conduct surveys on visual information necessary for puppet play and how to present it, and at the same time we will produce puppet play contents and puppets. We will proceed with implementation of the system and eventually perform at the special support school and elementary school and verify the effectiveness of this research based on the evaluation.

Research Products

• [Journal Article] A Full-Body Interaction Game for Children with Hearing Disabilities to Gain the Immersive Experience in a Puppet Show (2016)
  • Author(s): Egusa, R. Nakadai, T. Nakayama, T., Kusunoki, F., Namatame, M.,&Mizoguchi, H., & Inagaki, S.
  • Journal Title: Social Computing in Digital Education Volume: 606 Pages: 29-28
  • Peer Reviewed
• [Journal Article] Designing a Collaborative Interaction Experience for a Puppet Show System for Hearing-Impaired Children (2016)
  • Author(s): Egusa, R., Sakai, T., Tamaki, H., Kusunoki, F., Namatame, M.,& Mizoguchi, H., & Inagaki, S.
  • Journal Title: LNCS 9759 Springer Volume: 2 Pages: 424-432
  • DOI: 10.1007/978-3-319-41267-2_60
  • ISBN: 9783319412665, 9783319412672
  • Peer Reviewed
• [Journal Article] Puppet Show System for Children With Hearing Disability:Evaluation of Story Participation Function With Physical Movement (2015)
  • Author(s): Egusa, R., Nakayama, T., Nakadai, T., Kusunoki, F., Namatame, M., Mizoguchi, H., & Inagaki, S.
  • Journal Title: proceedings of Global Learn 2015 Volume: 1 Pages: 482487-482487
  • Peer Reviewed / Open Access / Int'l Joint Research
• [Presentation] ユニバーサル人形劇システムにおける吹き出し型字幕の検討 (2017)
  • Author(s): 江草遼平・川口漱也・酒井嗣之介・楠房子・生田目美紀・溝口博・稲垣成哲
  • Organizer: 情報処理学会第15回デジタルコンテンツクリエーション研究会
  • Place of Presentation: 香川県 小豆島
  • Year and Date: 2017-01-20
• [Presentation] Preparatory development of collaborative / interactive learning game using bodily movements for deaf children (2016)
  • Author(s): Egusa, R., Sakai, T., Tamaki, H., Kusunoki, F., Namatame, M., Mizoguchi, H., & Inagaki, S
  • Organizer: Conference on Interaction Design and Children（IDC2016)
  • Place of Presentation: Manchester, UK
  • Year and Date: 2016-06-21
  • Int'l Joint Research
• [Presentation] Multiple-Player Full-Body Interaction Game to Enhance Young Children’s Cooperation (2016)
  • Author(s): Sakai T., Tamaki H., Ota Y., Egusa R., Yamaguchi E., Inagaki S., Kusunoki F.,Namatame M., Sugimoto M., & Mizoguchi. H
  • Organizer: Conference on Interaction Design and Children（IDC2016)
  • Place of Presentation: Manchester, UK
  • Year and Date: 2016-06-21
  • Int'l Joint Research
• [Presentation] COSEY: Computer Supported Enhancement of Young Children’s Cooperation : Toward a Multiple-player Cooperative Full-body Interaction Game (2016)
  • Author(s): Sakai, T., Tamaki, H., Yoshida, R., Egusa, R., Inagaki, S., Yamaguchi, & Kusunoki, F., Namatame, M., Sugimoto, M., & Mizoguchi, H.
  • Organizer: 8th International Conference on Computer Supported Education (CSEDU2016)
  • Place of Presentation: Rome,Italy
  • Year and Date: 2016-04-21
  • Int'l Joint Research
• [Presentation] A Full-Body Interaction Game for Children with Hearing Disabilities to Gain the Immersive Experience in a Puppet Show (2015)
  • Author(s): Egusa, R., Nakadai, T., Nakayama, T., Kusunoki, F., Namatame, M., Mizoguchi, H., & Inagaki, S.
  • Organizer: SocialEdu2015
  • Place of Presentation: Stanford University、CA,USA
  • Year and Date: 2015-08-18
  • Int'l Joint Research