• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Multisensory Methods for Teaching Onomatopoeia to the Hearing-impaired - Broadening the Experience of Sound.

Research Project

Project/Area Number 15K12122
Research Category

Grant-in-Aid for Challenging Exploratory Research

Allocation TypeMulti-year Fund
Research Field Kansei informatics
Research InstitutionTsukuba University of Technology

Principal Investigator

namatame miki  筑波技術大学, 産業技術学部, 教授 (20320624)

Co-Investigator(Kenkyū-buntansha) 楠 房子  多摩美術大学, 美術学部, 教授 (40192025)
稲垣 成哲  神戸大学, 人間発達環境学研究科, 教授 (70176387)
Research Collaborator KANEBAKO Junichi  慶応義塾大学, 大学院・メディアデザイン研究科, 研究員
Project Period (FY) 2015-04-01 – 2018-03-31
Project Status Completed (Fiscal Year 2017)
Budget Amount *help
¥3,510,000 (Direct Cost: ¥2,700,000、Indirect Cost: ¥810,000)
Fiscal Year 2017: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2016: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Fiscal Year 2015: ¥910,000 (Direct Cost: ¥700,000、Indirect Cost: ¥210,000)
Keywords音声情報 / 振動 / 聴覚障害者 / オノマトペ / 擬音語 / リズム / 音 / 共感覚
Outline of Final Research Achievements

It is difficult for hearing-impaired individuals to learn animal sounds and the onomatopoeia that depict them because they have limited or no access to auditory information. To attempt to solve this problem, we developed a device could convert audio information into vibrations. We examined the effect of tactile stimuli for rhythm discrimination used the device. In the rhythm discrimination test, the hearing-impaired showed better performance in Audio+Vibration than Audio. Then we designed a science lesson to help hearing-impaired students learn cicada songs. This lesson used multiple media including text, images, sounds, sound waveforms, onomatopoeia and vibrations to stimulate the senses of sight, hearing and touch. An experiment was conducted on 26 hearing-impaired students. The results that the students who were able to discriminate among the different vibrations reported that they found the lesson enjoyable and that it was a useful way to learn science.

Report

(4 results)
  • 2017 Annual Research Report   Final Research Report ( PDF )
  • 2016 Research-status Report
  • 2015 Research-status Report
  • Research Products

    (7 results)

All 2018 2017 2016 2015

All Journal Article (2 results) (of which Peer Reviewed: 2 results,  Acknowledgement Compliant: 1 results) Presentation (5 results) (of which Int'l Joint Research: 2 results)

  • [Journal Article] Basic Research on Multisensory Methods for Teaching Onomatopoeia to the Hearing-impaired - Broadening the Experience of Sound.2018

    • Author(s)
      Namatame M., Kusunoki F. and Inagaki S.
    • Journal Title

      Computer Supported Education

      Volume: 1 Pages: 22-27

    • DOI

      10.5220/0006665800220027

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed
  • [Journal Article] KIKIVIBE(キキビブ):音を振動で感じる共遊楽器2015

    • Author(s)
      金箱淳一,楠房子,稲垣成哲,生田目美紀
    • Journal Title

      日本デザイン学会,デザイン学研究作品集

      Volume: 21 Pages: 14-17

    • NAID

      130005148416

    • Related Report
      2015 Research-status Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Presentation] 振動刺激が聴覚障害者のリズム弁別成績と印象に与える効果2017

    • Author(s)
      金箱淳一
    • Organizer
      2017年 日本感性工学会春季大会
    • Place of Presentation
      学校法人上田学園上田安子服飾専門学校
    • Year and Date
      2017-03-29
    • Related Report
      2016 Research-status Report
  • [Presentation] 振動刺激が聴覚障害者のリズム弁別成績と印象に与える効果2017

    • Author(s)
      金箱淳一
    • Organizer
      日本感性工学会春季大会
    • Related Report
      2017 Annual Research Report
  • [Presentation] 触覚情報は聴覚障害者の理科学習に役立つか?2017

    • Author(s)
      生田目美紀
    • Organizer
      情報処理学会アクセシビリティ研究会
    • Related Report
      2017 Annual Research Report
  • [Presentation] Effect Of Vibration On Listening Sound With Hearing Impaired2016

    • Author(s)
      KANEBAKO. J., NAMATAME. M. and YAMANAKA. T.
    • Organizer
      International Conference on Computers Helping People with Special Needs
    • Place of Presentation
      Linz, Austria
    • Year and Date
      2016-07-13
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] Proposal for Science Learning Materials using a "VibGrip"2015

    • Author(s)
      KANEBAKO. J., NAMATAME. M., KUSUNOKI. F. and INAGAKI. S.
    • Organizer
      International Conference on Advances in Computer Entertainment Technology
    • Place of Presentation
      Iskandar, Malaysia
    • Year and Date
      2015-11-16
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research

URL: 

Published: 2015-04-16   Modified: 2019-03-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi