• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Music system for improving hearing ability of deaf and hard of hearing persons

Research Project

Project/Area Number 26282001
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypePartial Multi-year Fund
Section一般
Research Field Design science
Research InstitutionTsukuba University of Technology

Principal Investigator

Hiraga Rumi  筑波技術大学, 産業技術学部, 教授 (70327021)

Co-Investigator(Kenkyū-buntansha) 寺澤 洋子  筑波大学, 図書館情報メディア系, 助教 (70579094)
松原 正樹  筑波大学, 図書館情報メディア系, 助教 (90714494)
田渕 経司  筑波大学, 医学医療系, 講師 (80361335)
Research Collaborator Hansen Kjetil Falkenberg  
Iversen John Reiner  
Project Period (FY) 2014-04-01 – 2019-03-31
Project Status Completed (Fiscal Year 2018)
Budget Amount *help
¥16,120,000 (Direct Cost: ¥12,400,000、Indirect Cost: ¥3,720,000)
Fiscal Year 2017: ¥3,250,000 (Direct Cost: ¥2,500,000、Indirect Cost: ¥750,000)
Fiscal Year 2016: ¥4,030,000 (Direct Cost: ¥3,100,000、Indirect Cost: ¥930,000)
Fiscal Year 2015: ¥3,250,000 (Direct Cost: ¥2,500,000、Indirect Cost: ¥750,000)
Fiscal Year 2014: ¥5,590,000 (Direct Cost: ¥4,300,000、Indirect Cost: ¥1,290,000)
Keywords聴覚障害 / 音楽聴取 / 音楽ゲーム / 聴能 / 聴取トレーニング / コミュニケーション / 音楽 / 音楽認識 / トレーニング / メディア情報 / コンテンツ / ゲーム / 音情景 / 環境音 / シリアスゲーム / ゲーミフィケーション / 学習
Outline of Final Research Achievements

Some deaf and hard of hearing (DHH) persons would like to get information from sounds and enjoy music. We believe that the hearing-ability of DHH persons to understand sounds could be improved by increasing exposure to sound with enjoyment. Thus we developed music games then investigated the effect of using the games in a certain period of time to the hearing-ability of DHH persons. While they enjoyed our games in a short term, we found issues in longitudinal experiments with games including the game-difficulties. In order to solve the issues, we need to understand more DHH persons’ hearing-ability, make game contents good for use by DHH, and establish the measurement of hearing-ability.

Academic Significance and Societal Importance of the Research Achievements

本研究は,聴覚障害者の聴能訓練に関連するものである.これについて,人工内耳に限定した学術的取り組みは,海外で数少ないながら見られる.本研究は,人工内耳装用者に限定せず,聴覚障害者に関し,音楽と環境音の聴こえについて研究を行ったことが他の研究には見られない点である.
補聴器具の性能向上に伴い,聴覚障害を持っていても,音への気づきに関してはこれまでよりも容易になってきたと考えられるが,音を理解する,という点に関しては,聴くことのトレーニングが必要である.音声のみならず,生活で触れる環境音や生活を豊かにする音楽を理解する聴き方についての研究を進めたことに社会的意義がある.

Report

(6 results)
  • 2018 Annual Research Report   Final Research Report ( PDF )
  • 2017 Annual Research Report
  • 2016 Annual Research Report
  • 2015 Annual Research Report
  • 2014 Annual Research Report
  • Research Products

    (53 results)

All 2018 2017 2016 2015 2014 Other

All Int'l Joint Research (5 results) Journal Article (5 results) (of which Int'l Joint Research: 1 results,  Peer Reviewed: 4 results,  Open Access: 1 results,  Acknowledgement Compliant: 1 results) Presentation (37 results) (of which Int'l Joint Research: 9 results,  Invited: 5 results) Remarks (4 results) Patent(Industrial Property Rights) (2 results)

  • [Int'l Joint Research] KTH Royal Instutite of Technology(スウェーデン)

    • Related Report
      2018 Annual Research Report
  • [Int'l Joint Research] University of California San Diego(米国)

    • Related Report
      2018 Annual Research Report
  • [Int'l Joint Research] KTH Royal Institute of Technology(Sweden)

    • Related Report
      2017 Annual Research Report
  • [Int'l Joint Research] KTH Royal Institute of Technology(Sweden)

    • Related Report
      2016 Annual Research Report
  • [Int'l Joint Research] KTH Royal Institute of Technology(Sweden)

    • Related Report
      2015 Annual Research Report
  • [Journal Article] A preliminary observation on the effect of visual information in learning environmental sounds for deaf and hard of hearing people2018

    • Author(s)
      Kato, Y., Hiraga, R., Wakatsuki, D., and Yasu, K
    • Journal Title

      Springer LNCS

      Volume: 10896 Pages: 183-186

    • DOI

      10.1007/978-3-319-94277-3_30

    • ISBN
      9783319942766, 9783319942773
    • Related Report
      2018 Annual Research Report
    • Peer Reviewed
  • [Journal Article] A subjective evaluation of music beat recognition with different timbres by hearing-impaired people2018

    • Author(s)
      Nakahara, Y., Hiraga, R., and Kato, N.
    • Journal Title

      Springer LNCS

      Volume: 10896 Pages: 207-210

    • DOI

      10.1007/978-3-319-94277-3_34

    • ISBN
      9783319942766, 9783319942773
    • Related Report
      2018 Annual Research Report
    • Peer Reviewed
  • [Journal Article] The Effects of Musical Experience and Hearing Loss on Solving an Audio-Based Gaming Task2017

    • Author(s)
      Hansen Kjetil、Hiraga Rumi
    • Journal Title

      Applied Sciences

      Volume: 7 Issue: 12 Pages: 1278-1278

    • DOI

      10.3390/app7121278

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] 聴覚障害児のための環境音学習システム―試作と今後の展望―2017

    • Author(s)
      平賀瑠美,加藤優,松原正樹,寺澤洋子,田原敬
    • Journal Title

      筑波技術大学テクノレポート

      Volume: 24(2) Pages: 17-21

    • NAID

      120006007426

    • Related Report
      2016 Annual Research Report
  • [Journal Article] 聴覚障害者向けタッピングゲームにおける視覚手がかりによるリズム認知の短期的学習効果2016

    • Author(s)
      松原正樹,狩野直哉,寺澤洋子,平賀瑠美
    • Journal Title

      情報処理学会論文誌

      Volume: 57(5) Pages: 1331-1340

    • NAID

      170000130967

    • Related Report
      2016 Annual Research Report 2015 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Presentation] 聴覚障害者の環境音道程に関する報告ーオープンセット課題における解答の傾向ー2018

    • Author(s)
      湯野 悠希、松原 正樹、寺澤 洋子、平賀 瑠美、田原 敬
    • Organizer
      情報処理学会 アクセシビリティ研究会
    • Related Report
      2018 Annual Research Report
  • [Presentation] Music for Deaf and Hard of Hearing persons: on beat2018

    • Author(s)
      Hiraga, R. and Terasawa, H.
    • Organizer
      OHMI Conference & Awards, Music & Physical Disability: from Instrument to Performance
    • Related Report
      2018 Annual Research Report
  • [Presentation] 視覚障害、聴覚障害における振動利用2018

    • Author(s)
      平賀 瑠美、加藤 優、佐藤 文一、設楽 明寿、馬場 哲晃、本多 達也、山崎 勇祐、井口正樹
    • Organizer
      情報処理学会アクセシビリティ研究会
    • Related Report
      2018 Annual Research Report
  • [Presentation] 環境音学習における視覚情報の有効性についての検討ー重度の障害者を対象とする場合ー2018

    • Author(s)
      加藤優 平賀瑠美 若月大輔 安啓一 寺澤洋子 松原正樹
    • Organizer
      日本音響学会
    • Related Report
      2017 Annual Research Report
  • [Presentation] 聴覚障害者の拍理解に有効な楽器音ー主観評価の分析ー2018

    • Author(s)
      中原夕夏 平賀瑠美 加藤伸子
    • Organizer
      日本音響学会
    • Related Report
      2017 Annual Research Report
  • [Presentation] 聴覚障害者の環境音同定に影響を及ぼす音響特徴量の検討2018

    • Author(s)
      湯野悠希 寺澤洋子 松原正樹 平賀瑠美 田原敬
    • Organizer
      日本音響学会
    • Related Report
      2017 Annual Research Report
  • [Presentation] 聴覚障害児を対象とした環境音学習のための音響特徴量の可視化に関する基礎的検討2018

    • Author(s)
      加藤優 平賀瑠美 若月大輔 安啓一
    • Organizer
      情報処理学会 アクセシビリティ研究会
    • Related Report
      2017 Annual Research Report
  • [Presentation] 聴覚障害者の楽器音による拍理解についてー楽器音分析の試みー2018

    • Author(s)
      中原夕夏 平賀瑠美 加藤伸子
    • Organizer
      情報処理学会 アクセシビリティ研究会
    • Related Report
      2017 Annual Research Report
  • [Presentation] 聴覚障害児のための環境音学習システムの開発2018

    • Author(s)
      平賀瑠美
    • Organizer
      日本音響学会
    • Related Report
      2017 Annual Research Report
  • [Presentation] A Preliminary Observation on the Effect of Visual Information in Learning Environmental Sounds for Deaf and Hard of Hearing People2018

    • Author(s)
      Yuu Kato, Rumi Hiraga, Daisuke Wakatsuki, Keiichi Yasu
    • Organizer
      International Conference on Computers Helping Pople with Special Needs
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A Subjective Evaluation of Music beat Recognition with Different Timbres by Hearing-Impaired People2018

    • Author(s)
      Yuka Nakahara, Rumi Hiraga, Nobuko Kato
    • Organizer
      International Conference on Computers Helping Pople with Special Needs
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 聴覚障害者の環境音同定における音響特徴の考察2017

    • Author(s)
      湯野悠希 松原正樹 田原敬 寺澤洋子 平賀瑠美
    • Organizer
      情報処理学会 アクセシビリティ研究会
    • Related Report
      2017 Annual Research Report
  • [Presentation] 聴覚障害者のための視覚情報を併用した環境音学習の基礎的検討2017

    • Author(s)
      加藤優 平賀瑠美 若月大輔 松原正樹 寺澤洋子
    • Organizer
      情報処理学会 アクセシビリティ研究会
    • Related Report
      2017 Annual Research Report
  • [Presentation] Playing Music Game by Hearing-Impaired Youth -how do they play the game?-,2017

    • Author(s)
      Rumi Hiraga and Kjetil Falkenberg Hansen
    • Organizer
      Yamada Symposium 2017 on “Neuroimaging of Natural Behaviors”
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] 生活・社会アクセシビリティ ーデフ・リケジョー2017

    • Author(s)
      加藤優 中原夕夏 赤間怜菜 西山小百合 小林なな恵 平井見奈 平賀瑠美 加藤伸子 若月大輔 大塚和彦
    • Organizer
      情報処理学会 アクセシビリティ研究会
    • Related Report
      2017 Annual Research Report
  • [Presentation] タッピングゲームの長期的な利用を通じた聴覚障害者のリズム認知能力に関する検討2016

    • Author(s)
      狩野 直哉, 松原 正樹, 寺澤 洋子, 平賀 瑠美
    • Organizer
      情報処理学会アクセシビリティ研究会
    • Place of Presentation
      国立情報学研究所
    • Year and Date
      2016-12-02
    • Related Report
      2016 Annual Research Report
  • [Presentation] Discrimination and identification of environmental sounds among people with hearing impairment2016

    • Author(s)
      Yuuki Yuno, Masaki Matsubara, Kei Tabaru, Hiroko Terasawa, Rumi Hiraga
    • Organizer
      第5回日米音響学会ジョイントミーティング
    • Place of Presentation
      Honolulu, Hawaii, USA
    • Year and Date
      2016-11-28
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Promote Active Listening with Music games2016

    • Author(s)
      Rumi Hiraga, Masaki Matsubara, Hiroko Terasawa, Kjetil Falkenberg Hansen
    • Organizer
      2016 Music & Cochlear Implants Symposium
    • Place of Presentation
      Elicksholm Research Center, Denmark
    • Year and Date
      2016-10-13
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 聴覚障害者の環境音知覚における弁別と同定の比較2016

    • Author(s)
      湯野 悠希, 松原 正樹, 田原 敬, 寺澤 洋子, 平賀 瑠美
    • Organizer
      情報処理学会アクセシビリティ研究会
    • Place of Presentation
      国立情報学研究所
    • Year and Date
      2016-07-29
    • Related Report
      2016 Annual Research Report
  • [Presentation] A Learning System for Environmental Sounds on Tablets: toward a teaching resource for deaf and hard of hearing children2016

    • Author(s)
      Rumi Hiraga, Yuu Kato, Masaki Matsubara, Hiroko Terasawa, Kei Tabaru
    • Organizer
      15th International Conference on Computing Helping People with Special Needs
    • Place of Presentation
      Linz, Austria
    • Year and Date
      2016-07-11
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A Learning System for Environmental Sounds on Tablets: toward a teaching resource for deaf and hard of hearing children2016

    • Author(s)
      Yuu Kato, Rumi Hiraga, Masaki Matsubara, Hiroko Terasawa, and Kei Tabaru
    • Organizer
      15th Int'l Conf. on Comp. Helping People with Special Needs
    • Place of Presentation
      Linz, Austria
    • Year and Date
      2016-07-11
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] タブレットを用いた環境音学習システム~聴覚障害児のための教材を目指して~2016

    • Author(s)
      加藤 優,平賀 瑠美,松原 正樹,寺澤 洋子,田原 敬
    • Organizer
      情報処理学会第78回全国大会
    • Place of Presentation
      慶応大学(神奈川県,横浜市)
    • Year and Date
      2016-03-10
    • Related Report
      2015 Annual Research Report
  • [Presentation] 聴覚障害者を対象とする環境音聴取テスト作成に向けた 弁別と同定に関する比較検討2016

    • Author(s)
      湯野悠希, 松原正樹, 田原敬, 寺澤洋子, 平賀瑠美
    • Organizer
      日本音響学会2016年春季研究発表会
    • Place of Presentation
      横浜桐蔭大学(神奈川県,横浜市)
    • Year and Date
      2016-03-09
    • Related Report
      2015 Annual Research Report
  • [Presentation] 環境音とコンテクスト理解を支援するシステム-聴覚障害児のため環境音学習システム -2016

    • Author(s)
      加藤 優,平賀 瑠美,松原 正樹,寺澤 洋子,田原 敬
    • Organizer
      電子情報通信学会福祉情報工学研究会
    • Place of Presentation
      筑波技術大学(茨城県,つくば市)
    • Year and Date
      2016-03-04
    • Related Report
      2015 Annual Research Report
  • [Presentation] 音楽聴取と聴覚障害2016

    • Author(s)
      平賀瑠美
    • Organizer
      筑波大学知的コミュニティ基盤研究センター第134回研究談話会
    • Place of Presentation
      筑波大学
    • Related Report
      2016 Annual Research Report
    • Invited
  • [Presentation] Working with music and hearing impaired students2016

    • Author(s)
      Rumi Hiraga
    • Organizer
      JSPS SAC Activity Seminar: "Music Interaction for Health-Novel Methods for Using Music Interaction to Address Wellbeing and Health Improvement in Training and Leisure
    • Place of Presentation
      KTH Royal Institute of Technology, Stockholm, Sweden
    • Related Report
      2016 Annual Research Report
    • Invited
  • [Presentation] インクルーシブ音楽情報処理2015

    • Author(s)
      大島千佳,寺澤洋子,馬場哲晃,平賀瑠美,松原正樹
    • Organizer
      情報処理学会音楽情報科学研究会
    • Place of Presentation
      金沢大学(石川県,金沢市)
    • Year and Date
      2015-11-07
    • Related Report
      2015 Annual Research Report
  • [Presentation] Music perception of hearing-impaired persons with focus on one test subject2015

    • Author(s)
      Rumi Hiraga, Kjetil F. Hansen, Naoya Kano, Masaki Matsubara, Hiroko Terasawa, and Keiji Tabuchi
    • Organizer
      IEEE SMC 2015
    • Place of Presentation
      Hong Kong
    • Year and Date
      2015-10-09
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Music listening among hearing-impaired youth2015

    • Author(s)
      Rumi Hiraga
    • Organizer
      Open seminar: KTH-CSC-MediaTechnology and Interaction Design
    • Place of Presentation
      KTH Royal Institute of Technology, Stockholm, Sweden
    • Year and Date
      2015-09-10
    • Related Report
      2015 Annual Research Report
    • Invited
  • [Presentation] Development and short-term evaluation of tapping game for hearing-impaired students2015

    • Author(s)
      Naoya Kano, Masaki Matsubara, Hiroko Terasawa, and Rumi Hiraga
    • Organizer
      Rhythm Production and Perception Workshop 2015
    • Place of Presentation
      Amsterdam, Netherlands
    • Year and Date
      2015-07-06
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 聴覚障害者と音楽2015

    • Author(s)
      平賀瑠美
    • Organizer
      聴覚障害者のための字幕付与技術シンポジウム2015
    • Place of Presentation
      京都大学(京都府,京都市)
    • Year and Date
      2015-04-18
    • Related Report
      2015 Annual Research Report
    • Invited
  • [Presentation] The effect of musical experience on rhythm perception for hearing-impaired undergraduates2014

    • Author(s)
      松原正樹,寺澤洋子,平賀瑠美
    • Organizer
      IEEE SMC 2014
    • Place of Presentation
      San Diego (USA)
    • Year and Date
      2014-10-05 – 2014-10-08
    • Related Report
      2014 Annual Research Report
  • [Presentation] Appreciating Harmony-differences between the hearing-impaired, musically inexperienced, and musically experienced2014

    • Author(s)
      平賀瑠美,松原正樹
    • Organizer
      IEEE SMC 2014
    • Place of Presentation
      San Diego (USA)
    • Year and Date
      2014-10-05 – 2014-10-08
    • Related Report
      2014 Annual Research Report
  • [Presentation] 聴覚障害学生に向けたタッピングゲームの開発と印象調査2014

    • Author(s)
      狩野直哉,松原正樹,寺澤洋子,平賀瑠美
    • Organizer
      情報処理学会音楽情報科学研究会
    • Place of Presentation
      京都大学(京都府京都市)
    • Year and Date
      2014-08-25 – 2014-08-27
    • Related Report
      2014 Annual Research Report
  • [Presentation] Using Music Visualizaiton Systems with Hearing-Impaired Children2014

    • Author(s)
      平賀瑠美,大塚和彦,松田周,高橋渓太郎
    • Organizer
      ICMPC13-APSCOM 5
    • Place of Presentation
      ソウル(韓国)
    • Year and Date
      2014-08-04 – 2014-08-08
    • Related Report
      2014 Annual Research Report
  • [Presentation] An Inquiry into Hearing-Impaired Student's Musical Activities--How do they Listen to the Music?2014

    • Author(s)
      松原正樹,寺澤洋子,K. F. Hansen,平賀瑠美
    • Organizer
      ICMPC13-APSCOM 5
    • Place of Presentation
      ソウル(韓国)
    • Year and Date
      2014-08-04 – 2014-08-08
    • Related Report
      2014 Annual Research Report
  • [Presentation] 聴覚障害学生を対象とした聴能向上のための音楽トレーニングプロジェクト2014

    • Author(s)
      松原正樹,K. F. Hansen,寺澤洋子,平賀瑠美
    • Organizer
      情報処理学会音楽情報科学研究会
    • Place of Presentation
      日本大学文理学部(東京都世田谷区)
    • Year and Date
      2014-05-24 – 2014-05-25
    • Related Report
      2014 Annual Research Report
  • [Remarks] Promote Active Listening with Music Games

    • Related Report
      2018 Annual Research Report
  • [Remarks] Promote Active Listening with Music Games

    • Related Report
      2017 Annual Research Report
  • [Remarks] Promote Active Listening with Music Games

    • URL

      http://www.a.tsukuba-tech.ac.jp/el/~rhiraga/researchhi5.html

    • Related Report
      2016 Annual Research Report
  • [Remarks] Promote active-listening with music games

    • URL

      http://www.a.tsukuba-tech.ac.jp/el/~rhiraga/researchhi5.html

    • Related Report
      2015 Annual Research Report 2014 Annual Research Report
  • [Patent(Industrial Property Rights)] 特許2016

    • Inventor(s)
      平賀瑠美
    • Industrial Property Rights Holder
      平賀瑠美
    • Industrial Property Rights Type
      特許
    • Filing Date
      2016-02-23
    • Related Report
      2015 Annual Research Report
  • [Patent(Industrial Property Rights)] 特許2016

    • Inventor(s)
      松原正樹,寺澤洋子,田原敬,平賀瑠美
    • Industrial Property Rights Holder
      松原正樹,寺澤洋子,田原敬,平賀瑠美
    • Industrial Property Rights Type
      特許
    • Filing Date
      2016-02-23
    • Related Report
      2015 Annual Research Report

URL: 

Published: 2014-04-04   Modified: 2020-03-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi