• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Toward the music communication by hearing-impaired people

Research Project

Project/Area Number 23611005
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Research Field Design science
Research InstitutionTsukuba University of Technology

Principal Investigator

HIRAGA Rumi  筑波技術大学, 産業技術学部, 教授 (70327021)

Co-Investigator(Kenkyū-buntansha) OTSUKA Kazuhiko  筑波技術大学, 筑波技術大学, 准教授 (80331304)
Project Period (FY) 2011 – 2013
Project Status Completed (Fiscal Year 2013)
Budget Amount *help
¥5,330,000 (Direct Cost: ¥4,100,000、Indirect Cost: ¥1,230,000)
Fiscal Year 2013: ¥2,080,000 (Direct Cost: ¥1,600,000、Indirect Cost: ¥480,000)
Fiscal Year 2012: ¥1,690,000 (Direct Cost: ¥1,300,000、Indirect Cost: ¥390,000)
Fiscal Year 2011: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Keywords演奏可視化 / 聴覚障害 / 演奏支援 / 特殊教育 / 音楽認知 / 音楽支援 / 演奏認識 / 可視化
Research Abstract

We built two software systems that show the visualization of music performance for hearing-impaired people to enjoy music. In both systems, animation is shown that is controlled by the pitch and amplitude of musical performance. We showed these systems to kindergarten pupils, elementary school and junior high school students who have hearing impairment. They used our systems by playing musical instruments by themselves with joy and excitement.
In order to include information that hearing-impaired people recognize in music in the system, we have conducted cognitive experiments with them. During the period, we conducted experiments on discrimination of timbre and preference to harmonies. Since the results showed that hearing-impaired people recognize difference of timbre and harmonies less compared to hearing people, we did not include the information in the systems.

Report

(4 results)
  • 2013 Annual Research Report   Final Research Report ( PDF )
  • 2012 Research-status Report
  • 2011 Research-status Report
  • Research Products

    (8 results)

All 2014 2013 2012 2011

All Journal Article (5 results) (of which Peer Reviewed: 5 results) Presentation (3 results)

  • [Journal Article] Sound preferences of persons with hearing loss playing an audio-based computer game2013

    • Author(s)
      Rumi Hiraga, Kjetil F. Hansen
    • Journal Title

      Proceedings of the 3rd ACM International Workshop on Interactive Multimedia on Mobile & Portable Devices

      Volume: IMMPD '13 Pages: 25-30

    • DOI

      10.1145/2505483.2505489

    • Related Report
      2013 Final Research Report
    • Peer Reviewed
  • [Journal Article] On the recognition of timbre - A first step toward understanding how hearing-impaired people perceive timbre2013

    • Author(s)
      Rumi Hiraga, Kazuhiko Otsuka
    • Journal Title

      2012 IEEE International Conference on Systems, Man, and Cybernetics

      Pages: 2103-2108

    • DOI

      10.1109/icsmc.2012.6378050

    • Related Report
      2013 Final Research Report
    • Peer Reviewed
  • [Journal Article] Emotion recognition in polygons and curved shapes2013

    • Author(s)
      Rumi Hiraga
    • Journal Title

      2011 IEEE International Conference on Systems, Man, and Cybernetics

      Volume: 2011 Pages: 3286-3291

    • DOI

      10.1109/icsmc.2011.6084176

    • Related Report
      2013 Final Research Report 2011 Research-status Report
    • Peer Reviewed
  • [Journal Article] Conveying Emotion with Moving Images2013

    • Author(s)
      Rumi Hiraga, Keitaro Takahashi
    • Journal Title

      Relationship between Movement and Emotion

      Volume: LNCS Springer 6974 Pages: 558-567

    • DOI

      10.1007/978-3-642-24600-5_59

    • ISBN
      9783642245992, 9783642246005
    • Related Report
      2013 Final Research Report
    • Peer Reviewed
  • [Journal Article] Conveying Emotion with Moving Images: relationship between movement and emotion2011

    • Author(s)
      平賀瑠美
    • Journal Title

      LNCS

      Volume: 6974 Pages: 558-567

    • Related Report
      2011 Research-status Report
    • Peer Reviewed
  • [Presentation] Using music visualization systems with hearing-impaired children2014

    • Author(s)
      Rumi Hiraga, Kazuhiko Otsuka, Shu Matsuda, Keitaro Takahashi
    • Organizer
      The 13th International Conference on Music Perception and Cognition and The 5th Conference for the Asia-Pacific Society for Cognitive Science of Music
    • Place of Presentation
      Seoul, Korea(発表決定)
    • Year and Date
      2014-08-06
    • Related Report
      2013 Final Research Report
  • [Presentation] Using music visualization systems with hearing-impaired children2014

    • Author(s)
      平賀瑠美
    • Organizer
      International Conference on Music Perception and Cognition
    • Place of Presentation
      Yonsei University (Seoul, Korea)
    • Related Report
      2013 Annual Research Report
  • [Presentation] On the recognition of Timbre, A first step toward understanding how hearing-impaired people perceive timbre2012

    • Author(s)
      平賀瑠美
    • Organizer
      IEEE International Conference on Systems, Man, and Cybernetics
    • Place of Presentation
      Convention and Exhibition Center, Seoul, Korea
    • Related Report
      2012 Research-status Report

URL: 

Published: 2011-08-05   Modified: 2019-07-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi