• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to project page

2013 Fiscal Year Final Research Report

Toward the music communication by hearing-impaired people

Research Project

  • PDF
Project/Area Number 23611005
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Research Field Design science
Research InstitutionTsukuba University of Technology

Principal Investigator

HIRAGA Rumi  筑波技術大学, 産業技術学部, 教授 (70327021)

Co-Investigator(Kenkyū-buntansha) OTSUKA Kazuhiko  筑波技術大学, 筑波技術大学, 准教授 (80331304)
Project Period (FY) 2011 – 2013
Keywords演奏可視化 / 聴覚障害 / 演奏支援 / 特殊教育 / 音楽認知
Research Abstract

We built two software systems that show the visualization of music performance for hearing-impaired people to enjoy music. In both systems, animation is shown that is controlled by the pitch and amplitude of musical performance. We showed these systems to kindergarten pupils, elementary school and junior high school students who have hearing impairment. They used our systems by playing musical instruments by themselves with joy and excitement.
In order to include information that hearing-impaired people recognize in music in the system, we have conducted cognitive experiments with them. During the period, we conducted experiments on discrimination of timbre and preference to harmonies. Since the results showed that hearing-impaired people recognize difference of timbre and harmonies less compared to hearing people, we did not include the information in the systems.

  • Research Products

    (5 results)

All 2014 2013

All Journal Article (4 results) (of which Peer Reviewed: 4 results) Presentation (1 results)

  • [Journal Article] Sound preferences of persons with hearing loss playing an audio-based computer game2013

    • Author(s)
      Rumi Hiraga, Kjetil F. Hansen
    • Journal Title

      Proceedings of the 3rd ACM International Workshop on Interactive Multimedia on Mobile & Portable Devices

      Volume: IMMPD '13 Pages: 25-30

    • DOI

      10.1145/2505483.2505489

    • Peer Reviewed
  • [Journal Article] On the recognition of timbre - A first step toward understanding how hearing-impaired people perceive timbre2013

    • Author(s)
      Rumi Hiraga, Kazuhiko Otsuka
    • Journal Title

      2012 IEEE International Conference on Systems, Man, and Cybernetics

      Pages: 2103-2108

    • DOI

      10.1109/ICSMC.2012.6378050

    • Peer Reviewed
  • [Journal Article] Emotion recognition in polygons and curved shapes2013

    • Author(s)
      Rumi Hiraga
    • Journal Title

      2011 IEEE International Conference on Systems, Man, and Cybernetics

      Pages: 3286-3291

    • DOI

      10.1109/ICSMC.2011.6084176

    • Peer Reviewed
  • [Journal Article] Conveying Emotion with Moving Images2013

    • Author(s)
      Rumi Hiraga, Keitaro Takahashi
    • Journal Title

      Relationship between Movement and Emotion

      Volume: LNCS Springer 6974 Pages: 558-567

    • DOI

      10.1007/978-3-642-24600-5_59

    • Peer Reviewed
  • [Presentation] Using music visualization systems with hearing-impaired children2014

    • Author(s)
      Rumi Hiraga, Kazuhiko Otsuka, Shu Matsuda, Keitaro Takahashi
    • Organizer
      The 13th International Conference on Music Perception and Cognition and The 5th Conference for the Asia-Pacific Society for Cognitive Science of Music
    • Place of Presentation
      Seoul, Korea(発表決定)
    • Year and Date
      2014-08-06

URL: 

Published: 2015-07-16  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi