• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Toward the enhancement of music performance recognition with visualization and an application system for hearing-impaired people

Research Project

Project/Area Number 16500138
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field Sensitivity informatics/Soft computing
Research InstitutionTsukuba University of Technology (2007)
Bunkyo University (2004-2006)

Principal Investigator

HIRAGA Rumi  Tsukuba University of Technology, Industrial Technology, Professor (70327021)

Co-Investigator(Kenkyū-buntansha) KATO Nobuko  Tsukuba University of Technology, Industrial Technology, Associate Professor (90279555)
Project Period (FY) 2004 – 2007
Project Status Completed (Fiscal Year 2007)
Budget Amount *help
¥3,970,000 (Direct Cost: ¥3,700,000、Indirect Cost: ¥270,000)
Fiscal Year 2007: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2006: ¥700,000 (Direct Cost: ¥700,000)
Fiscal Year 2005: ¥1,000,000 (Direct Cost: ¥1,000,000)
Fiscal Year 2004: ¥1,100,000 (Direct Cost: ¥1,100,000)
KeywordsHearing Impairment / Performance Recognition / Visualization / Performance Expression / Encoding of an Emotion / Decoding of an Emotion / Communication / 感情表現 / メディア / 演奏 / 図形 / 認知 / 図形認知 / 演奏可視化 / 音楽情報
Research Abstract

We have investigated the basic research on two points. A) music performance visualization and B) cognition of music performance by hearing-impaired people. With the purpose of building a support system for music performance by hearing-impaired people, we conducted several experiments on recognition of emotions in drum performances of improvised style. We proposed stimuli of sound only, sound and drawings of the same intended emotion, sound and moving picture of no intended emotion to two types of subjects, hearing-impaired people and people with hearing abilities, then compared the recognition of emotion in drum performance between subject groups. We found some notable results. 1. There were no significant differences in the recognition of emotion in drum performances between two subject groups except for one stimulus. 2. Subjects with hearing-impairment recognized the motion in drum performances by professional drummer, people with hearing ability, and people with hearing-impairment with no significant differences, while subjects with hearing ability did with significant difference. Performances by professionals were recognized differently between two subject groups. 3. Subjects recognized emotions the most with the stimulus type of sound with a drawing of the same intended emotion.
There have not been many research works on music recognition by hearing-impaired people. We were able to obtain several interesting findings on performance visualization and performance recognition by hearing-impaired people with our four-year research that we can use in our future research.

Report

(5 results)
  • 2007 Annual Research Report   Final Research Report Summary
  • 2006 Annual Research Report
  • 2005 Annual Research Report
  • 2004 Annual Research Report
  • Research Products

    (27 results)

All 2007 2006 2005 2004 Other

All Journal Article (24 results) (of which Peer Reviewed: 9 results) Presentation (1 results) Remarks (2 results)

  • [Journal Article] Recognition of intended emotions in drum performances: differences and similarities between hearing-impaired people and people with normal hearing ability2006

    • Author(s)
      Hiraga, R. Yamazaki, A., and Kato, N.
    • Journal Title

      Proceedings of International Conference on Music Perception and Cognition

      Pages: 219-224

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] Performance Visualization for Hearing-Impaired Students2006

    • Author(s)
      Hiraga, R. and Kawashima, M.
    • Journal Title

      Journal of Systemics, Cybernetics and Informatics 3:5

      Pages: 24-32

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] Understanding emotion through Drawings: comparison between hearing-impaired people and people with normal hearing abilities2006

    • Author(s)
      Hiraga, R. and Kato, N.
    • Journal Title

      Proceedings of IEEE International Conference on Systems, Man, and Cybernetics

      Pages: 103-108

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] Understanding Emotion through Multimedia: comparison between hearing-impaired people and people with hearing abilities2006

    • Author(s)
      Hiraga, R. and Kato, N.
    • Journal Title

      Proceedings of the Eighth International ACM SIGACCESS Conference on Computers and Accessibility

      Pages: 141-148

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] Performance Visualization for Hearing-Impaired Students2006

    • Author(s)
      Hiraga, R. and Kawashima, M.
    • Journal Title

      Journal of Systemics, Cybernetics and Informatics

      Pages: 24-32

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] Recognition of intended emotions in drum performances : differences and similarities between hearing-impaired people and people with normal hearing ability2006

    • Author(s)
      Rumi Hiraga
    • Journal Title

      Proceedings of International Conference on Music Perception and Cognition (CD-ROM)

      Pages: 6-6

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Performance Visualization for Hearing-Impaired Students2006

    • Author(s)
      Rumi Hiraga
    • Journal Title

      Journal of Systemics, Cybernetics and Informatics 3・5(online Journal)

      Pages: 9-9

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Understanding emotion through drawings comparison between hearing-impaired people and people with normal hearing abilities2006

    • Author(s)
      Rumi Hiraga
    • Journal Title

      Proceedings of IEEE International Conference on Systems, Man. and Cybernetics

      Pages: 6-6

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Understanding Emotion through Multimedia comparison between hearing-impaired people and people with hearing abilities2006

    • Author(s)
      Rumi Hiraga
    • Journal Title

      Proceedings of The Eighth International ACM SIGACCESS Conference on Computers and Accessibility

      Pages: 8-8

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Expression of Emotion by Hearing-Impaired People though Playing of Drum Set2005

    • Author(s)
      Hiraga, R., Yamazaki, A., and Kato, N.
    • Journal Title

      The 9th World Multi-Conference on Systemics, Cybernetics, and Informatics (Proceedings CD-ROM)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] Cognition of Emotion on a Drum Performance by hearing-impaired people2005

    • Author(s)
      Hiraga, R., Yamazaki, A., and Kato, N.
    • Journal Title

      HCI International 2005(Proceedings CD-ROM)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] Cognition of Emotion on a Drum Performance by hearing-impaired people2005

    • Author(s)
      Hiraga, R., Yamazaki, A., and Kato, N.
    • Journal Title

      HCI International 2005 (Proceedings CD-ROM)

      Pages: 4-4

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] Expression of Emotion by Hearing-Impaired People through Playing of Drum Set2005

    • Author(s)
      平賀瑠美, 山崎晃男, 加藤伸子
    • Journal Title

      The 9th World Multi-Conference on Systemics, Cybernetics and Informatics (SCI 2005) (CD-ROM)

      Pages: 4-4

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Cognition of Emotion on a Drum Performance by hearing-impaired people2005

    • Author(s)
      平賀瑠美, 山崎晃男, 加藤伸子
    • Journal Title

      HCI International 2005 (CD-ROM)

      Pages: 4-4

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Visualization of Music Performance as an Aid to Listener's Comprehension2004

    • Author(s)
      Hiraga, R. and Matsuda, N.
    • Journal Title

      Proc. of Advanced Visual Interface 2004

      Pages: 103-105

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] Graphical Expression of the Mood of Music2004

    • Author(s)
      Hiraga, R. and Matsuda, N.
    • Journal Title

      The 2004 IEEE International Conference on Multimedia and Expo (Proceedings CD-ROM)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] Performance Visualization for Hearing Impaired Students2004

    • Author(s)
      Hiraga, R. and Kawashima, M.
    • Journal Title

      Proceedings of International Conference on Education and Information Systems: Technologies and Applications

      Pages: 323-328

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] Visualization of Music Performance as an Aid to Listener's Comprehension2004

    • Author(s)
      Hiraga, R. and Matsuda, N.
    • Journal Title

      Proceedings of Advanced Visual Interface 2004

      Pages: 103-105

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] Performance Visualization for Hearing Impaired Students2004

    • Author(s)
      Hiraga, R. and Kawashima,M.
    • Journal Title

      Proceedings of International Conference on Education and Information Systems: Technologies and Applications

      Pages: 323-328

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] Visualization of Music Performance as an Aid to Listener's Comprehension2004

    • Author(s)
      Hiraga, R., Matsuda, N.
    • Journal Title

      Proc. of Advanced Visual Interfaces 2004

      Pages: 103-106

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Graphical Expression of the Mood of Music2004

    • Author(s)
      Hiraga, R., Matsuda, N.
    • Journal Title

      The 2004 IEEE International Conference on Multimedia and Expo (Proceedings) (CD-ROM)

      Pages: 4-4

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Performance Visualization for Hearing Impaired Students2004

    • Author(s)
      Hiraga, R., Kawashima, M.
    • Journal Title

      Proc. of International Conference on Education and Information Systems : Technologies and Applications

      Pages: 323-328

    • Related Report
      2004 Annual Research Report
  • [Journal Article] comp-i : a system for visual exploration and editing of MIDI datasets2004

    • Author(s)
      Miyazaki, R., Fujishiro, I., Hiraga, R.
    • Journal Title

      Proc. of International Computer Music Conference

      Pages: 157-164

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Emotional communication through music performance played by hearing impaired people

    • Author(s)
      山崎晃男, 平賀瑠美, 加藤伸子
    • Journal Title

      The Neurosciences and Music II (口頭発表)

    • Related Report
      2005 Annual Research Report
  • [Presentation] The catch and throw of music emotion by hearing-impaired people2007

    • Author(s)
      平賀瑠美
    • Organizer
      International Conference on Music Communication Science
    • Place of Presentation
      Sydney, Australia
    • Year and Date
      2007-12-06
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Annual Research Report 2007 Final Research Report Summary
  • [Remarks] 「研究成果報告書概要(和文)」より

    • URL

      http://www.a.tsukuba-tech.ac.jp/el/~rhiraga/

    • Related Report
      2007 Final Research Report Summary
  • [Remarks]

    • URL

      http://www.a.tsukuba-tech.ac.jp/el/~rhiraga/researchhi2.html

    • Related Report
      2007 Annual Research Report

URL: 

Published: 2004-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi