• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Measurement of colored-hearing synesthesia-Non-verbal mapping between sound and color-

Research Project

Project/Area Number 17560382
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field Measurement engineering
Research InstitutionKwansei Gakuin University

Principal Investigator

NAGATA Noriko  Kwansei Gakuin University, School of Science and Technology, Associate Professor, 理工学部, 助教授 (50368453)

Co-Investigator(Kenkyū-buntansha) INOKUCHI Seiji  Takarazuka University of Art and Design, Faculty of Media Contents, Professor, メディア・コンテンツ学部, 教授 (90029463)
SUGIO Takeshi  Doshisha University, Faculty of Culture and Information Science, Lecturer, 文化情報学部専任, 講師 (60335205)
FUJISAWA Takashi  Kwansei Gakuin University, School of Science and Technology, Post-Doctoral Researcher, 理工学研究科, 博土研究員 (90434894)
Project Period (FY) 2005 – 2006
Project Status Completed (Fiscal Year 2006)
Budget Amount *help
¥3,400,000 (Direct Cost: ¥3,400,000)
Fiscal Year 2006: ¥1,500,000 (Direct Cost: ¥1,500,000)
Fiscal Year 2005: ¥1,900,000 (Direct Cost: ¥1,900,000)
KeywordsColored-hearing / Synesthesia / fMRI / Color perception / Music / Visual / Interaction / CM
Research Abstract

(1)Brain activity in colored-hearing synesthetes when listening to music : an fMRI study
We measured brain activity in colored-hearing (musical tonality-color ) synesthesia, in which a person sees colors when listening to music, by using functional magnetic resonance imaging (fMRI). We compared the images acquired from two colored-hearing subjects and 11 non-colored-hearing subjects when listening to various kinds of music. The results showed that the fusiform gyrus, cerebellum, right lateral inferior parietal lobule and superior frontal gyrus were activated only in the colored-hearing synesthetes. Moreover we found that the area of activity in the cerebellum and the color area, V4/V8 (V4 complex), in the fusiform gyrus which was also activated, are next to each other, and were activated coincidently. It indicates that colored-hearing synesthetes actually perceive colors when listening to music and that they experience a direct interaction between the auditory and visual modalities. In … More addition, this suggests evidence for the synesthesia cross-wiring hypothesis that there is a strong neurological connection between the color V4 complex and the cerebellum, and that the activity in the V4 complex occurs as a result of the activity of the cerebellum caused by listening to music.
(2)Interactions between pictures and music in TV commercials-
We presented an analysis of the relationship between the elements of pictures and music which make up commercials. In order to clarify the interactions between the expressions of pictures and music, the expressions were classified into 9 elements, 71categories. These categories were applied to commercial samples using Hayashi's Quantification Theory III. The result shows picture and music elements contribute greatly to the impression such as Exciting-Calm and Homely-Sophisticated made by commercial. We have been also successful in clarifying the relationship between basic elements such as color tone and tonality, indicating the probability of their appeal to the subconscious feelings of human beings. Less

Report

(3 results)
  • 2006 Annual Research Report   Final Research Report Summary
  • 2005 Annual Research Report
  • Research Products

    (21 results)

All 2007 2006 2005

All Journal Article (19 results) Book (2 results)

  • [Journal Article] An fMRI Study of Synesthesia - Brain activity in colored-hearing by listening to music -2007

    • Author(s)
      Takahashi, R
    • Journal Title

      Proc. 13th Annual Meeting of the Organization for Human Brain Mapping

      Pages: 204-204

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Annual Research Report 2006 Final Research Report Summary
  • [Journal Article] Brain Activity in Colored-hearing by Listening to Music : An fMRI Study2007

    • Author(s)
      Takahashi, R
    • Journal Title

      Proc. Second International Congress Synaesthesia, Science & art

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] An fMRI Study of Synesthesia-Brain activity in colored-hearing by listening to music-2007

    • Author(s)
      Takahashi, R.
    • Journal Title

      Proc.13th Annual Meetingof the Organization for Human Brain Mapping

      Pages: 204-204

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Brain activity in colored-hearing by listening to music : An fMRI study2007

    • Author(s)
      Takahashi, R.
    • Journal Title

      Proc.Second International Congress Synaesthesia, Science & art, RIUMA.pdf,

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Brain Activity in Colored-hearing by Listening to Music : An fMRI Study2007

    • Author(s)
      Takahashi, R
    • Journal Title

      Proc. Second International Congress Synaesthesia, Science & art (in press)

    • Related Report
      2006 Annual Research Report
  • [Journal Article] fMRIによる共感覚の計測-色聴者の音楽聴取時の脳活動-2006

    • Author(s)
      高橋理宇眞
    • Journal Title

      情報処理学会研究報告2006-MUS-66 2006・90

      Pages: 105-108

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Annual Research Report 2006 Final Research Report Summary
  • [Journal Article] fMRI Study of Synesthesia Brain activation in colored-hearing by listening to music2006

    • Author(s)
      Takahashi, R.
    • Journal Title

      Information Processing Society of Japan (IPSJ) SIG Notes, 2006-MUS-66-(17) Vol.2006,No.90

      Pages: 105-108

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Non-verbal Mapping between Sound and Color2005

    • Author(s)
      Nagata, N.
    • Journal Title

      Entertainment Computing - ICEC2005, Lecture Notes in Computer Science 3711

      Pages: 401-412

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Quality of Multimedia Contents - Interactions between Pictures and Music of TV Commercials -2005

    • Author(s)
      Takashima, A.
    • Journal Title

      Proc. 7th International Conference on Quality Control by Artificial Vision

      Pages: 329-334

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] CMにおける映像と音楽のインタラクション2005

    • Author(s)
      高島杏菜
    • Journal Title

      情報処理学会関西支部大会講演論文集 A-10

      Pages: 37-40

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary 2005 Annual Research Report
  • [Journal Article] fMRIによる共感覚計測 : 色聴者の音楽視聴時のV4/V8活動2005

    • Author(s)
      横井真一
    • Journal Title

      日本認知心理学会第3回大会講演論文集

      Pages: 11-11

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] CMにおける映像と音楽のインタラクション2005

    • Author(s)
      高島杏菜
    • Journal Title

      電気学会研究会 IP-05-03

      Pages: 13-18

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary 2005 Annual Research Report
  • [Journal Article] Non-verbal Mapping between Sound and Color2005

    • Author(s)
      Nagata, N.
    • Journal Title

      Entertainment Computing-ICEC2005, Lecture Notes in Computer Science 3711

      Pages: 401-412

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary 2005 Annual Research Report
  • [Journal Article] Quality of Multimedia Contents-Interactions between Pictures and Music of TV Commercials-2005

    • Author(s)
      Takashima, A.
    • Journal Title

      Proc.7th International Conference on Quality Control by Artificial Vision

      Pages: 329-334

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary 2005 Annual Research Report
  • [Journal Article] A picture in a commercial and an interaction of music2005

    • Author(s)
      Anna Takashima
    • Journal Title

      Information Processing Society Kansai branch office meet lecture memoirs A-10

      Pages: 37-40

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] A synesthesia measurement by fMRI : V4/V8 activity at the time of the music seeing and hearing of a person of chromesthesia2005

    • Author(s)
      Shinichi Yokoi
    • Journal Title

      Japanese cognitive psychology society level three times meet lecture memoirs

      Pages: 11-11

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] A picture in a commercial and an interaction of music2005

    • Author(s)
      Anna Takashima
    • Journal Title

      Institute of Electrical Engineers of Japan meeting for the study IP-05-03

      Pages: 13-18

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Entertainment Computing-ICEC 2005, Lecture Notes in Computer Science 37112005

    • Author(s)
      Fumiko kishino
    • Journal Title

      (Springer-Verlag)

      Pages: 538-538

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] fMRIによる共感覚計測:色聴者の音楽視聴時のV4/V8活動2005

    • Author(s)
      横井真一
    • Journal Title

      日本認知心理学会第3回大会講演論文集

      Pages: 11-11

    • Related Report
      2005 Annual Research Report
  • [Book] Entertainment Computing - ICEC 2005, Lecture Notes in Computer Science 37112005

    • Author(s)
      Fumio kishino編
    • Total Pages
      538
    • Publisher
      Springer-Verlag
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Book] Entertainment Computing-ICEC 2005, Lecture Notes in Computer Science 37112005

    • Author(s)
      Fumio Kishino編
    • Total Pages
      538
    • Publisher
      Springer-Verlag
    • Related Report
      2005 Annual Research Report

URL: 

Published: 2005-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi