A mechanism on cross-modal interactions of synesthesia-Functional neuroimaging of colored-hearing synesthesia and digital media
| Project/Area Number |
21300086
|
|---|
| Research Category |
Grant-in-Aid for Scientific Research (B)
|
| Allocation Type | Single-year Grants |
|---|
| Section | 一般 |
|---|
| Research Field |
Sensitivity informatics/Soft computing
|
|---|
| Research Institution | Kwansei Gakuin University |
|---|
Principal Investigator |
NAGATA Noriko 関西学院大学, 理工学部, 教授 (50368453)
|
|---|
| Co-Investigator(Kenkyū-buntansha) |
FUJISAWA Takashi 長崎大学, 医歯薬学総合研究科, 助教 (90434894)
INOKUCHI Seiji 宝塚大学, 造形芸術学部, 講師 (90029463)
KURODA Kagayaki 東海大学, 情報理工学部, 教授 (70205243)
AIBA Eriko 関西学院大学, 理工学部, 研究員 (40569761)
SHIMOTOMAI Takayuki 玉川大学, 脳科学研究所, 特別研究員 (50415361)
|
|---|
| Project Period (FY) |
2009 – 2011
|
| Project Status |
Completed (Fiscal Year 2011)
|
| Budget Amount *help |
¥10,660,000 (Direct Cost: ¥8,200,000、Indirect Cost: ¥2,460,000)
Fiscal Year 2011: ¥3,120,000 (Direct Cost: ¥2,400,000、Indirect Cost: ¥720,000)
Fiscal Year 2010: ¥3,380,000 (Direct Cost: ¥2,600,000、Indirect Cost: ¥780,000)
Fiscal Year 2009: ¥4,160,000 (Direct Cost: ¥3,200,000、Indirect Cost: ¥960,000)
|
|---|
| Keywords | 感性情報処理 / 計測工学 / 脳 / 神経 / マルチモーダルインタフェース / 共感覚 / 色聴 / fMRI / 感性情報学 / 脳・神経 |
|---|
| Research Abstract |
Synesthesia is an interesting phenomenon in which the stimulation of one sensory modality involuntarily elicits a perception in another modality. In this study, we focused on one typical synesthesia : seeing colors while listening to sounds, which is called "colored hearing." We examined the brain's mechanism with neuroimaging technology. Furthermore, we applied the synesthesia phenomenon to digital media creations, and we achieved scientific-based interactive arts between music and colors. The results of the research have been made public through mass media, including TV and press reports, and we succeeded in helping the public understand synesthesia better.
|
Report
(4 results)
Research Products
(59 results)
-
-
-
-
-
-
-
-
-
[Journal Article] Dance Motion Control of a Humanoid Robot Based on Real-Time Tempo Tracking from Musical Audio Signals2009
Author(s)
Nakahara, N., Miyazaki, K., Sakamoto, H., Fujisawa, T. X., Nagata, N., & Nakatsu, R.
-
Journal Title
ICEC2009, Lecture Notes in Computer Science
Volume: 5709
Pages: 36-47
Related Report
Peer Reviewed
-
-
-
-
-
-
-
-
-
-
[Presentation] Brain activity in grapheme-color synesthetes : when seeing japanese letters : an fMRI study2011
Author(s)
Mazaki, H., Nishimoto, M., Akatsuka, S., Yayama, R., Shimotomai, T., Aiba, E., & Nagata, N.
Organizer
16th Annual Meeting of the Organization for Human Brain Mapping(OHBM2011)
Place of Presentation
Quebec City, Canada
Year and Date
2011-06-27
Related Report
-
[Presentation] Brain Activity in the Color Area When Listening to Music : An fMRI Study of Synesthesia2011
Author(s)
Yayama, R., Shimotomai, T., Takahashi, R., Akatsuka, S., Aiba, E., Fujisawa, T. X., & Nagata, N.
Organizer
16th Annual Meeting of the Organization for Human Brain Mapping(OHBM2011)
Place of Presentation
Quebec City, Canada
Year and Date
2011-06-27
Related Report
-
[Presentation] Brain activity in grapheme-color synesthetes : when seeing japanese letters : an fMRI study2011
Author(s)
Mazaki, H., Nishimoto, M., Akatsuka, S., Yayama, R., Shimotomai, T., Aiba, E., Nagata, N.
Organizer
16th Annual Meeting of the Organization for Human Brain Mapping (OHBM2011)
Place of Presentation
Quebec City, Canada
Year and Date
2011-06-27
Related Report
-
[Presentation] Brain Activity in the Color Area When Listening to Music : An fMRI Study of Synesthesia2011
Author(s)
Yayama, R., Shimotomai, T., Takahashi, R., Akatsuka, S., Aiba, E., Fujisawa, T.X., Nagata, N.
Organizer
16th Annual Meeting of the Organization for Human Brain Mapping (OHBM2011)
Place of Presentation
Quebec City, Canada
Year and Date
2011-06-27
Related Report
-
[Presentation] Synesthetic cross-modal sound-color mapping2011
Author(s)
Wang, J., Cai, D., Asai, N., Nagata, N., & Fukumoto, A.
Organizer
The 15th annual meeting of the The Association for the Scientific Study of Consciousness
Place of Presentation
Kyoto, Japan
Year and Date
2011-06-09
Related Report
-
[Presentation] Synesthetic Sound-Color Cross-Modality in Animations2011
Author(s)
Cai, D., Goto, S., Wang, J. P., Asai, N., Nagata, N., Fukumoto, A., & Kurumizawa, J.
Organizer
Eurographics 2011 : posters
Place of Presentation
Llandudno, UK
Year and Date
2011-04-15
Related Report
-
[Presentation] Synesthetic Sound-Color Cross-Modality in Animations2011
Author(s)
Cai, D., Goto, S., Wang, J.P., Asai, N., Nagata, N., Fukumoto, A., Kurumizawa, J.
Organizer
Eurographics 2011
Place of Presentation
Llandudno, UK
Year and Date
2011-04-15
Related Report
-
-
-
-
[Presentation] Synesthetic Color Scheme in Fantasia2010
Author(s)
Cai, D. S., Goto, S., Shinohara, T., Nagata, N., Fukumoto, A., Kurumisawa, J., & Asai, N.
Organizer
ACM SIGGRAPH 2010 : Talks, Visualization for Art & Design
Place of Presentation
Los angeles. USA
Year and Date
2010-07-27
Related Report
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
