2011 Fiscal Year Final Research Report
A mechanism on cross-modal interactions of synesthesia-Functional neuroimaging of colored-hearing synesthesia and digital media
| Project/Area Number |
21300086
|
|---|
| Research Category |
Grant-in-Aid for Scientific Research (B)
|
| Allocation Type | Single-year Grants |
|---|
| Section | 一般 |
|---|
| Research Field |
Sensitivity informatics/Soft computing
|
|---|
| Research Institution | Kwansei Gakuin University |
|---|
Principal Investigator |
NAGATA Noriko 関西学院大学, 理工学部, 教授 (50368453)
|
|---|
| Co-Investigator(Kenkyū-buntansha) |
FUJISAWA Takashi 長崎大学, 医歯薬学総合研究科, 助教 (90434894)
INOKUCHI Seiji 宝塚大学, 造形芸術学部, 講師 (90029463)
KURODA Kagayaki 東海大学, 情報理工学部, 教授 (70205243)
AIBA Eriko 関西学院大学, 理工学部, 研究員 (40569761)
SHIMOTOMAI Takayuki 玉川大学, 脳科学研究所, 特別研究員 (50415361)
|
|---|
| Project Period (FY) |
2009 – 2011
|
| Keywords | 感性情報処理 / 計測工学 / 脳 / 神経 / マルチモーダルインタフェース / 共感覚 / 色聴 / fMRI |
|---|
| Research Abstract |
Synesthesia is an interesting phenomenon in which the stimulation of one sensory modality involuntarily elicits a perception in another modality. In this study, we focused on one typical synesthesia : seeing colors while listening to sounds, which is called "colored hearing." We examined the brain's mechanism with neuroimaging technology. Furthermore, we applied the synesthesia phenomenon to digital media creations, and we achieved scientific-based interactive arts between music and colors. The results of the research have been made public through mass media, including TV and press reports, and we succeeded in helping the public understand synesthesia better.
|
-
-
-
-
-
-
[Journal Article] Dance Motion Control of a Humanoid Robot Based on Real-Time Tempo Tracking from Musical Audio Signals2009
Author(s)
Nakahara, N., Miyazaki, K., Sakamoto, H., Fujisawa, T. X., Nagata, N., & Nakatsu, R.
-
Journal Title
ICEC2009, Lecture Notes in Computer Science
Volume: 5709
Pages: 36-47
Peer Reviewed
-
-
-
-
[Presentation] Brain activity in grapheme-color synesthetes : when seeing japanese letters : an fMRI study2011
Author(s)
Mazaki, H., Nishimoto, M., Akatsuka, S., Yayama, R., Shimotomai, T., Aiba, E., & Nagata, N.
Organizer
16th Annual Meeting of the Organization for Human Brain Mapping(OHBM2011)
Place of Presentation
Quebec City, Canada
Year and Date
2011-06-27
-
[Presentation] Brain Activity in the Color Area When Listening to Music : An fMRI Study of Synesthesia2011
Author(s)
Yayama, R., Shimotomai, T., Takahashi, R., Akatsuka, S., Aiba, E., Fujisawa, T. X., & Nagata, N.
Organizer
16th Annual Meeting of the Organization for Human Brain Mapping(OHBM2011)
Place of Presentation
Quebec City, Canada
Year and Date
2011-06-27
-
[Presentation] Synesthetic cross-modal sound-color mapping2011
Author(s)
Wang, J., Cai, D., Asai, N., Nagata, N., & Fukumoto, A.
Organizer
The 15th annual meeting of the The Association for the Scientific Study of Consciousness
Place of Presentation
Kyoto, Japan
Year and Date
2011-06-09
-
[Presentation] Synesthetic Sound-Color Cross-Modality in Animations2011
Author(s)
Cai, D., Goto, S., Wang, J. P., Asai, N., Nagata, N., Fukumoto, A., & Kurumizawa, J.
Organizer
Eurographics 2011 : posters
Place of Presentation
Llandudno, UK
Year and Date
2011-04-15
-
-
[Presentation] Synesthetic Color Scheme in Fantasia2010
Author(s)
Cai, D. S., Goto, S., Shinohara, T., Nagata, N., Fukumoto, A., Kurumisawa, J., & Asai, N.
Organizer
ACM SIGGRAPH 2010 : Talks, Visualization for Art & Design
Place of Presentation
Los angeles. USA
Year and Date
2010-07-27
-
-
-
-
-
-
-
-
-
[Remarks] (1)長田典子(2012.5.19).音と色のハーモニー-科学・技術・アートを融合した感性価値の創出-,東京オトナ大学.
-
[Remarks] (2)楽しい学問「感性情報学」,読売新聞, 2012.4.22.
-
[Remarks] (3) NHK総合爆問学問(爆笑問題のニッポンの教養)「世界はもっとカラフルだ～共感覚のフシギ」, 2011.11.3
-
[Remarks] (4)共感覚現象,読売新聞科学欄, 2011.9.26
-
[Remarks] (5) BSフジガリレオX,「ガリレオチャンネル共感覚のミステリー」,再放送, 2011.4.1
-
-
[Remarks] (7) NHK教育テレビ(ETV),「ガリレオチャンネル共感覚のミステリー」第51回科学技術映像祭入選作品から, 2010.05.29.
-
[Remarks] (8)長田典子.フジテレビ「とくダネ!」で,共感覚に関して取材協力. 2010.04.26.
-
[Remarks] (9)東京MXテレビ「ガリレオチャンネル共感覚のミステリー」が第51回科学技術映像祭文部科学大臣賞受賞,入選作品上映会が全国13都市で開催, 2010.03.11.
-
[Remarks] (10)長田典子.共感覚のミステリー音や文字に色が見える!?-東京MXテレビ「ガリレオチャンネル」に出演, 2009.11.21.
-
