• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Symmetric and Structural Cross-Modal Mapping between Musics and Colors and its Application to Media Designs

Research Project

Project/Area Number 23650040
Research Category

Grant-in-Aid for Challenging Exploratory Research

Allocation TypeMulti-year Fund
Research Field Media informatics/Database
Research InstitutionUniversity of Tsukuba

Principal Investigator

CAI DongSheng  筑波大学, システム情報系, 准教授 (70202075)

Project Period (FY) 2011 – 2013
Project Status Completed (Fiscal Year 2013)
Budget Amount *help
¥3,640,000 (Direct Cost: ¥2,800,000、Indirect Cost: ¥840,000)
Fiscal Year 2013: ¥650,000 (Direct Cost: ¥500,000、Indirect Cost: ¥150,000)
Fiscal Year 2012: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Fiscal Year 2011: ¥1,690,000 (Direct Cost: ¥1,300,000、Indirect Cost: ¥390,000)
Keywords共感覚 / 感覚統合現象 / 脳内クロスモダリティ / MRI計測 / MEG / 応用認知科学 / カラーグレーディング / クロスモダリティ / アニメ / クラスタリング
Research Abstract

Synesthesia is a neurological condition in which stimulation of one sensory or cognitive pathway includes automatic and involuntary responses in a second sensory or cognitive pathway. People who report such experiences are known as "synesthetes". A subset of synesthetes, sound-color synesthetes "see" colors and simple animated shapes in association with music and other sounds. We can find a color-sound synesthetes out of two to three thousands. It has been suggested that "...every infant is synesthetic, although most gradually grow out of it" p 12 (Stein and Meredith 1993) and the synesthetes possess these cross-modal connections even they grown up. We show scientifically how these synesthetic cross-modal mapping are used in animations and movies.

Report

(4 results)
  • 2013 Annual Research Report   Final Research Report ( PDF )
  • 2012 Research-status Report
  • 2011 Research-status Report
  • Research Products

    (32 results)

All 2014 2013 2012 2011 Other

All Journal Article (9 results) (of which Peer Reviewed: 9 results) Presentation (20 results) (of which Invited: 9 results) Remarks (3 results)

  • [Journal Article] Amplification of Weibel instability in the relativistic beam-plasma interactions due to ion streaming2014

    • Author(s)
      KazemArdane, DongShengCai, Ken-Ichi Nishikawa
    • Journal Title

      NewAstronomy

      Volume: Vol.33 Pages: 1-6

    • DOI

      10.1016/j.newast.2014.04.004

    • Related Report
      2013 Final Research Report
    • Peer Reviewed
  • [Journal Article] Memory color effect induced by familiarity of brand logos2013

    • Author(s)
      Atsushi Kimura, Yuji Wada, Tomohiro Masuda, Sho-ichi Goto, Daisuke Tsuzuki, Haruo Hibino, Dongsheng Cai, Ippeita Dan
    • Journal Title

      PLoS ONE

      Volume: 8 Issue: 7 Pages: e68474-e68474

    • DOI

      10.1371/journal.pone.0068474

    • Related Report
      2013 Annual Research Report 2013 Final Research Report
    • Peer Reviewed
  • [Journal Article] Rendering Morpho Butterflies Based on High Accuracy Nano-Optical Simulation2013

    • Author(s)
      N. Okada, D. Zhu, D. Cai, J. B. Cole, M. Kambe, S. Kinoshita
    • Journal Title

      Journal of Optics

      Volume: 42 Issue: 1 Pages: 25-36

    • DOI

      10.1007/s12596-012-0092-y

    • Related Report
      2013 Final Research Report
    • Peer Reviewed
  • [Journal Article] 色聴共感覚者の一貫性実験によるクロスモーダルマッピング,2013

    • Author(s)
      蔡 東生, 丁 策立
    • Journal Title

      情報処理学会研究報告, グラフィクスとCAD研究会報告

      Volume: 2013-CG-150(4) Pages: 1-8

    • NAID

      110009537015

    • Related Report
      2012 Research-status Report
    • Peer Reviewed
  • [Journal Article] Model of Aggregation - A Topological Approach2012

    • Author(s)
      Masud Rana and DongSheng Cai
    • Journal Title

      GRAPP/IVAPP

      Pages: 355-360

    • Related Report
      2013 Final Research Report
    • Peer Reviewed
  • [Journal Article] Stable and convenient spatial registration of stand-alone NIRS data through anchor- based probabilistic registration2012

    • Author(s)
      DaisukeTsuzuki, DongShengCai, Haruka Dan, YasushiKyutoku, AkifumiFujita, EijuW atanabe, IppeitaDan
    • Journal Title

      Neuroscience Research

      Volume: 72, 2 Pages: 1632013171-1632013171

    • Related Report
      2013 Final Research Report
    • Peer Reviewed
  • [Journal Article] Model of Aggregation - A Topological Approach2012

    • Author(s)
      Masud Rana and DongSheng Cai
    • Journal Title

      GRAPP/IVAPP

      Volume: 2012 Pages: 355-360

    • Related Report
      2012 Research-status Report
    • Peer Reviewed
  • [Journal Article] Variability of particles distribution function through a nonstationary collisionless shock front: use of virtual satellites in 2D Full Particle Simulations2012

    • Author(s)
      Bertrand Lembge, Zheng Huang, Pierre Martel, and Dongsheng Cai,
    • Journal Title

      IEEE Trans. Plasma Sci.

      Volume: accepted

    • Related Report
      2011 Research-status Report
    • Peer Reviewed
  • [Journal Article] 色聴共感覚者の一貫性実験によるクロスモーダルマッピング

    • Author(s)
      蔡東生, 丁策立
    • Journal Title

      情報処理学会研究報告, グラフィクスとCAD研究会報告

      Pages: 1-8

    • NAID

      110009537015

    • Related Report
      2013 Final Research Report
    • Peer Reviewed
  • [Presentation] Emotion of Colors : Synesthetic CrossModal Key Modulation2014

    • Author(s)
      Cai, D., N.Asai, andN.Nagata
    • Organizer
      International Confe rence on Computer Graphics and Interactive Techniques
    • Place of Presentation
      Vancouver, Canada
    • Related Report
      2013 Final Research Report
  • [Presentation] Dynamics of the cusp within a selfconsistent global 3D PIC simulation approach2014

    • Author(s)
      Cai, D., B. Lembege, K.-I. Nishikawa, A. Esmaeili
    • Organizer
      Union Rado Scientifique Internationale
    • Place of Presentation
      Beijing, China
    • Related Report
      2013 Final Research Report
    • Invited
  • [Presentation] 3D Global PIC simulation of Cusp Dynamics and Alfvenic transition layers at cusp outer boudary during IMF rotations from north to south2014

    • Author(s)
      Cai, D., B. Lembege, K.-I. Nishikawa, A. Esmaeil, K.Nishikawa
    • Organizer
      European Geosciences Union General Assembly 2014
    • Place of Presentation
      Austria Center Vienna
    • Related Report
      2013 Annual Research Report
    • Invited
  • [Presentation] Dynamics of the cusp within a self > consistent global 3D PIC simulation approach, Union Rado Scientifique Internationale2014

    • Author(s)
      Cai, D., B. Lembege, K.-I. Nishikawa, A. Esmaeil
    • Organizer
      31st URSI GASS
    • Place of Presentation
      China Beijing Conference Center
    • Related Report
      2013 Annual Research Report
    • Invited
  • [Presentation] 3D Global Simulation of Magnetosphere, International Conference on Storms2013

    • Author(s)
      Cai, D., B. Lembege, K.-I. Nishikawa, A. Esmaeili
    • Organizer
      Substorms, and Space Weather (ICSSSW)
    • Place of Presentation
      ShenZheng, China
    • Related Report
      2013 Final Research Report
    • Invited
  • [Presentation] Large Scale 3D Full particle simulations of the solarwind-terrestrial magnetosphere interaction : impact of the IMF rotation on the magnetospheric dynamics2013

    • Author(s)
      Cai, D., B.Lembege, K.-I.Nishikawa, A. Esmaeili
    • Organizer
      The 23rd International Con ference on Numerical Simulation of Plasmas (23rd ICNSP)
    • Place of Presentation
      Beijin China
    • Related Report
      2013 Final Research Report
  • [Presentation] 3D Global Simulation of Magneto sphere2013

    • Author(s)
      Cai, D., B.Lembege, K.-I.Nishikawa, A. Esmaeili
    • Organizer
      The11th International School for Space Simulations (ISSS-11)
    • Place of Presentation
      Taipei, Taiwan
    • Related Report
      2013 Final Research Report
    • Invited
  • [Presentation] 3D Global Simulation of Magnetosphere2013

    • Author(s)
      Cai, D., B. Lembege, K.-I. Nishikawa, A. Esmaeili,
    • Organizer
      The 11th International School for Space Simulations (ISSS-11)
    • Place of Presentation
      National Central Univ., Taiwan
    • Related Report
      2013 Annual Research Report
    • Invited
  • [Presentation] Large Scale 3D Full particle simulations of the solar wind-terrestrial magnetosphere interaction: impact of the IMF rotation on the magnetospheric dynamics2013

    • Author(s)
      Cai, D., B. Lembege, K.-I. Nishikawa, A. Esmaeili,
    • Organizer
      The 23rd International Conference on Numerical Simulation of Plasmas
    • Place of Presentation
      Beijin China, USB
    • Related Report
      2013 Annual Research Report
  • [Presentation] 3D Global Simulation of Magnetosphere,2013

    • Author(s)
      Cai, D., B. Lembege, K.-I. Nishikawa, A. Esmaeili,
    • Organizer
      International Conference on Storms, Substorms, and Space Weather (ICSSSW),
    • Place of Presentation
      ShenZheng, China
    • Related Report
      2013 Annual Research Report
    • Invited
  • [Presentation] Dynamicsofthecuspboundariesa ndparticlesentry : 3-DPIClargescalesimulati on2012

    • Author(s)
      B.Lembege, D.S.Cai, K.Nishikawaand A.Esmaeili
    • Organizer
      the11th Annual International Astrophysics Conference
    • Place of Presentation
      PalmSprings, USA
    • Related Report
      2013 Final Research Report
    • Invited
  • [Presentation] Model of Aggregation A Topological Approach2012

    • Author(s)
      M.Rana, D.Cai
    • Organizer
      GRAPP2012 : International Conferenceon Computer Graphics Theory and Application
    • Place of Presentation
      Rome, Italy
    • Related Report
      2013 Final Research Report
  • [Presentation] Dynamics of the cusp boundaries and particle entry during a Northward IMF period : 3-D PIC large scale simulation2012

    • Author(s)
      Cai, D., B.Lembege, A. Esmaeili, and K.-I.Nishikawa,
    • Organizer
      STE シミュレーション研究会
    • Place of Presentation
      広島大学東千田キャンパス (広島県)
    • Related Report
      2011 Research-status Report
  • [Presentation] Lorenz bifurcation and its visualization in magnetospheric dynamics2011

    • Author(s)
      Cai, D., B.Lembege, andK.-I.Nishikawa
    • Organizer
      The10th International School for Space Simulations (ISSS-10)
    • Place of Presentation
      Banff Canada
    • Related Report
      2013 Final Research Report
    • Invited
  • [Presentation] SynestheticCr oss-ModalSound-ColorMapping2011

    • Author(s)
      J.Wang, D.Cai, NobuyoshiAsai, Noriko Nagata, andAsakoFukumoto
    • Organizer
      The15th annual meeting of the Association for the Scientific Study of Consciousness : poster(DVD)
    • Place of Presentation
      京都
    • Related Report
      2013 Final Research Report
  • [Presentation] Synesthetic Sound-Color Cross-Modality in Animations2011

    • Author(s)
      Cai, D., Goto, S., Wang, J.P., Asai, N., Nagata, N., Fukumoto, A., Kurumizawa, J
    • Organizer
      Proc. Eurographics 2011 : posters (DVD)
    • Place of Presentation
      Llandudno UK
    • Related Report
      2013 Final Research Report
  • [Presentation] Synesthetic Sound-Color Cross-Modality in Animations (diglib.eg.org/EG/DL/conf/EG2011/posters/019-020.pdf.abstract.pdf)2011

    • Author(s)
      Cai, D., Goto, S., Wang, J.P., Asai, N., Nagata, N., Fukumoto, A., & Kurumizawa, J.
    • Organizer
      Eurographics 2011 (Poster)
    • Place of Presentation
      Llandudno UK (Bangor Univ. )
    • Related Report
      2011 Research-status Report
  • [Presentation] Synesthetic Cross-Modal Sound-Color Mapping2011

    • Author(s)
      J. Wang, D. Cai,Nobuyoshi Asai,Noriko Nagata, and Asako Fukumoto,
    • Organizer
      The 15th annual meeting of the Association for the Scientific Study of Consciousness
    • Place of Presentation
      京都大学 百周年時計台記念館(京都府)
    • Related Report
      2011 Research-status Report
  • [Presentation] Magnetic reconnection in magnetosphere analyzed by field topology:application to the magnetotail and the subsolar region2011

    • Author(s)
      Cai, D., B.Lembege, and K.-I.Nishikawa,
    • Organizer
      The 10th International School for Space Simulations (ISSS-10)(招待講演)
    • Place of Presentation
      Banff, Canada (Banff Conference Centre)
    • Related Report
      2011 Research-status Report
  • [Presentation] Dynamics of particle entries within the cusp boundary deformed during the IMF rotation from Northward to Southward: 3-D large-scale Particle-In-Cell simulation2011

    • Author(s)
      Cai, D., B.Lembege, and K.-I.Nishikawa,
    • Organizer
      AGU Fall Meeting 2011
    • Place of Presentation
      Moscone Center, San Francisco, LA
    • Related Report
      2011 Research-status Report
  • [Remarks]

    • URL

      http://www.cavelab.cs.tsukuba.ac.jp/~gotoh/syneth/index.html

    • Related Report
      2013 Final Research Report
  • [Remarks] 共感覚判定テスト

    • URL

      http://www.cavelab.cs.tsukuba.ac.jp/~gotoh/syneth/index.html

    • Related Report
      2013 Annual Research Report
  • [Remarks]

    • URL

      http://www.cavelab.cs.tsukuba.ac.jp/~gotoh/syneth/syn.html

    • Related Report
      2011 Research-status Report

URL: 

Published: 2011-08-05   Modified: 2019-07-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi