• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Psychological experiment for clarifying the neural mechanism of complementary interaction between visual and haptic information in their binding process

Research Project

Project/Area Number 15500209
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field Neuroscience in general
Research InstitutionThe University of Electro-Communications

Principal Investigator

KASHIMORI Yoshiki  The University of Electro-Camlunications, Faculty of Electro-Communications, Associate Professor, 電気通信学部, 助教授 (70233707)

Co-Investigator(Kenkyū-buntansha) KAMBARA Takeshi  The University of Electro-Camlunications, Faculty of Electro-Communications, Professor, 電気通信学部, 教授 (90017442)
Project Period (FY) 2003 – 2004
Project Status Completed (Fiscal Year 2004)
Budget Amount *help
¥3,800,000 (Direct Cost: ¥3,800,000)
Fiscal Year 2004: ¥900,000 (Direct Cost: ¥900,000)
Fiscal Year 2003: ¥2,900,000 (Direct Cost: ¥2,900,000)
Keywordshigher order function of brain / vision / haptics / psychological experiment / haptic simulator / neural model / 触覚シュミレータ
Research Abstract

When a person looks at an object while exploring it with their hand, vision frequently dominates the integrated visual-haptic perception, but in some circumstances the process is clearly affected by haptics. The aim of this study is to investigate the neural mechanism of the complementary interaction between visual and haptic information in their binding process, based on psychological experiment.
1.Psychological experiments
We conducted psychological experiments in which virtual spaces were constructed with a haptic device and 3D-visual system. The task of the psychological experiment is as follow : The subject feels the weight of a cube presented on a computer screen by manipulating the haptic device, and then feels the weight of an another cube in the same way, which has different visual characters (i.e.size, color) from the cube firstly presented. The subject has to make a decision of which cube has larger weight. We examined the effect of the visual characters on the weight-discrimination task. We showed that the visual characters of cube cause significant changes in the discrimination task, supporting a hypothesis that the visual information is rapidly processed and then act as a prediction signal in binding process of visual and haptic information.
2.Neural network model for binding visual and haptic information
To investigate the neural mechanism of sensory information processing, we made neural models for visual, auditory, and electrosensory systems. Based on the modeling study, we made a computational model for binding process of visual and haptic information. The network model of visual system was made based on backpropagation network, and the output of the network affects the network of haptic system as a prediction signal. The computational model reproduced qualitatively our psychological data described in section 1.

Report

(3 results)
  • 2004 Annual Research Report   Final Research Report Summary
  • 2003 Annual Research Report
  • Research Products

    (26 results)

All 2005 2004 Other

All Journal Article (23 results) Publications (3 results)

  • [Journal Article] A functional role of multiple spatial resolution maps in form perception along the ventral visual pathway.2005

    • Author(s)
      Y.Kashimori, N.Suzuki, K.Fujita, M.Zheng, T.Kambara
    • Journal Title

      Neurocomputing (in press)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Dynamic population coding for detecting the distance and size of an object in electrolocation2005

    • Author(s)
      K.Fujita, Y.Kashimori, T.Kambara
    • Journal Title

      Neurocomputing (in press)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] A functional role of multiple spatial resolution maps in form perception along the ventral visual pathway2005

    • Author(s)
      Y.Kashimori, N.Suzuki, K.Fujita, T.Kamabra
    • Journal Title

      Neurocomputing (in press)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Dynamic population coding for detecting the distance and size of an object in electrolocation2005

    • Author(s)
      K.Fujita, Y.Kashimori, T.Kamabra
    • Journal Title

      Neurocomputing (in press)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] A functional role of multiple spatial resolution maps in form perception along the ventral visual pathway2005

    • Author(s)
      Y.Kashimori, N.Suzuki, K.Fujita, M.Zheng, T.Kamabra
    • Journal Title

      Neurocomputing in press

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Dynamic population coding for detecting the distance and size of an object in electrolocation2005

    • Author(s)
      K.Fujita, Y.Kashimori, T.Kambara
    • Journal Title

      Neurocomputing in press

    • Related Report
      2004 Annual Research Report
  • [Journal Article] A role of burst firing in encoding of spatiotemporally-varying stimulus2004

    • Author(s)
      K.Fujita, Y.kashimori, M.Zheng, T.Kambara
    • Journal Title

      BioSystems 76

      Pages: 21-31

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] A neural mechanism for detectiong the distance of a selected target by modulationg the FM sweep rate of biosonar in echoolocation of bat2004

    • Author(s)
      E.Kamata, S.Inoue, M.Zheng, Y.Kashimori, T.Kambara
    • Journal Title

      BioSystems 76

      Pages: 55-64

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] A neural model of predictive recognition in form pathway of visual cortex.2004

    • Author(s)
      N.Suzuki, N.Hashimoto, Y.Kashimori, M.Zheng, T.Kambara
    • Journal Title

      BioSystems 76

      Pages: 33-42

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Neural mechanism of binding ITD information with IID one for generating brain map of sound localization2004

    • Author(s)
      K.Fujita, S.Q.Huang, Y.Kashimori, T.Kambara
    • Journal Title

      Lecture Notes in Computer Science, (Springer-Verlag, Heidelberg) 3316

      Pages: 44-49

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] A functional role of FM sweep rate of biosonar in echolocation of bat2004

    • Author(s)
      K.Fujita, E.Kamata, S.Inoue, Y.Kashimori, T.Kambara
    • Journal Title

      Lecture Notes in Computer Science, (Springer-Verlag, Heidelberg) 3316

      Pages: 78-83

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] 視覚-触覚の感覚統合における相互補間機能の神経機構解明のための心理学実験2004

    • Author(s)
      樫森与志喜, 松村純平, 藤田一寿, 神原武志
    • Journal Title

      日本神経回路学会第14回全国大会講演論文集

      Pages: 186-187

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] A role of burst firing in encoding of spatiotemporally-varying stimulus2004

    • Author(s)
      K.Fujita, Y.Kashimori, M.Zheng, T.Kambara
    • Journal Title

      Bio Systems 76

      Pages: 21-31

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] A neural mechanism for detectiong the distance of a selected target by modulating the FM sweep rate of biosonar2004

    • Author(s)
      E.Kamata, S.Inoue, M.Zheng, Y.Kashimori, T.Kambara
    • Journal Title

      Bio Systems 76

      Pages: 55-64

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] A neural model of predictive recognition in form pathway of visual cortex2004

    • Author(s)
      N.Suzuki, N.Hashimoto, Y.Kashimori, M.Zheng, T.Kambara
    • Journal Title

      Bio Systems 76

      Pages: 33-42

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] A functional role of FM sweep rate of biosonar in echolocation of bat2004

    • Author(s)
      K.Fujita, S.Q.Huang, Y.Kashimori, T.Kamabra
    • Journal Title

      Lecture Notes in Computer Science(Springer-Verlag Heidelberg,) 3316

      Pages: 78-83

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Psychological experiments for clarifying the neural mechanism of complementary interaction between visual and haptic information in their binding process2004

    • Author(s)
      Y.Kashimori, J.Matumura, K.Fujita, T.Kambara
    • Journal Title

      Proceedings of Annual Meeting of Japanese Neural Network Society 1

      Pages: 186-187

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] A role of burst firing in encoding of spatiotemorally-varying stimulus2004

    • Author(s)
      K.Fujita, Y.Kashimori, M.Zheng, T.Kambara
    • Journal Title

      BioSystems 76

      Pages: 21-31

    • Related Report
      2004 Annual Research Report
  • [Journal Article] A neural mechanism for detectiong the distance of a selected target by modulationg the FM sweep rate of biosonar in echolocation of bat,2004

    • Author(s)
      E.Kamata, S.Inoue, M.Zheng, Y.Kashimori, T.Kambara
    • Journal Title

      BioSystems 76

      Pages: 55-64

    • Related Report
      2004 Annual Research Report
  • [Journal Article] A neural model of predictive recognition in form pathway of visual cortex,2004

    • Author(s)
      N.Suzuki, N.Hahsimoto, Y.Kashimori, M.Zheng, T.Kambara
    • Journal Title

      BioSystems 76

      Pages: 33-42

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Neural mechanism of biding ITD information with IID one for generating brain map of sound localization2004

    • Author(s)
      K.Fujita, S.Q.Huang, Y.Kashimori, T.Kambara
    • Journal Title

      Lecture Notes in Computer Science, (Springer-Verlag Heidelberg,) 3316

      Pages: 44-49

    • Related Report
      2004 Annual Research Report
  • [Journal Article] A functional role of FM sweep rate of biosonar in echolocation of bat,2004

    • Author(s)
      K.Fujita, E.Kamata, S.Inoue, Y.Kashimori, T.Kambara
    • Journal Title

      Lecture Notes in Computer Science, (Springer-Verlag Heidelberg,) 3316

      Pages: 78-83

    • Related Report
      2004 Annual Research Report
  • [Journal Article] 視覚-触覚の感覚統合における相互補間機能の神経機構解明のための心理学実験2004

    • Author(s)
      樫森与志喜, 松平純平, 藤田一寿, 神原武志
    • Journal Title

      日本神経回路学会第14回全国大会講演論文集

      Pages: 186-187

    • Related Report
      2004 Annual Research Report
  • [Publications] Kazuhisa Fujita: "A role of burst firings in encoding of spatiotemporal-varying stimulus"Proc.of IPCAT. 1. 55-69 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] Nobuyuki Suzuki: "A neural model of predictive recognition in form pathway of visual cortex"Proc.of IPCAT. 1. 105-122 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] Eigo Kamata: "A neural machanism for detecting the distance of a selected target by modulating the FM sweep rate of biosonar in echolocation of bat"Proc.of IPCAT. 1. 139-154 (2003)

    • Related Report
      2003 Annual Research Report

URL: 

Published: 2003-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi