• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Modeling the representation and transformation of material-related information in the visual cortex

Research Project

Project/Area Number 25330179
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Research Field Cognitive science
Research InstitutionNational Institute for Physiological Sciences

Principal Investigator

Goda Naokazu  生理学研究所, システム脳科学研究領域, 助教 (30373195)

Project Period (FY) 2013-04-01 – 2017-03-31
Project Status Completed (Fiscal Year 2016)
Budget Amount *help
¥4,810,000 (Direct Cost: ¥3,700,000、Indirect Cost: ¥1,110,000)
Fiscal Year 2015: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Fiscal Year 2014: ¥1,820,000 (Direct Cost: ¥1,400,000、Indirect Cost: ¥420,000)
Fiscal Year 2013: ¥1,690,000 (Direct Cost: ¥1,300,000、Indirect Cost: ¥390,000)
Keywords視覚 / 物体認知 / 質感 / テクスチャ / 多感覚 / fMRI / CNN / 触覚 / ニューラルネットワーク
Outline of Final Research Achievements

Our brain can easily recognize the material of an object - what the object is made of - just by seeing it. This study is aimed at understanding the neural processing of the material-related information through the visual stream in the brain and developing a computational model that can mimic the processes. A series of functional brain imaging and psychological experiments revealed that (1) the higher ventral visual areas in monkeys represent visual and non-visual material properties of objects, and (2) the neural representation can be affected by simple visuo-haptic experience on the objects, suggesting that is formed through learning of the crossmodal association. Further analysis with the state-of-the-art computer vision techniques revealed that (3) deep convolutional neural network models can capture the representation of the visual and nonvisual material properties. These new findings greatly advance understanding of material information processing in the brain.

Report

(5 results)
  • 2016 Annual Research Report   Final Research Report ( PDF )
  • 2015 Research-status Report
  • 2014 Research-status Report
  • 2013 Research-status Report
  • Research Products

    (26 results)

All 2017 2016 2015 2014 Other

All Journal Article (5 results) (of which Int'l Joint Research: 1 results,  Peer Reviewed: 5 results,  Open Access: 3 results,  Acknowledgement Compliant: 3 results) Presentation (19 results) (of which Invited: 9 results) Book (1 results) Remarks (1 results)

  • [Journal Article] Crossmodal association of visual and haptic material properties of objects in the monkey ventral visual cortex2016

    • Author(s)
      Goda N, Yokoi I, Tachibana A, Minamimoto T, Komatsu H
    • Journal Title

      Current Biology

      Volume: 26 Issue: 7 Pages: 928-934

    • DOI

      10.1016/j.cub.2016.02.003

    • Related Report
      2015 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research / Acknowledgement Compliant
  • [Journal Article] Mirror neurons in a New World monkey, common marmoset2015

    • Author(s)
      Suzuki W, Banno T, Miyakawa N, Abe H, Goda N, Ichinohe N
    • Journal Title

      Frontiers in Neuroscience 9 459

      Volume: 9 Pages: 459-459

    • DOI

      10.3389/fnins.2015.00459

    • Related Report
      2015 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Perceptual gloss parameters are encoded by population responses in the monkey inferior temporal cortex2014

    • Author(s)
      Akiko Nishio, Takeaki Shimokawa, Naokazu Goda, and Hidehiko Komatsu
    • Journal Title

      The Journal of Neuroscience

      Volume: 34(33) Issue: 33 Pages: 11143-11151

    • DOI

      10.1523/jneurosci.1451-14.2014

    • Related Report
      2014 Research-status Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Representation of the material properties of objects in the visual cortex of nonhuman primates2014

    • Author(s)
      Goda N, Tachibana A, Okazawa G, Komatsu H
    • Journal Title

      Journal of Neuroscience

      Volume: 34 Issue: 7 Pages: 2660-2673

    • DOI

      10.1523/jneurosci.2593-13.2014

    • Related Report
      2013 Research-status Report
    • Peer Reviewed
  • [Journal Article] Audiovisual integration in the human perception of materials2014

    • Author(s)
      Fujisaki W, Goda N, Motoyoshi I, Komatsu H, Nishida S
    • Journal Title

      Journal of Vision

      Volume: vol. 14 no. 4 article 12 Issue: 4 Pages: 1-20

    • DOI

      10.1167/14.4.12

    • Related Report
      2013 Research-status Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Presentation] Visual features representing material properties of objects: analysis with convolutional neural networks2017

    • Author(s)
      Goda N
    • Organizer
      第40回日本神経科学大会
    • Place of Presentation
      幕張メッセ(千葉県千葉市)
    • Year and Date
      2017-07-20
    • Related Report
      2016 Annual Research Report
  • [Presentation] Representation of visual and nonvisual material properties of objects in the visual cortex2017

    • Author(s)
      郷田直一
    • Organizer
      NICT-NSF Collaborative Workshop on Computational Neuroscience
    • Place of Presentation
      脳情報通信融合研究センター (大阪府吹田市)
    • Year and Date
      2017-01-17
    • Related Report
      2016 Annual Research Report
    • Invited
  • [Presentation] 視覚野における多感覚的な情報の表現2016

    • Author(s)
      郷田直一
    • Organizer
      第8回多感覚研究会
    • Place of Presentation
      早稲田大学(東京都新宿区)
    • Year and Date
      2016-11-19
    • Related Report
      2016 Annual Research Report
    • Invited
  • [Presentation] 材質を知る: 質感認知の脳内機構2016

    • Author(s)
      郷田直一
    • Organizer
      視覚科学フォーラム第20回研究会
    • Place of Presentation
      脳情報通信融合研究センター (大阪府吹田市)
    • Year and Date
      2016-08-24
    • Related Report
      2016 Annual Research Report
    • Invited
  • [Presentation] 多感覚的な素材質感の脳内表現とその形成2016

    • Author(s)
      郷田直一
    • Organizer
      生理学研究所研究会 「視知覚の総合的理解を目指して-生理学、心理物理学、計算論」
    • Place of Presentation
      岡崎コンファレンスセンター(愛知県岡崎市)
    • Year and Date
      2016-06-09
    • Related Report
      2016 Annual Research Report
    • Invited
  • [Presentation] 物体材質属性の視覚認知機構:多感覚経験の重要性2016

    • Author(s)
      郷田直一
    • Organizer
      東北大学電気通信研究所第31回生体生命工学研究会
    • Place of Presentation
      東北大学電気通信研究所(宮城県仙台市)
    • Related Report
      2016 Annual Research Report
    • Invited
  • [Presentation] 質感知覚の多感覚的性質とその神経基盤に関する最新の研究紹介2016

    • Author(s)
      郷田直一
    • Organizer
      視覚科学技術コンソーシアム第8回オープンイベント
    • Place of Presentation
      名古屋プライムセントラルタワー(愛知県名古屋市)
    • Related Report
      2016 Annual Research Report
    • Invited
  • [Presentation] Neural representation of material properties of objects in visual cortex: Impact of visuo-tactile experiences2015

    • Author(s)
      Goda N
    • Organizer
      第38回日本神経科学大会
    • Place of Presentation
      神戸国際会議場(兵庫県神戸市)
    • Year and Date
      2015-07-28
    • Related Report
      2015 Research-status Report
    • Invited
  • [Presentation] 繊維素材における触覚的印象の心理評価と風合い計測2015

    • Author(s)
      安川涼子 堀川直幹 重村幸弘 小松英彦 郷田直一
    • Organizer
      日本繊維製品消費科学会2015年年次大会
    • Place of Presentation
      信州大学(長野県上田市)
    • Year and Date
      2015-06-27
    • Related Report
      2015 Research-status Report
  • [Presentation] Representation of material properties of objects in visual cortex investigated with multivoxel pattern analysis2014

    • Author(s)
      Goda N
    • Organizer
      第14回日中韓合同ワークショップ Neurobiology and Neuroinformatics (NBNI) 2014
    • Place of Presentation
      岡崎コンファレンスセンター(愛知県岡崎市)
    • Year and Date
      2014-12-18 – 2014-12-20
    • Related Report
      2014 Research-status Report
    • Invited
  • [Presentation] サル視覚野における物体素材表現に視触覚経験が及ぼす効果: fMRI研究2014

    • Author(s)
      郷田直一 横井功 橘篤導 南本敬史 小松英彦
    • Organizer
      第37回日本神経科学大会
    • Place of Presentation
      パシフィコ横浜(神奈川県横浜市)
    • Year and Date
      2014-09-11 – 2014-09-13
    • Related Report
      2014 Research-status Report
  • [Presentation] 実物把持課題における素材カテゴリーに依存したサルの行動2014

    • Author(s)
      横井功 橘篤導 南本敬史 郷田直一 小松英彦
    • Organizer
      第37回日本神経科学大会
    • Place of Presentation
      パシフィコ横浜(神奈川県横浜市)
    • Year and Date
      2014-09-11 – 2014-09-13
    • Related Report
      2014 Research-status Report
  • [Presentation] Neural representation of materials of objects in human and monkey visual cortex2014

    • Author(s)
      Goda N
    • Organizer
      The 10th Asia-Pacific Conference on Vision
    • Place of Presentation
      かがわ国際会議場(香川県高松市)
    • Year and Date
      2014-07-19 – 2014-07-22
    • Related Report
      2014 Research-status Report
    • Invited
  • [Presentation] Population responses in the macaque inferior temporal cortex encode perceptual gloss parameters2014

    • Author(s)
      Nishio A , Shimokawa T , Goda N, Komatsu H
    • Organizer
      The 10th Asia-Pacific Conference on Vision
    • Place of Presentation
      かがわ国際会議場(香川県高松市)
    • Year and Date
      2014-07-19 – 2014-07-22
    • Related Report
      2014 Research-status Report
  • [Presentation] Optimal audiovisual integration of object appearance and impact sounds in human perception of materials2014

    • Author(s)
      Fujisaki W, Goda N, Motoyoshi I, Komatsu H, Nishida S
    • Organizer
      The 10th Asia-Pacific Conference on Vision
    • Place of Presentation
      かがわ国際会議場(香川県高松市)
    • Year and Date
      2014-07-19 – 2014-07-22
    • Related Report
      2014 Research-status Report
  • [Presentation] Canonical correlation analysis revealed perceptual gloss parameters represented in the monkey inferior temporal cortex

    • Author(s)
      Nishio A, Shimokawa T, Goda N
    • Organizer
      Society for Neuroscience 43rd Annual Meeting
    • Place of Presentation
      San Diego (USA)
    • Related Report
      2013 Research-status Report
  • [Presentation] サル視覚野における素材情報処理過程: fMRI研究

    • Author(s)
      郷田直一, 橘篤導, 岡澤剛起, 小松英彦
    • Organizer
      第36回日本神経科学大会
    • Place of Presentation
      国立京都国際会館(京都府)
    • Related Report
      2013 Research-status Report
  • [Presentation] 下側頭皮質に表現されている知覚光沢パラメータ:正準相関解析による神経データ解析

    • Author(s)
      下川丈明, 西尾亜希子, 郷田直一, 小松英彦
    • Organizer
      第36回日本神経科学大会
    • Place of Presentation
      国立京都国際会館(京都府)
    • Related Report
      2013 Research-status Report
  • [Presentation] 織物の心理的距離の触覚経験による変化

    • Author(s)
      安川涼子, 郷田直一, 小松英彦
    • Organizer
      繊維学会秋季研究発表会
    • Place of Presentation
      豊田工業大学(愛知県)
    • Related Report
      2013 Research-status Report
  • [Book] 触り心地の制御、評価技術と新材料・新製品開発への応用 第1章第1節 質感は脳でどのように処理されているのか?2017

    • Author(s)
      小松英彦 郷田直一
    • Total Pages
      7
    • Publisher
      技術情報協会
    • Related Report
      2016 Annual Research Report
  • [Remarks] 「見て触れる」経験が「見る」仕組みを変える-脳の「視覚野」が手触りの経験によって変化することを発見-

    • URL

      http://www.nips.ac.jp/release/2016/03/post_317.html

    • Related Report
      2015 Research-status Report

URL: 

Published: 2014-07-25   Modified: 2019-07-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi