• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Representation of visual and non-visual object attributes in the brain and artificial neural networks

Research Project

Project/Area Number 17H01756
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Cognitive science
Research InstitutionNational Institute for Physiological Sciences

Principal Investigator

Goda Naokazu  生理学研究所, システム脳科学研究領域, 助教 (30373195)

Co-Investigator(Kenkyū-buntansha) 蒲池 みゆき  工学院大学, 情報学部(情報工学部), 教授 (70395101)
Project Period (FY) 2017-04-01 – 2022-03-31
Project Status Completed (Fiscal Year 2022)
Budget Amount *help
¥17,680,000 (Direct Cost: ¥13,600,000、Indirect Cost: ¥4,080,000)
Fiscal Year 2021: ¥2,600,000 (Direct Cost: ¥2,000,000、Indirect Cost: ¥600,000)
Fiscal Year 2020: ¥2,600,000 (Direct Cost: ¥2,000,000、Indirect Cost: ¥600,000)
Fiscal Year 2019: ¥3,900,000 (Direct Cost: ¥3,000,000、Indirect Cost: ¥900,000)
Fiscal Year 2018: ¥3,900,000 (Direct Cost: ¥3,000,000、Indirect Cost: ¥900,000)
Fiscal Year 2017: ¥4,680,000 (Direct Cost: ¥3,600,000、Indirect Cost: ¥1,080,000)
Keywords視覚 / 多感覚 / 質感 / 深層学習 / 視触覚 / VR / 物体認識 / fMRI / 物体
Outline of Final Research Achievements

Our brain effortlessly recognizes not only visual but also non-visual attributes of objects and environments just by looking at them. To delve into this intriguing neural processing, we analyzed the relationship between the psychological/neural representations of non-visual attributes of objects and the image features derived from deep convolutional neural networks (DNN). We discovered DNN features valuable for recognizing non-visual attributes and developed prototype image synthesis techniques that manipulate non-visual impressions using those features. Additionally, we created a virtual reality environment capable of manipulating visual and non-visual features, revealing new visual-somatosensory interactions within the environment. These techniques contribute to advancing our understanding of the brain's multisensory nature.

Academic Significance and Societal Importance of the Research Achievements

本研究は、未だ解明されていない脳の情報処理を理解するために、現在成功を収めている深層畳込みニューラルネットワーク(DNN)を利用する試みである。脳神経科学研究だけでなくDNNの研究開発においても、複数の感覚(視覚や触覚など)情報を統合的に扱うアプローチはまだこれからのテーマであり、本研究で得られた知見や技術は、これら両分野の研究の進展に貢献することが期待される。

Report

(6 results)
  • 2022 Final Research Report ( PDF )
  • 2021 Annual Research Report
  • 2020 Annual Research Report
  • 2019 Annual Research Report
  • 2018 Annual Research Report
  • 2017 Annual Research Report
  • Research Products

    (11 results)

All 2022 2021 2019 2018 2017

All Journal Article (5 results) (of which Peer Reviewed: 4 results,  Open Access: 3 results) Presentation (6 results) (of which Int'l Joint Research: 2 results,  Invited: 2 results)

  • [Journal Article] Structure and function of neural circuit related to gloss perception in the macaque inferior temporal cortex: a case report2021

    • Author(s)
      Komatsu Hidehiko、Nishio Akiko、Ichinohe Noritaka、Goda Naokazu
    • Journal Title

      Brain Structure and Function

      Volume: 226 Issue: 9 Pages: 3023-3030

    • DOI

      10.1007/s00429-021-02324-6

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Visuo-tactile Integration for the Perception of Wind Intensity in a VR Environments2021

    • Author(s)
      西牧 侑哉、郷田 直一、蒲池 みゆき
    • Journal Title

      Transactions of the Virtual Reality Society of Japan

      Volume: 26 Issue: 1 Pages: 14-21

    • DOI

      10.18974/tvrsj.26.1_14

    • NAID

      130008014101

    • ISSN
      1344-011X, 2423-9593
    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Dependence of behavioral performance on material category in an object grasping task with monkeys2018

    • Author(s)
      Yokoi Isao、Tachibana Atsumichi、Minamimoto Takafumi、Goda Naokazu、Komatsu Hidehiko
    • Journal Title

      Journal of Neurophysiology

      Volume: 印刷中 Issue: 2 Pages: 553-563

    • DOI

      10.1152/jn.00748.2017

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Neural Mechanisms of Material Perception: Quest on Shitsukan2018

    • Author(s)
      Komatsu Hidehiko、Goda Naokazu
    • Journal Title

      Neuroscience

      Volume: 392 Pages: 329-347

    • DOI

      10.1016/j.neuroscience.2018.09.001

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Toward Understanding Neural Substrates of Material and Shitsukan Recognition2018

    • Author(s)
      郷田直一
    • Journal Title

      NIHON GAZO GAKKAISHI (Journal of the Imaging Society of Japan)

      Volume: 57 Issue: 2 Pages: 197-206

    • DOI

      10.11370/isj.57.197

    • NAID

      130006700896

    • ISSN
      1344-4425, 1880-4675
    • Related Report
      2017 Annual Research Report
  • [Presentation] 水中での移動感覚再現に向けたロコモーションインタフェースの検討2022

    • Author(s)
      川俣 昂平, 蒲池みゆき
    • Organizer
      第27回バーチャルリアリティ学会大会
    • Related Report
      2021 Annual Research Report
  • [Presentation] Effects of skin and water conditions on water surface perception2021

    • Author(s)
      Kawamata Kohei, Kamachi G Miyuki
    • Organizer
      The ISAT-20 (The 20th International Symposium on Advanced Technology)
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Visual and Tactile Perception of the Wind in the Virtual Reality environment2019

    • Author(s)
      Nishimaki Y, Goda N, Kamachi MG
    • Organizer
      The 15th Asia-Pacific Conference on Vision
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 脳が作り出す「ものの質感」のイメージング2018

    • Author(s)
      郷田 直一
    • Organizer
      第71回日本画像学会イメージングカフェ
    • Related Report
      2018 Annual Research Report
    • Invited
  • [Presentation] 物体の材質を表現する視覚特徴: CNNを用いた解析2017

    • Author(s)
      郷田直一 小松英彦
    • Organizer
      第40回日本神経科学大会
    • Related Report
      2017 Annual Research Report
  • [Presentation] 光沢や艶,質感を感じる脳のメカニズムについて2017

    • Author(s)
      郷田直一
    • Organizer
      技術情報協会セミナー No.707203
    • Related Report
      2017 Annual Research Report
    • Invited

URL: 

Published: 2017-04-28   Modified: 2024-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi