• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Investigation of holistic representation of faces from visual features encoded by face neurons in the brain

Research Project

Project/Area Number 26240021
Research Category

Grant-in-Aid for Scientific Research (A)

Allocation TypeSingle-year Grants
Section一般
Research Field Cognitive science
Research InstitutionInstitute of Physical and Chemical Research

Principal Investigator

Tanifuji Manabu  国立研究開発法人理化学研究所, 脳神経科学研究センター, チームリーダー (60197530)

Project Period (FY) 2014-04-01 – 2018-03-31
Project Status Completed (Fiscal Year 2018)
Budget Amount *help
¥40,040,000 (Direct Cost: ¥30,800,000、Indirect Cost: ¥9,240,000)
Fiscal Year 2017: ¥11,050,000 (Direct Cost: ¥8,500,000、Indirect Cost: ¥2,550,000)
Fiscal Year 2016: ¥11,310,000 (Direct Cost: ¥8,700,000、Indirect Cost: ¥2,610,000)
Fiscal Year 2015: ¥9,750,000 (Direct Cost: ¥7,500,000、Indirect Cost: ¥2,250,000)
Fiscal Year 2014: ¥7,930,000 (Direct Cost: ¥6,100,000、Indirect Cost: ¥1,830,000)
Keywords物体認識 / 顔認知 / 深層学習 / AI / DCNN / 倒立効果 / 下側頭葉視覚連合野 / 神経科学 / 顔認識 / 視覚認識 / 認知科学 / 生物物理学 / 生物物理
Outline of Final Research Achievements

How faces are decomposed in the brain? Faces may be decomposed into facial parts, such as eyes, nose and mouth, and/or elements representing relational information of facial parts. We addressed this question by approximating visual features encoded by face neurons as natural image fragments. Resulting features reproduced response preference to particular views, and combination of them made view invariant face identification possible. Visualizing sub-region of faces captured by these features revealed that our brain decomposed faces into local features and complex features each of which detects a spatial arrangement of the local features. However, these local features are not explicit representation of facial parts. They are edge and color contrast derived from facial parts, hairline, and face lines. We suggest that the deep layered ventral visual pathway can be approximated by a shallow network comprising layers of low level processing and of combining low level information.

Academic Significance and Societal Importance of the Research Achievements

脳において、視覚物体像は何層にもわたる多層ネットワークを経て処理されている。私たちの研究は、この多層なネットワークが低次の局所的なエッジを抽出する初期層と局所的な情報の特定の組み合わせを作る層の2層によって近似できることを示した。この結果は、脳における視覚物体処理の本質の理解に大きく貢献している。近年、AIの一分野として、視覚物体処理を行うネットワークの開発されている。しかし、それらのネットワークは多層構造を持つため、中で行われている演算はわからないという問題点がある。我々の研究で用いた手法はAIにも適用できるので、AIの解析に大きな貢献をすることが期待される。

Report

(5 results)
  • 2018 Final Research Report ( PDF )
  • 2017 Annual Research Report
  • 2016 Annual Research Report
  • 2015 Annual Research Report
  • 2014 Annual Research Report
  • Research Products

    (29 results)

All 2018 2017 2016 2015 2014

All Journal Article (6 results) (of which Int'l Joint Research: 3 results,  Peer Reviewed: 6 results,  Open Access: 6 results,  Acknowledgement Compliant: 3 results) Presentation (23 results) (of which Int'l Joint Research: 8 results,  Invited: 8 results)

  • [Journal Article] Searching for visual features that explain response variance of face neurons in inferior temporal cortex2018

    • Author(s)
      Owaki, T, Vidal-Naquet, M, Nam, Y, Uchida, G, Sato, T, Cateau, H, Ullman, S, Tanifuji, M.
    • Journal Title

      PlosOne

      Volume: 13 Issue: 9 Pages: e0201192-e0201192

    • DOI

      10.1371/journal.pone.0201192

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] 3D topology of orientation columns in visual cortex revealed by functional optical coherence tomography.2018

    • Author(s)
      Nakamichi, Y., Kalatsky, V. A., Watanabe, H., Sato, T., Rajagopalan, U.M., Tanifuji, M.
    • Journal Title

      J. Neurophysiol.

      Volume: 119 Issue: 4 Pages: 1562-1575

    • DOI

      10.1152/jn.00921.2017

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Mechanisms for shaping receptive field in monkey area TE.2017

    • Author(s)
      Obara, K., O’Hashi, K., Tanifuji, M.
    • Journal Title

      J. Neurophysiol.

      Volume: 118 Issue: 4 Pages: 2448-2457

    • DOI

      10.1152/jn.00348.2017

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Functional optical coherence tomography of rat olfactory bulb with periodic odor stimulation2016

    • Author(s)
      Hideyuki Watanabe, Uma Maheswari Rajagopalan, Yu Nakamichi, Kei M. Igarashi, Hirofumi Kadono, Manabu Tanifuji
    • Journal Title

      Biomedical Optics Express

      Volume: 7 Issue: 3 Pages: 841-854

    • DOI

      10.1364/boe.7.000841

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research / Acknowledgement Compliant
  • [Journal Article] Independent Noise Enhances Synchronization in Heterogeneous Systems2014

    • Author(s)
      Uchida G, Tanifuji M.
    • Journal Title

      Journal of the Physical Society of Japan

      Volume: 83 Issue: 9 Pages: 093801-093801

    • DOI

      10.7566/jpsj.83.093801

    • NAID

      40020194411

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] tochastic process underlying emergent recognition of visual objects hidden in degraded images2014

    • Author(s)
      Murata T, Hamada T, Shimokawa T, Tanifuji M, and Yanagida T
    • Journal Title

      PLoS ONE

      Volume: 9 (12) Issue: 12 Pages: e115658-e115658

    • DOI

      10.1371/journal.pone.0115658

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Presentation] 3D topology of orientation columns in visual cortex revealed by functional optical coherence tomography2017

    • Author(s)
      Manabu Tanifuji
    • Organizer
      The 13th Asia Pacific Conference on Vision
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] A computational approach to predict view tuning and face inversion effect of face neurons in inferior temporal cortex2017

    • Author(s)
      Y. Nam, G. Uchida, T. Sato, M. Tanifuji
    • Organizer
      Soc. for Neuroscience USA
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A computational model providing quantitative description of features of view-tuned face neurons2017

    • Author(s)
      Yunjun Nam, Takayuki Sato, Yuji Yamauchi, Chia-pei Lin, Chou P Hung, Uchida Go, Manabu Tanifuji
    • Organizer
      Cosyne 2017
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Machineries for forming center and periphery of receptive fields in monkey anterior inferior temporal cortex2016

    • Author(s)
      Manabu Tanifuji
    • Organizer
      IEEE International Symposium on Video and Audio Signal Processing in the Context of Neurotechnologies
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Searching for visual features driving face neurons in the higher visual cortex, inferior temporal cortex, in macaque monkeys.2016

    • Author(s)
      Manabu Tanifuji
    • Organizer
      IEEE International Symposium on Video and Audio Signal Processing
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] サル高次元視覚野における物体像の表現~畳み込みニューラルネットは霊長類の視覚モデルになるか~2016

    • Author(s)
      谷藤 学
    • Organizer
      CVIM2017年3月研究会
    • Related Report
      2016 Annual Research Report
    • Invited
  • [Presentation] Principles for mapping view tuned neurons in the face selective region of anterior inferotemporal cortex revealed by dense neural recordings2016

    • Author(s)
      A. Sasaki, C.-P. Lin, M. Matsuda, T. Sato, G. Uchida, C. Hung, M. Tanifuji
    • Organizer
      Soc. for Neuroscience USA
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] サル高次視覚野における物体像の表現とそのダイナミクス2016

    • Author(s)
      谷藤 学
    • Organizer
      第14回全脳アーキテクチャ勉強会 ~深層学習を越える新皮質計算モデル~
    • Related Report
      2016 Annual Research Report
    • Invited
  • [Presentation] Principles for mapping view tuned neurons in the face selective region of anterior inferotemporal cortex revealed by dense neural recordings2015

    • Author(s)
      A. Sasaki, C.-P. Lin, M. Matsuda, T. Sato, G. Uchida, C. Hung, M. Tanifuji
    • Organizer
      Neuroscience2015/ SfN's 45th annual meeting
    • Place of Presentation
      McCormick Place, Chicago, USA
    • Year and Date
      2015-10-19
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] View angle maps inside the face selective sub-region of anterior inferior temporal cortex2015

    • Author(s)
      谷藤 学
    • Organizer
      The 6th FAONS Congress and the 11th Biennial Conferences of CNS
    • Place of Presentation
      Wuzhen, Shejiang Province, China
    • Year and Date
      2015-09-22
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] サル下側頭葉皮質における顔の向きのマッピング2015

    • Author(s)
      佐々木あす郁, Chia-pei Lin, 松田將志、佐藤多加之、内田豪、Chou Hung, 谷藤 学
    • Organizer
      第25回日本神経回路学会 全国大会
    • Place of Presentation
      電気通信大学・調布市、東京
    • Year and Date
      2015-09-02
    • Related Report
      2015 Annual Research Report
  • [Presentation] 下側頭葉視覚連合野の機能構造と物体像表現2015

    • Author(s)
      谷藤 学
    • Organizer
      視覚科学フォーラム第19回研究会
    • Place of Presentation
      ホテル福島グリーンパレス・福島市、福島
    • Year and Date
      2015-08-20
    • Related Report
      2015 Annual Research Report
    • Invited
  • [Presentation] マカクザル下側頭葉皮質における顔の向きの選択性についてのマップ2015

    • Author(s)
      Lin Cynthia, 佐々木あす郁, 佐藤多加之, 内田豪, Hung Chou-Po, 谷藤学
    • Organizer
      視覚科学フォーラム第19回研究会
    • Place of Presentation
      ホテル福島グリーンパレス・福島市、福島
    • Year and Date
      2015-08-20
    • Related Report
      2015 Annual Research Report
  • [Presentation] Effect of attention on shaping receptive fields on neurons in infero temporal cortex and involvement of inter-laminar interaction in the effect2015

    • Author(s)
      Obara, K., O'Hashi, K., Tanifuji, M.
    • Organizer
      9th FEN Forum of Neuroscience
    • Place of Presentation
      Milan, Italy
    • Year and Date
      2015-07-08
    • Related Report
      2014 Annual Research Report
  • [Presentation] 独立な雑音による神経細胞間での同期発火の増強2015

    • Author(s)
      内田 豪、谷藤 学
    • Organizer
      日本物理学会第70回年次大会
    • Place of Presentation
      早稲田大学早稲田キャンパス、東京
    • Year and Date
      2015-03-21
    • Related Report
      2014 Annual Research Report
  • [Presentation] Mechanisms for shaping receptive field in monkey anterior inferior temporal cortex2015

    • Author(s)
      Obara, K., O'Hashi, K., Tanifuji, M.
    • Organizer
      Computational and Systems Neuroscience (Cosyne) 2015
    • Place of Presentation
      Milan, Italy
    • Year and Date
      2015-03-07
    • Related Report
      2014 Annual Research Report
  • [Presentation] A combination study of optogenetics and optical imaging to identify unknown cortico-cortical projection patterns in macaque2014

    • Author(s)
      Nakamichi,Y., Hashimoto, M., Kitamura, N., Hagiya, K., Sato, T., Tanifuji, M.
    • Organizer
      Soc. for Neurosci. USA
    • Place of Presentation
      Washington, DC, USA
    • Year and Date
      2014-11-18
    • Related Report
      2014 Annual Research Report
  • [Presentation] Functional organization of facial views within the face selective region in anterior inferotemporal cortex in macaque2014

    • Author(s)
      Lin, C-P, Matsuda, M., Sato,T., Uchida, G., Hung, C.P., Tanifuji, M.
    • Organizer
      日本神経科学大会
    • Place of Presentation
      パシフィコ横浜、横浜
    • Year and Date
      2014-09-13
    • Related Report
      2014 Annual Research Report
  • [Presentation] Behavioral task demands modulate object tuning of neurons in the inferior temporal cortex2014

    • Author(s)
      Ohashi, K., Obara, K., Tanifuji, M.
    • Organizer
      日本神経科学大会
    • Place of Presentation
      パシフィコ横浜、横浜
    • Year and Date
      2014-09-12
    • Related Report
      2014 Annual Research Report
  • [Presentation] Spatial attention modulates size and shape of receptive fields of neurons in monkey inferotemporal cortex differently in supra- and infra-granular layers2014

    • Author(s)
      Obara, K., Ohashi, K., Tanifuji, M.
    • Organizer
      日本神経科学大会
    • Place of Presentation
      パシフィコ横浜、横浜
    • Year and Date
      2014-09-12
    • Related Report
      2014 Annual Research Report
  • [Presentation] Possible industrial transfer of recent findings in visual neuroscience2014

    • Author(s)
      Tanifuji, M.
    • Organizer
      日本神経科学大会
    • Place of Presentation
      パシフィコ横浜、横浜
    • Year and Date
      2014-09-11
    • Related Report
      2014 Annual Research Report
    • Invited
  • [Presentation] Independent noise input enhances synchronous firing between neurons with different electrophysiological property2014

    • Author(s)
      Uchida, G., Tanifuji, M.
    • Organizer
      日本神経科学大会
    • Place of Presentation
      パシフィコ横浜、横浜
    • Year and Date
      2014-09-11
    • Related Report
      2014 Annual Research Report
  • [Presentation] Identifying unknown cortico-cortical projection patterns in macaque using optogenetics and optical imaging2014

    • Author(s)
      Nakamichi, Y., Tanifuji, M.
    • Organizer
      日本神経科学大会
    • Place of Presentation
      パシフィコ横浜、横浜
    • Year and Date
      2014-09-11
    • Related Report
      2014 Annual Research Report

URL: 

Published: 2014-04-04   Modified: 2023-03-23  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi