Computational model of face network in inferotemporal cortex based on mixture of sparse coding models

• Project/Area Number: 18K11517
• Research Category: Grant-in-Aid for Scientific Research (C)
• Allocation Type: Multi-year Fund
• Section: 一般
• Review Section: Basic Section 61060:Kansei informatics-related
• Research Institution: Advanced Telecommunications Research Institute International
• Principal Investigator: Hosoya Haruo 株式会社国際電気通信基礎技術研究所, 脳情報通信総合研究所, 主任研究員 (50335296)
• Project Period (FY): 2018-04-01 – 2021-03-31
• Project Status: Completed (Fiscal Year 2020)
• Budget Amount: ¥4,420,000 (Direct Cost: ¥3,400,000、Indirect Cost: ¥1,020,000); Fiscal Year 2020: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000); Fiscal Year 2019: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000); Fiscal Year 2018: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
• Keywords: 深層生成学習 / 顔ニューロン / 下側側頭野 / 高次視覚野 / 機械学習 / 深層学習

Outline of Final Research Achievements

Inspired by the face-processing network in the primate higher visual cortex, we developed two deep generative models, group-based variational autoencoder (GVAE) and its extension, mixture of GVAEs. We quantitatively evaluated their performance in artificial intelligence tasks and their reproducibility of response properties of face neurons in macaque brain and thus showed advantages over existing models.

Academic Significance and Societal Importance of the Research Achievements

複雑の高次視覚野の計算原理の解明に向けて、重要な一歩を踏むことができた。また、構築した深層生成学習モデルは一般性があり、物体画像以外のデータセットにも幅広く適用可能性がある。

Research Products

• [Int'l Joint Research] ロックフェラー大学(米国)
• [Journal Article] Neuroscience: A Face’s Journey through Space and Time (2021)
  • Author(s): Freiwald Winrich A.、Hosoya Haruo
  • Journal Title: Current Biology Volume: 31 Issue: 1 Pages: R13-R15
  • DOI: 10.1016/j.cub.2020.10.065
  • Int'l Joint Research
• [Journal Article] Convolutional neural networks explain tuning properties of anterior, but not middle, face-processing areas in macaque inferotemporal cortex (2020)
  • Author(s): Raman Rajani、Hosoya Haruo
  • Journal Title: Communications Biology Volume: 3 Issue: 1 Pages: 1-15
  • DOI: 10.1038/s42003-020-0945-x
  • Peer Reviewed / Open Access
• [Journal Article] Group-based learning of disentangled representations with generalizability for novel contents (2019)
  • Author(s): Haruo HOSOYA
  • Journal Title: 28th International Joint Conference on Artificial Intelligence(IJCAI2019) Volume: N/A
  • Peer Reviewed / Open Access
• [Journal Article] Does CNN explain tuning properties of macaque face-processing system? (2019)
  • Author(s): Raman RAJANI, Haruo HOSOYA
  • Journal Title: Conference on Cognitive Computational Neuroscience(CCN2019) Volume: N/A
  • Peer Reviewed / Open Access
• [Journal Article] A deep generative model explaining tuning properties of monkey face processing patches (2019)
  • Author(s): Haruo HOSOYA
  • Journal Title: Conference on Cognitive Computational Neuroscience(CCN2019) Volume: N/A
  • Peer Reviewed / Open Access
• [Presentation] CIGMO: Learning categorical invariant deep generative models from grouped data (2021)
  • Author(s): Haruo Hosoya
  • Organizer: ICLR Workshop on Weakly Supervised Learning
  • Int'l Joint Research
• [Presentation] A deep generative model explaining tuning properties of monkey face processing patches (2020)
  • Author(s): Haruo Hosoya
  • Organizer: 第43回日本神経科学大会
  • Int'l Joint Research
• [Presentation] Evaluating CNNs as a model of face processing network of the macaque (2019)
  • Author(s): Raman RAJANI, Haruo HOSOYA
  • Organizer: 第42回日本神経科学大会(Neuro2019)
  • Int'l Joint Research
• [Presentation] Generalizability of disentangled representations for novel contents (2019)
  • Author(s): 細谷 晴夫
  • Organizer: 脳と心のメカニズム第19回冬のワークショップ
• [Presentation] Towards computational understanding of facial coding in the macaque (2018)
  • Author(s): 細谷 晴夫
  • Organizer: Cinet Friday Lunch Seminar
  • Invited
• [Presentation] 霊長類脳における顔認識系の計算論 (2018)
  • Author(s): 細谷 晴夫
  • Organizer: 京都大学「脳科学に関わる数理」セミナー
  • Invited
• [Presentation] Computational models of the face processing system in the primate brain (2018)
  • Author(s): 細谷 晴夫
  • Organizer: 科学研究費新学術領域「脳と人工知能」第5回領域会議
  • Invited
• [Presentation] Does CNN explain the properties of the middle face patch area of primate? (2018)
  • Author(s): RAJANI Raman, Haruo HOSOYA
  • Organizer: Society for Neuroscience 48th Annual Meeting(Neuroscience2018)
  • Int'l Joint Research