• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Brain decoding of impressions on visual images

Research Project

Project/Area Number 26870935
Research Category

Grant-in-Aid for Young Scientists (B)

Allocation TypeMulti-year Fund
Research Field Kansei informatics
Cognitive science
Research InstitutionAdvanced Telecommunications Research Institute International

Principal Investigator

Horikawa Tomoyasu  株式会社国際電気通信基礎技術研究所, 脳情報通信総合研究所, 主任研究員 (60721876)

Project Period (FY) 2014-04-01 – 2017-03-31
Project Status Completed (Fiscal Year 2016)
Budget Amount *help
¥3,640,000 (Direct Cost: ¥2,800,000、Indirect Cost: ¥840,000)
Fiscal Year 2016: ¥520,000 (Direct Cost: ¥400,000、Indirect Cost: ¥120,000)
Fiscal Year 2015: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2014: ¥2,080,000 (Direct Cost: ¥1,600,000、Indirect Cost: ¥480,000)
Keywords脳情報デコーディング / fMRI / 印象 / 視覚 / 深層ニューラルネットワーク / 感性情報 / 高次認知機能
Outline of Final Research Achievements

The brain decoding approach was used to examine whether impressions on visual images can be predicted from human brain activity patterns measured using functional magnetic resonance imaging. The decoding analyses were performed to evaluate the predictability of 1) hierarchical visual features, 2) twelve types of impression scores associated with surface characteristics, and 3) positive-negative scores (valence), which were obtained using computational models and human rating. The analyses suggest that the lower/higher visual features were better predicted from the lower/higher visual areas, the impression scores were successfully predicted from the mid- to high-level visual areas, and the valence score was accurately predicted from the frontal brain areas. These results suggest that the multi-level visual information associated with subjective impressions on visual images can be decoded from human brain activity patterns.

Report

(4 results)
  • 2016 Annual Research Report   Final Research Report ( PDF )
  • 2015 Research-status Report
  • 2014 Research-status Report
  • Research Products

    (14 results)

All 2017 2016 2015 2014 Other

All Journal Article (5 results) (of which Peer Reviewed: 3 results,  Open Access: 3 results,  Acknowledgement Compliant: 3 results) Presentation (7 results) (of which Int'l Joint Research: 4 results,  Invited: 4 results) Book (1 results) Remarks (1 results)

  • [Journal Article] Generic decoding of seen and imagined objects using hierarchical visual features2017

    • Author(s)
      Tomoyasu Horikawa, and Yukiyasu Kamitani
    • Journal Title

      Nature Communications

      Volume: 印刷中

    • NAID

      120006305983

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] Position information encoded by population activity in hierarchical visual areas2017

    • Author(s)
      Majima K, Sukhanov P, Horikawa T, Kamitani Y
    • Journal Title

      eNeuro

      Volume: 0268-16 Issue: 2 Pages: 1-42

    • DOI

      10.1523/eneuro.0268-16.2017

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] Hierarchical neural representations of dreamed objects revealed by brain decoding with deep neural network features2016

    • Author(s)
      Horikawa T, Kamitani Y
    • Journal Title

      Frontires in Computational Neuroscience

      Volume: 11: 4.

    • DOI

      10.3389/fncom.2017.00004

    • NAID

      120005980907

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] 夢内容のブレイン・デコーディング:夢の機能解明に向けて2015

    • Author(s)
      堀川友慈
    • Journal Title

      実験医学

      Volume: 33 Pages: 2077-2082

    • Related Report
      2015 Research-status Report
  • [Journal Article] 脳情報デコーディング2015

    • Author(s)
      堀川友慈
    • Journal Title

      細胞工学

      Volume: 34 Pages: 638-643

    • Related Report
      2015 Research-status Report
  • [Presentation] Shared hierarchical neural representation for perception, imagery, and dreaming2017

    • Author(s)
      Tomoyasu Horikawa
    • Organizer
      NSF-NICT Collaborative Workshop on Computational Neuroscience
    • Place of Presentation
      Osaka, Japan
    • Year and Date
      2017-01-17
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Brain decoding via deep neural network feature representation"2016

    • Author(s)
      Tomoyasu Horikawa
    • Organizer
      第39回日本神経科学大会
    • Place of Presentation
      Chiba, Japan
    • Year and Date
      2016-07-20
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Generic decoding of seen and imagined objects using features of deep neural networks2016

    • Author(s)
      Tomoyasu Horikawa, and Yukiyasu Kamitani
    • Organizer
      Vision science society
    • Place of Presentation
      Florida, USA
    • Year and Date
      2016-05-13
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 視覚的夢内容のブレイン・デコーディング2016

    • Author(s)
      堀川友慈
    • Organizer
      第18回 日本ヒト脳機能マッピング学会
    • Place of Presentation
      京都大学 桂キャンパス
    • Year and Date
      2016-03-07
    • Related Report
      2015 Research-status Report
    • Invited
  • [Presentation] Brain decoding of visual dream contents2016

    • Author(s)
      Tomoyasu Horikawa
    • Organizer
      脳と心のメカニズム 第16回 冬のワークショップ
    • Place of Presentation
      ルスツリゾートホテル,北海道
    • Year and Date
      2016-01-06
    • Related Report
      2015 Research-status Report
    • Invited
  • [Presentation] Generic decoding of seen and imagined objects using hierarchical visual features2015

    • Author(s)
      Tomoyasu Horikawa
    • Organizer
      Society for Neuroscience 45th Annual Meeting (Neuroscience 2015)
    • Place of Presentation
      Chicago, USA
    • Year and Date
      2015-10-17
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] Common human brain activity patterns during perception, imagery, and dreaming2014

    • Author(s)
      Tomoyasu Horikawa
    • Organizer
      Society for Neuroscience 44th Annual Meeting (Neuroscience 2014)
    • Place of Presentation
      Washington D.C. (USA)
    • Year and Date
      2014-11-15 – 2014-11-19
    • Related Report
      2014 Research-status Report
  • [Book] DOUJIN BIOSCIENCE 睡眠科学2017

    • Author(s)
      堀川友慈, 神谷之康
    • Total Pages
      344
    • Publisher
      化学同人
    • Related Report
      2016 Annual Research Report
  • [Remarks] Codes and data for the Generic decoding study

    • URL

      https://github.com/KamitaniLab/GenericObjectDecoding

    • Related Report
      2016 Annual Research Report

URL: 

Published: 2014-04-04   Modified: 2018-03-22  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi