• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Reconstructing perceived stereoscopic scenes from fMRI/MEG brain activity

Research Project

Project/Area Number 17K20021
Research Category

Grant-in-Aid for Challenging Research (Exploratory)

Allocation TypeMulti-year Fund
Research Field Human informatics and related fields
Research InstitutionNational Institute of Information and Communications Technology

Principal Investigator

Ban Hiroshi  国立研究開発法人情報通信研究機構, 脳情報通信融合研究センター脳情報通信融合研究室, 主任研究員 (00467391)

Project Period (FY) 2017-06-30 – 2020-03-31
Project Status Completed (Fiscal Year 2019)
Budget Amount *help
¥6,370,000 (Direct Cost: ¥4,900,000、Indirect Cost: ¥1,470,000)
Fiscal Year 2019: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Fiscal Year 2018: ¥2,210,000 (Direct Cost: ¥1,700,000、Indirect Cost: ¥510,000)
Fiscal Year 2017: ¥2,730,000 (Direct Cost: ¥2,100,000、Indirect Cost: ¥630,000)
KeywordsfMRI / 視知覚 / 立体視 / 3D / 認知 / 物体知覚 / バーチャルリアリティ / データベース / 心理学 / 知覚 / 神経科学 / 物体視 / 脳機能イメージング / エンコーディングモデル / MEG / 3D知覚 / 実験心理学 / 物体認知 / 実験系心理学 / 認知科学 / 画像
Outline of Final Research Achievements

The purpose of this study is to reconstruct 3D images based on the brain response patterns, obtained using fMRI and MEG, corresponding to perceived stereoscopic feelings caused when observers view 2D (not 3D) images. As the first step, we have developed a 3D image database, called "3D Koto(ancient city)", which consists of over 10,000 4K 3D stereo images of natural scenes taken in Kyoto and Nara. As the second step, we have developed fMRI brain activity database which consists of 5 observers' fMRI brain responses for 2,400 3D images selected from the "3D Koto" database. We are now working on the elaboration of a model to reconstruct the stereoscopic structures represented in human brain responses. We are now trying to our best so as to publish the model and papers as soon as possible. The related database and fMRI responses will be also organized so that they can be publicly available for free.

Academic Significance and Societal Importance of the Research Achievements

ヒトの「立体感」と視対象の物理的な特性は、必ずしも1対1に対応しないことが知られている。ここで、ヒトの脳内に再現された「立体感」を画像として復元できれば、その画像と視対象そのものを直接比較することが可能となる。この比較により、例えば技術的には問題なく製作されたはずの3D CGに対して、ヒトがそれほどリアルさを感じないような場合に、臨場感を増強させるためには視対象に何が欠けているのか、あるいは逆にヒトがリアルさを感じているのは視対象のどの部位なのかを同定する新しい映像評価技術の開発へと繋がる。

Report

(4 results)
  • 2019 Annual Research Report   Final Research Report ( PDF )
  • 2018 Research-status Report
  • 2017 Research-status Report
  • Research Products

    (28 results)

All 2019 2018 2017 Other

All Int'l Joint Research (10 results) Journal Article (3 results) (of which Int'l Joint Research: 2 results,  Peer Reviewed: 2 results,  Open Access: 1 results) Presentation (15 results) (of which Int'l Joint Research: 8 results,  Invited: 5 results)

  • [Int'l Joint Research] 香港大学心理学部/華東師範大学心理学部(中国)

    • Related Report
      2019 Annual Research Report
  • [Int'l Joint Research] ケンブリッジ大学心理学部(英国)

    • Related Report
      2019 Annual Research Report
  • [Int'l Joint Research] University of Cambridge(英国)

    • Related Report
      2018 Research-status Report
  • [Int'l Joint Research] KU Leuven(ベルギー)

    • Related Report
      2018 Research-status Report
  • [Int'l Joint Research] Harvard University(米国)

    • Related Report
      2018 Research-status Report
  • [Int'l Joint Research] 香港大学(中国)

    • Related Report
      2018 Research-status Report
  • [Int'l Joint Research] 香港大学(中国)

    • Related Report
      2017 Research-status Report
  • [Int'l Joint Research] ケンブリッジ大学(英国)

    • Related Report
      2017 Research-status Report
  • [Int'l Joint Research] KU Leuven大学(ベルギー)

    • Related Report
      2017 Research-status Report
  • [Int'l Joint Research] ハーバード大学(英国)

    • Related Report
      2017 Research-status Report
  • [Journal Article] Human depth sensitivity is affected by object plausibility2019

    • Author(s)
      Wong, N.H.L., Ban, H., Chang, D.H.F.
    • Journal Title

      Journal of Coginitive Neuroscience

      Volume: 32 Issue: 2 Pages: 338-352

    • DOI

      10.1162/jocn_a_01483

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] 脳が思い込み創り出す映像臨場感 ~ 脳のクセが作り出すリアルな仮想 ~2019

    • Author(s)
      番浩志
    • Journal Title

      電波技術協会報誌

      Volume: 331 Pages: 14-17

    • Related Report
      2019 Annual Research Report
  • [Journal Article] Areal differences in depth cue integration between monkey and human2019

    • Author(s)
      Marcelo Armendariz, Hiroshi Ban, Andrew E. Welchman, Wim Vanduffel
    • Journal Title

      PLOS Biology

      Volume: 17 Issue: 3 Pages: 1-32

    • DOI

      10.1371/journal.pbio.2006405

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Presentation] ヒト脳内における両眼視差の平均および分散の階層的な推定・表現機構2019

    • Author(s)
      金谷翔子、藤田一郎、番浩志
    • Organizer
      日本視覚学会冬季大会
    • Related Report
      2019 Annual Research Report
  • [Presentation] Neural Substrate for Reversed-Depth Perception Generated by Anti-Correlated Random-Dot Stereograms in the Human Brain2019

    • Author(s)
      Wundari, B.G., Ban, H., Fujita, I.
    • Organizer
      Asia Pacific Conference on Vision
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Oblique effect in 3D gradient discriminations revealed by psychophysics and MEG2019

    • Author(s)
      Wu, H.N., Ikeyaga, Y., Ban, H.
    • Organizer
      Asia Pacific Conference on Vision
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] fMRIヒト脳機能イメージングで分かる立体視(3D)情報の脳内統合過程とその産業応用2019

    • Author(s)
      番浩志
    • Organizer
      NTTデータ経営研究所 第3回CiNet脳情報研究WS
    • Related Report
      2018 Research-status Report
    • Invited
  • [Presentation] Characterization of stereoscopic information processing in human brain using reverse depth perception stimulus2019

    • Author(s)
      Wundari, B.G., Ban, H., Fujita, I
    • Organizer
      The Japan Neuroscience Society 42nd Annual Meeting
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Spatiotemporal characteristics of cortical responses to biological motion2019

    • Author(s)
      Chang, D.H.F, Troje, N.F., Ban, H
    • Organizer
      Vision Science Society Annual Meeting 2019
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] ヒトはなぜ3Dを見ることができるのか~3次元知覚を実現する脳の情報処理メカニズムとその特性~2018

    • Author(s)
      番浩志
    • Organizer
      株式会社技術情報協会・企業向けセミナー
    • Related Report
      2018 Research-status Report
    • Invited
  • [Presentation] Cortical dynamics for compensating visual orientation sensitivity bias2018

    • Author(s)
      Wu, H.N., Ikegaya, Y., Ban, H
    • Organizer
      Human Neuroimaging Workshop
    • Related Report
      2018 Research-status Report
  • [Presentation] Temporal compensation of orientation selectivity bias in early visual areas2018

    • Author(s)
      Wu, H.N., Ikeyaga, Y., Ban, H
    • Organizer
      The Japan Neuroscience Society 41st Annual Meeting
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Reverse Radial Bias: Temporal Compensation of Orientation Bias in Early Visual Areas Revealed by MEG2018

    • Author(s)
      8.Wu, H.N., Ikeyaga, Y., Ban, H
    • Organizer
      Vision Science Society Annual Meeting 2018
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Reverse Radial Bias: Temporal Compensation of Orientation Bias in Early Visual Areas Revealed by MEG.2018

    • Author(s)
      Wu, H.N., Ikeyaga, Y., Ban, H.
    • Organizer
      Vision Science Society 2018
    • Related Report
      2017 Research-status Report
  • [Presentation] Temporal compensation of orientation selectivity bias in early visual areas.2018

    • Author(s)
      Wu, H.N., Ikeyaga, Y., Ban, H.
    • Organizer
      日本神経科学会2018年大会
    • Related Report
      2017 Research-status Report
  • [Presentation] Biological motion perception in the human brain: A subcortical locus?2017

    • Author(s)
      Chang, DHF., Ban, H., Ikegaya, Y. Fujita, I, Troje, N.
    • Organizer
      知覚と記憶情報処理過程に関するシンポジウム (華東師範大学・上海)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] The fusion of pictorial /motion and binocular disparity cues to depth in dorsal visual cortex.2017

    • Author(s)
      Ban, H.
    • Organizer
      知覚と記憶情報処理過程に関するシンポジウム (華東師範大学・上海)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] fMRIで明らかになったヒト大脳皮質視覚野の立体視情報処理過程 -経路2017

    • Author(s)
      番浩志
    • Organizer
      視覚科学フォーラム
    • Related Report
      2017 Research-status Report
    • Invited

URL: 

Published: 2017-07-21   Modified: 2021-02-19  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi