Neuroimaging of human 3D depth perception and its applications

• Project/Area Number: 26870911
• Research Category: Grant-in-Aid for Young Scientists (B)
• Allocation Type: Multi-year Fund
• Research Field: Cognitive science; Experimental psychology
• Research Institution: National Institute of Information and Communications Technology
• Principal Investigator: Ban Hiroshi 国立研究開発法人情報通信研究機構, 脳情報通信融合研究センター・脳情報通信融合研究室, 研究員 (00467391)
• Project Period (FY): 2014-04-01 – 2016-03-31
• Project Status: Completed (Fiscal Year 2015)
• Budget Amount: ¥3,900,000 (Direct Cost: ¥3,000,000、Indirect Cost: ¥900,000); Fiscal Year 2015: ¥1,950,000 (Direct Cost: ¥1,500,000、Indirect Cost: ¥450,000); Fiscal Year 2014: ¥1,950,000 (Direct Cost: ¥1,500,000、Indirect Cost: ¥450,000)
• Keywords: fMRI / 奥行き知覚 / 3D / 視覚心理学 / 神経科学 / 視知覚 / 3D知覚 / 物体知覚 / 物体認知 / 実験心理学 / 脳機能イメージング

Outline of Final Research Achievements

A fundamental challenge in visual neuroscience is to understand how the outputs of neurons responding to local, simple elements are progressively transformed to encode the critical features of spatially-extensive objects. While models of the ventral stream detail the decoding transformations that support invariance, much less is known about the dorsal hierarchy. In this research project, using human fMRI, I especially focused on the cortical processing of binocular depth signals that strongly engage dorsal pathways. In addition, I tried to reveal how and where in the brain binocular disparities and pictorial depth cues (e.g. shading, motion) are fused into a unified depth representation. I found that local binocular disparities are gradually integrated into a coherent 3D surface from V1 to V3B, and that multiple depth cues are integrated in V3B, an adjacent region of V3A. I further tried to apply those findings for future novel 3D visualization techniques.

Research Products

• [Int'l Joint Research] ケンブリッジ大学/ノッティンガム大学/ユニバーシティ・カレッジ・ロンドン(英国)
• [Journal Article] Differential processing of binocular and monocular gloss cues in human visual cortex (2016)
  • Author(s): Sun, H.-C., Di Luca, M., Ban, H., Murry, A., Welchman, A.E.
  • Journal Title: Journal of Neurophysiology Volume: 117 Issue: 6 Pages: 2779-2790
  • DOI: 10.1152/jn.00829.2015
  • Peer Reviewed / Int'l Joint Research / Acknowledgement Compliant
• [Journal Article] Late development of cue integration is linked to sensory fusion in cortex (2015)
  • Author(s): Dekker, T., Ban, H., van der Velde, B., Sereno, M.I., Welchman, A.E., Narandini, M.
  • Journal Title: Current Biology Volume: 25 Issue: 21 Pages: 2856-2861
  • DOI: 10.1016/j.cub.2015.09.043
  • Peer Reviewed / Open Access / Int'l Joint Research / Acknowledgement Compliant
• [Journal Article] fMRI analysis-by-synthesis reveals a dorsal hierarchy that extracts surface slant (2015)
  • Author(s): Ban, H., Welchman, A.E.
  • Journal Title: The Journal of Neuroscience Volume: 35 Issue: 27 Pages: 9823-9835
  • DOI: 10.1523/jneurosci.1255-15.2015
  • Peer Reviewed / Open Access / Int'l Joint Research / Acknowledgement Compliant
• [Journal Article] Ultra-high field fMRI reveals systematic functional organization for binocular disparity in human visual cortex (2015)
  • Author(s): Goncalves, N. R., Ban, H., Sanchez-Panchuel, R.M., Francis, S., Schluppeck, D., Welchman, A.E.
  • Journal Title: The Journal of Neuroscience Volume: 35 Issue: 7 Pages: 3056-3072
  • DOI: 10.1523/jneurosci.3047-14.2015
  • Peer Reviewed / Open Access / Int'l Joint Research / Acknowledgement Compliant
• [Journal Article] fMRI脳機能イメージングとTMS法で明らかになったヒト脳内における3D視覚情報の処理と統合 (2015)
  • Author(s): Ban, H., Chang, H.F.D., Welchman, A.E.
  • Journal Title: 映像情報メディア学会誌 Volume: 69 Pages: 10-15
  • Open Access / Int'l Joint Research
• [Journal Article] Brightness masking is modulated by disparity structure (2015)
  • Author(s): Pelekanos, V., Ban, H., Welchman, A.E.
  • Journal Title: Vision Research Volume: 110 Pages: 87-92
  • DOI: 10.1016/j.visres.2015.02.010
  • Peer Reviewed / Open Access / Int'l Joint Research / Acknowledgement Compliant
• [Journal Article] fMRI evidence for areas that process surface gloss in the human visual cortex (2015)
  • Author(s): Sun, H.-C., Ban, H., Di Luca, M., Welchman, A.E.
  • Journal Title: Vision Research Volume: 109 Pages: 149-157
  • DOI: 10.1016/j.visres.2014.11.012
  • Peer Reviewed / Open Access / Int'l Joint Research / Acknowledgement Compliant
• [Journal Article] Ultra-high field fMRI reveals systematic functional organization for binocular disparity in human visual cortex. (2015)
  • Author(s): Goncalves, N. R., Ban, H., Sanchez-Panchuel, R. M., Francis, S., Schluppeck, D., Welchman, A. E.
  • Journal Title: The Journal of Neuroscience Volume: 35 Pages: 3056-3072
  • Peer Reviewed / Open Access / Acknowledgement Compliant
• [Journal Article] fMRI脳機能イメージングとTMS法で明らかになった ヒト脳内における3D視覚情報の処理と統合 (2015)
  • Author(s): 番 浩志, ドリタ チャン, アンドリュー ウェルチマン
  • Journal Title: 映像情報メディア学会誌 Volume: 7
• [Presentation] 脳機能イメージングによって明らかになった立体視の脳内処理経路と立体視手掛かりの統合過程 (2016)
  • Author(s): 番浩志
  • Organizer: 基礎心理学会フォーラム「脳イメージングで探る3次元の世界」
  • Place of Presentation: 東北学院大学(宮城県、仙台市)
  • Year and Date: 2016-03-17
  • Invited
• [Presentation] Dorsal cortical pathway that translates local binocular disparities into 3-D surfaces (2016)
  • Author(s): Hiroshi Ban
  • Organizer: Maastricht University研究会
  • Place of Presentation: Maastricht University, Maastricht, the Netherlands
  • Year and Date: 2016-03-10
  • Int'l Joint Research / Invited
• [Presentation] ヒトはなぜ3Dを見ることができるのか？ －fMRIで明らかになった立体視手掛かりの脳内処理経路－ (2015)
  • Author(s): 番浩志
  • Organizer: NHK放送技術研究所 所内セミナー
  • Place of Presentation: NHK放送技術研究所(東京都、世田谷区)
  • Year and Date: 2015-12-14
  • Invited
• [Presentation] ヒトを対象とした視知覚の脳機能画像研究～MATLABによる解析の実際 (2015)
  • Author(s): 番浩志
  • Organizer: 実ビジネスへの応用例でみるヒューマンデータセンシングとアナリティクス ～ウエアラブル技術からの生体信号、機械学習の適用～ Mathworks Japan and NTTデータ経営研究所
  • Place of Presentation: 品川シーズンテラスカンファレンス(東京都、港区)
  • Year and Date: 2015-12-03
  • Invited
• [Presentation] Seeing slant: fMRI analysis-by-synthesis reveals a cortical hierarchy that extracts 3D-surfaces (2015)
  • Author(s): Hiroshi Ban
  • Organizer: The 6th FAONS Congress and 11th Biennial Conference of the Chinese Neuroscience Society
  • Place of Presentation: 烏鎮国際会議場(中国浙江省、嘉興市)
  • Year and Date: 2015-09-21
  • Int'l Joint Research / Invited
• [Presentation] fMRI脳機能イメージングとTMS法で明らかになったヒト脳内における3D視覚情報の処理と統合 (2015)
  • Author(s): 番浩志
  • Organizer: 映像情報メディア学会年次大会2015、シンポジウム「脳と映像情報メディア」
  • Place of Presentation: 東京理科大学葛飾キャンパス(東京都、葛飾区)
  • Year and Date: 2015-08-27
  • Invited
• [Presentation] A preference for stereopsis in deep layers of human primary visual cortex (2015)
  • Author(s): Goncalves, N.R., Zimmermann, J., Ban, H., Goebel, R., Welchman. A.E.
  • Organizer: European conference on visual perception
  • Place of Presentation: University of Liverpool, Liverpool, UK
  • Year and Date: 2015-08-22
  • Int'l Joint Research
• [Presentation] Representational changes in retinotopic cortex during the development of depth cue combination in childhood (2015)
  • Author(s): Dekker, T., Ban, H., Sereno, M., Welchman, A., van der Velde, B., Nardini, M.
  • Organizer: Vision Science Society
  • Place of Presentation: TradeWinds Island Resorts, Florida, USA
  • Year and Date: 2015-05-15
  • Int'l Joint Research
• [Presentation] Brain processing of gloss information with 2D and 3D depth cues (2015)
  • Author(s): Sun, H., Di Luca, M., Fleming, R., Muryy, A., Ban, H., Welchman, A.
  • Organizer: Vision Science Society
  • Place of Presentation: TradeWinds Island Resorts, Florida, USA
  • Year and Date: 2015-05-15
  • Int'l Joint Research
• [Presentation] Cortical representations of object motion trajectories in 3D space (2015)
  • Author(s): Ban, H., Ikegaya, Y.
  • Organizer: Vision Science Society
  • Place of Presentation: TradeWinds Island Resorts, Florida, USA
  • Year and Date: 2015-05-15
  • Int'l Joint Research
• [Presentation] Translating local binocular disparities into global 3D surface structures along dorsal visual hierarchy (2015)
  • Author(s): Hiroshi Ban
  • Organizer: 中国実験心理学学会年次大会2015
  • Place of Presentation: 蘇州大学(中国江蘇省、蘇州市)
  • Year and Date: 2015-05-09
  • Int'l Joint Research / Invited
• [Presentation] ヒト背側視覚経路における階層的な奥行き視情報の処理:fMRIおよび行動実験によるアプローチ (2014)
  • Author(s): 番浩志
  • Organizer: 関西若手心理学研究会
  • Place of Presentation: 大阪大学人間科学部、大阪府吹田市
  • Year and Date: 2014-07-26
  • Invited
• [Presentation] A local display characterization method to improve calibration accuracies and to achieve quick chromaticity reproductions (2014)
  • Author(s): Hiroshi Ban, Hiroyuki Yamashiro, Hiroki Yamamoto
  • Organizer: Asia-Pacific Conference on Vision
  • Place of Presentation: 香川国際コンベンションホール、香川県高松市
  • Year and Date: 2014-07-19 – 2014-07-22
• [Presentation] ヒト初期(V1/V2)および背側視覚野V3A、V3B/KOにおける奥行き視情報の処理と統合 (2014)
  • Author(s): 番浩志
  • Organizer: 生理学研究所研究会「視知覚の現象・機能・メカニズム –生理学的、心理物理学的、計算論的アプローチ」
  • Place of Presentation: 岡崎生理学研究所、愛知県岡崎市
  • Year and Date: 2014-06-12 – 2014-06-13
  • Invited
• [Presentation] Cortical organization of binocular disparity in human V3A. (2014)
  • Author(s): Nuno Goncalves, Hiroshi Ban, Rosa Sanchez-Panchuelo, Susan Francis, Denis Schluppeck, Andrew Welchman
  • Organizer: Vision Science Society
  • Place of Presentation: フロリダ、USA
  • Year and Date: 2014-05-16 – 2014-05-21
• [Presentation] The Perception of Glossiness in the Human Brain (2014)
  • Author(s): Hua-Chun Sun, Hiroshi Ban, Andrew Welchman
  • Organizer: Vision Science Society
  • Place of Presentation: フロリダ、USA
  • Year and Date: 2014-05-16 – 2014-05-21
• [Presentation] Goal-seeking approaches to characterize non-CRT as well as CRT displays for vision experiments (2014)
  • Author(s): Hiroshi Ban, Hiroki Yamamoto
  • Organizer: Vision Science Society
  • Place of Presentation: フロリダ、USA
  • Year and Date: 2014-05-16 – 2014-05-21
• [Book] 基礎心理学会編 実験心理学ハンドブック 「2.1.1 視覚刺激呈示装置：カラーディスプレイ」 (2017)
  • Author(s): 番浩志
  • Publisher: 朝倉書店