疎表現に基づく質感と３次元形状の同時推定

• Project Area: Integrative studies of neural mechanisms and advanced information technologies for perception of material and surface qualities
• Project/Area Number: 25135704
• Research Category: Grant-in-Aid for Scientific Research on Innovative Areas (Research in a proposed research area)
• Allocation Type: Single-year Grants
• Review Section: Complex systems
• Research Institution: University of Tsukuba
• Principal Investigator: 酒井 宏 筑波大学, システム情報系, 教授 (80281666)
• Project Period (FY): 2013-04-01 – 2015-03-31
• Project Status: Completed (Fiscal Year 2014)
• Budget Amount: ¥10,010,000 (Direct Cost: ¥7,700,000、Indirect Cost: ¥2,310,000); Fiscal Year 2014: ¥5,720,000 (Direct Cost: ¥4,400,000、Indirect Cost: ¥1,320,000); Fiscal Year 2013: ¥4,290,000 (Direct Cost: ¥3,300,000、Indirect Cost: ¥990,000)
• Keywords: 脳・神経 / 神経科学 / 認知科学 / 感性情報学 / 画像・文章・音声等認識

Outline of Annual Research Achievements

疎性(sparseness)を制約とした成分分析により推定したBRDF kernel について解析を行った。成分分析(Non-negative Matrix Factorization)によって示された１０個程度の kernelの、質感としての反射特性を明らかにし、その表現の物理的・知覚的意味を解析した。これにより，BRDF kernel の線形結合によって質感が表現され得ることを示した。
さらに，質感と３次元形状が同時知覚されているとの仮説を検討した。心理物理実験では，推定したBRDF kernel を基にして，最新のray-tracing 技術(Physically based Rendering: pbrt-v2 )によって刺激を作成した。実験では，単一のBRDF kernel からなる刺激を作成し，これが質感からの３次元形状知覚において順応を示すかどうかを測定した。成分分析で高寄与だったkernelほど，高い順応を示すことが示された。順応時の視線を確認するために視線追跡を実施したが，特定の偏向は観察されなかった。
このように，計算解析および心理物理実験の結果を基に，BRDF kernel の線形結合による質感表現モデルを提案した。さらに，質感と３次元形状を同時推定可能な計算アルゴリズムに立脚した知覚モデルを提案した。

Research Progress Status

26年度が最終年度であるため、記入しない。

Strategy for Future Research Activity

26年度が最終年度であるため、記入しない。

Research Products

• [Journal Article] Facilitatory mechanisms of specular highlights in the perception of depth (2015)
  • Author(s): K. Sakai, R. Meiji and T. Abe
  • Journal Title: Vision Research Volume: 112
  • Peer Reviewed / Acknowledgement Compliant
• [Journal Article] Neural construction of 3D medial axis from the binocular fusion of 2D MAs (2015)
  • Author(s): W. Qiu, Y. Hatori and K. Sakai
  • Journal Title: Neurocomputing Volume: 149 Pages: 546-558
  • DOI: 10.1016/j.neucom.2014.08.019
  • NAID: 120007136494
  • Peer Reviewed / Acknowledgement Compliant
• [Journal Article] Perception of Symmetry in Natural Images --- A Cortical Representation of Shape (2014)
  • Author(s): K. Sakai, K. Kurematsu, and S. Matsuoka
  • Journal Title: Lecture Notes in Computer Science Volume: 8836 Pages: 135-141
  • DOI: 10.1007/978-3-319-12643-2_17
  • ISBN: 9783319126425, 9783319126432
  • Peer Reviewed / Acknowledgement Compliant
• [Journal Article] Early representation of shape by onset synchronization of border-ownership-selective cells in the V1-V2 network (2014)
  • Author(s): Yasuhiro Hatori, Ko Sakai
  • Journal Title: Journal of the Optical Society of America A Volume: 31 Issue: 4 Pages: 716-729
  • DOI: 10.1364/josaa.31.000716
  • Peer Reviewed
• [Journal Article] Spatial and feature-based attention in a layered cortical microcircuit model. (2013)
  • Author(s): Nobuhiko Wagatsuma, Tobias C. Potjans, Markus Diesmann, Ko Sakai, Tomoki Fukai
  • Journal Title: PLOS One Volume: 8 Issue: 12 Pages: 1-14
  • DOI: 10.1371/journal.pone.0080788
  • Peer Reviewed
• [Journal Article] Feature-based Attention in Early Vision for the Modulation of Figure-Ground Segregation (2013)
  • Author(s): N. Wagatsuma, M. Oki and K. Sakai
  • Journal Title: Frontiers in Psychology Volume: Vol. 4, Article 123 Pages: 17-17
  • DOI: 10.3389/fpsyg.2013.00123
  • Peer Reviewed
• [Journal Article] Latency Modulation of Border Ownership Selective Cells in V1-V2 Feed-Forward Model (2013)
  • Author(s): K. Sakai and S. Michii
  • Journal Title: Proceedings of International Conference on Neural Information Processing(ICONIP) 2013, (Oral Presentation) Lecture Notes in Computer Science Volume: Vol. 8228 Pages: 291-300
  • DOI: 10.1007/978-3-642-42051-1_37
  • ISBN: 9783642420504, 9783642420511
  • Peer Reviewed
• [Journal Article] Sparseness Controls the Receptive Field Characteristics of V4 Neurons : Generation of Curvature Selectivity in V4 (2013)
  • Author(s): Y. Hatori, T. Mashita, K. Sakai
  • Journal Title: Lecture Notes in Computer Science Volume: 8131 Pages: 327-334
  • DOI: 10.1007/978-3-642-40728-4_41
  • ISBN: 9783642407277, 9783642407284
  • Peer Reviewed
• [Presentation] Adaptation to Symmetry Axis --- Towards Understanding the Cortical Representation of Shape --- (2015)
  • Author(s): K. Sakai, K. Kurematsu and Y. Sakata
  • Organizer: Asia-Pacific Conference on Vision 2015
  • Place of Presentation: Singapore
  • Year and Date: 2015-07-10 – 2015-07-12
• [Presentation] Direction of Figure in Natural Contours by Population Coding of Surround-Modulation Models and V4 Neuronal Activities (2015)
  • Author(s): M. Hasuike, Y. Nakata, Y. Yamane, H. Tamura and K. Sakai
  • Organizer: Asia-Pacific Conference on Vision 2015
  • Place of Presentation: Singapore
  • Year and Date: 2015-07-10 – 2015-07-12
  • Invited
• [Presentation] The Simultaneous Perception of Material Qualities and Depth in Human Vision (2015)
  • Author(s): T. Oyakawa and K. Sakai
  • Organizer: AEARU CS-WT workshop 2015
  • Place of Presentation: 筑波大学（茨城県）
  • Year and Date: 2015-02-26 – 2015-02-27
• [Presentation] Global and local properties in the perception of figure-ground (2015)
  • Author(s): M. Urabe and K. Sakai
  • Organizer: AEARU CS-WT workshop 2015
  • Place of Presentation: 筑波大学（茨城県）
  • Year and Date: 2015-02-26 – 2015-02-27
• [Presentation] Cortical Representation of Meterial: Adaptation to Reflectance Distribution Function (2015)
  • Author(s): K. Kudo and K. Sakai
  • Organizer: AEARU CS-WT workshop 2015
  • Place of Presentation: 筑波大学（茨城県）
  • Year and Date: 2015-02-26 – 2015-02-27
• [Presentation] Synchronous Firing Caused by Natural Image Contours (2015)
  • Author(s): D. Minowa, Y. Yamane, H. Tamura and K. Sakai
  • Organizer: AEARU CS-WT workshop 2015
  • Place of Presentation: 筑波大学（茨城県）
  • Year and Date: 2015-02-26 – 2015-02-27
• [Presentation] Curvatures of Natural Contours Facilitate Neural Responses of Figure-Ground (2015)
  • Author(s): M. Hasuike, Y. Yamane, H. Tamura and K. Sakai
  • Organizer: AEARU CS-WT workshop 2015
  • Place of Presentation: 筑波大学（茨城県）
  • Year and Date: 2015-02-26 – 2015-02-27
• [Presentation] 物体領域知覚における大域性と局所性 -図地知覚と図方向知覚の関係から見る皮質メカニズムの究明- (2015)
  • Author(s): 卜部みか, 酒井 宏
  • Organizer: 日本視覚学会 冬季大会
  • Place of Presentation: 工学院大学（東京都）
  • Year and Date: 2015-02-21
• [Presentation] 対称軸への順応 (2015)
  • Author(s): 榑松憲, 酒井 宏
  • Organizer: 日本視覚学会 冬季大会
  • Place of Presentation: 工学院大学（東京都）
  • Year and Date: 2015-02-21
• [Presentation] 質感に依存して変化する奥行き知覚 (2015)
  • Author(s): 親川武仕, 酒井 宏
  • Organizer: 日本視覚学会 冬季大会
  • Place of Presentation: 工学院大学（東京都）
  • Year and Date: 2015-01-23 – 2015-01-25
• [Presentation] 視覚皮質における質感表現の探索 -BRDF morphing刺激を用いた順応実験- (2015)
  • Author(s): 工藤功基, 酒井 宏
  • Organizer: 日本視覚学会 冬季大会
  • Place of Presentation: 工学院大学（東京都）
  • Year and Date: 2015-01-23
• [Presentation] A search for material representation in the cortex (2014)
  • Author(s): T. Oyakawa and K. Sakai
  • Organizer: Annual Conference of Japanese Neural Network Society, 2014
  • Place of Presentation: はこだて未来大学（北海道）
  • Year and Date: 2014-09-27
• [Presentation] Sparseness and surface representation in the generation of curvature selectivity (2014)
  • Author(s): Y. Hatori, T. Mashita and K. Sakai
  • Organizer: Vision Sciences Society, Annual Meeting 2014
  • Place of Presentation: St. Petersburg, FL, U.S.A.
  • Year and Date: 2014-05-17
• [Presentation] Perceptual characteristics of natural contours and their contributions to figure/ground segregation (2014)
  • Author(s): K. Sakai, K. Kurematsu and S. Matsuoka
  • Organizer: Vision Sciences Society, Annual Meeting 2014
  • Place of Presentation: St. Petersburg, FL, U.S.A.
  • Year and Date: 2014-05-17
• [Presentation] Sparseness for the Representation of Surface in the Construction of Curvature Selectivity in V4 (2013)
  • Author(s): Y. Hatori, T. Mashita, K. Sakai
  • Organizer: PRISM2: The science of light & shade
  • Place of Presentation: Bordearux, France
• [Presentation] Latency Modulation of Border Ownership Selective Cells in V1-V2 Feed-Forward Model
  • Author(s): K. Sakai and S. Michii
  • Organizer: International Conference on Neural Information Processing(ICONIP)
  • Place of Presentation: Daegu, Korea
• [Presentation] Sparseness Controls the Receptive Field Characteristics of V4 Neurons: Generation of Curvature Selectivity in V4
  • Author(s): Y. Hatori, T. Mashita, K. Sakai
  • Organizer: International Conference on Artificial Neural Networks (ICANN)
  • Place of Presentation: Sofia, Bulgaria
• [Presentation] Sparse Representation in the Construction of Curvature Selectivity in V4
  • Author(s): Y. Hatori, T. Mashita, K. Sakai
  • Organizer: Neuro 2013
  • Place of Presentation: Kyoto, Japan
• [Presentation] 自然画像輪郭における対称性の知覚
  • Author(s): 榑松憲, 酒井宏
  • Organizer: 日本視覚学会 冬季大会
  • Place of Presentation: 東京都
• [Presentation] 輪郭の凸性・閉合性・対称性と図方向知覚
  • Author(s): 松岡昭平, 榑松憲, 酒井宏
  • Organizer: 日本視覚学会 冬季大会
  • Place of Presentation: 東京都
• [Presentation] 質感表現の探索
  • Author(s): 親川武仕, 酒井宏
  • Organizer: 日本視覚学会 冬季大会
  • Place of Presentation: 東京都
• [Remarks] Subjects of Research
  • URL: http://www.cvs.cs.tsukuba.ac.jp/research.html
• [Remarks] 研究テーマ概要の紹介
  • URL: http://www.cvs.cs.tsukuba.ac.jp/research.html