Active stereo for indoor and outdoor use with event camera and ripple motion patterning

2022 Fiscal Year Final Research Report

• Project/Area Number: 20K19849
• Research Category: Grant-in-Aid for Early-Career Scientists
• Allocation Type: Multi-year Fund
• Review Section: Basic Section 61020:Human interface and interaction-related
• Research Institution: Nara Institute of Science and Technology
• Principal Investigator: Fujimoto Yuichiro 奈良先端科学技術大学院大学, 先端科学技術研究科, 助教 (30755971)
• Project Period (FY): 2020-04-01 – 2023-03-31
• Keywords: イベントカメラ / ３次元形状計測 / アクティブステレオ / プロジェクタ / プロジェクションマッピング

Outline of Final Research Achievements

This research proposed and developed a technology to apply an event camera, which can observe only the presence (and direction) of changes in light intensity during a small period of time, for an active stereo system operating in bright locations. First, in order to obtain the correspondence between each pixel of the projector and the camera, a new projecting patterns with different frequencies for each row and column was proposed. Using this pattern, I also proposed a method to calculate the relative 3D positions and postures of the two projectors and cameras. Based on this method, an active stereo system for 3D shape measurement was developed. Comparison experiments with a projector camera using a normal frame camera showed that the 3D shape measurement is stable even in a very bright environment (projection surface of about 2500 lux).

Free Research Field

拡張現実感

Academic Significance and Societal Importance of the Research Achievements

これまでのプロジェクタカメラを用いたアクティブステレオは暗所の方がロバストに動作し，明所で動作させるためには，パタンの輝度やカメラによる検出時の微細なパラメータ調整が必要であった．それに対し，そのような調整の必要なく，明所でも暗所でも安定して動作するアクティブステレオを開発したことに学術的意義がある．また，この技術は明所での（例えば屋内での）プロジェクションマッピングなどに直接転用可能である．