Development of Occlusion-Capable Retinal-Scanning Optical See-Through Head-Mounted Display with Depth Scanning

• Project/Area Number: 17K19985
• Research Category: Grant-in-Aid for Challenging Research (Exploratory)
• Allocation Type: Multi-year Fund
• Research Field: Information science, computer engineering, and related fields
• Research Institution: Tokyo Institute of Technology
• Principal Investigator: Itoh Yuta 東京工業大学, 情報理工学院, 助教 (10781362)
• Project Period (FY): 2017-06-30 – 2020-03-31
• Project Status: Completed (Fiscal Year 2019)
• Budget Amount: ¥6,370,000 (Direct Cost: ¥4,900,000、Indirect Cost: ¥1,470,000); Fiscal Year 2019: ¥1,820,000 (Direct Cost: ¥1,400,000、Indirect Cost: ¥420,000); Fiscal Year 2018: ¥2,210,000 (Direct Cost: ¥1,700,000、Indirect Cost: ¥510,000); Fiscal Year 2017: ¥2,340,000 (Direct Cost: ¥1,800,000、Indirect Cost: ¥540,000)
• Keywords: 拡張現実感 / AR / HMD / 光学遮蔽 / 可変焦点 / 頭部搭載型ディスプレイ / 網膜投影 / 奥行き

Outline of Final Research Achievements

Optical see-through head-mounted displays (OST-HMD) are used for augmented reality (AR) technology that integrates virtual objects into the real world by superimposing images directly on the wearer's field of view. In this study, we have realized an OST-HMD system with optical occlusion that is free from perceptual deficiencies and overflowing of the displayed image. We have developed a miniaturized OST-HMD that produces perceptually consistent occlusion by combining a depth-range and retina-scanning OST-HMD with a transmissive liquid crystal display (LCD) using an integrated rangefinder laser projector.

Academic Significance and Societal Importance of the Research Achievements

光学シースルー頭部搭載型ディスプレイ(OST-HMD)は、視野にヴァーチャルな映像を現実世界に表示する、拡張現実感（AR）技術に用いられる。OST-HMDによる映像は常に半透明の物体として表示され、映像の現実感を損なう。例えば、OST-HMDによって現実の机上にティーポットを表示するとティーポットが透けて後ろの机が映りこんでしまい、ポットが机に「在る」感覚を得ることは難しい。この遮蔽問題はOST-HMDによる自然なAR表示を実現する上で、根本的な問題の一つである。本研究では、光学遮蔽を実現したOST-HMDシステムを実現し、より現実感のあるAR表示が実現できることを示した。

Research Products

• [Int'l Joint Research] University of Otago(ニュージーランド)
• [Int'l Joint Research] Coburg University(Germany)
• [Int'l Joint Research] Mississippi State University(米国)
• [Journal Article] Light Attenuation Display: Subtractive See-Through Near-Eye Display via Spatial Color Filtering (2019)
  • Author(s): Itoh Yuta、Langlotz Tobias、Iwai Daisuke、Kiyokawa Kiyoshi、Amano Toshiyuki
  • Journal Title: IEEE Transactions on Visualization and Computer Graphics Volume: 25 Issue: 5 Pages: 1951-1960
  • DOI: 10.1109/tvcg.2019.2899229
  • Peer Reviewed / Int'l Joint Research
• [Journal Article] Varifocal Occlusion for Optical See-Through Head-Mounted Displays using a Slide Occlusion Mask (2019)
  • Author(s): Hamasaki Takumi、Itoh Yuta
  • Journal Title: IEEE Transactions on Visualization and Computer Graphics Volume: 25 Issue: 5 Pages: 1961-1969
  • DOI: 10.1109/tvcg.2019.2899249
  • Peer Reviewed
• [Journal Article] Occlusion Leak Compensation for Optical See-Through Displays Using a Single-Layer Transmissive Spatial Light Modulator (2017)
  • Author(s): Itoh Yuta、Hamasaki Takumi、Sugimoto Maki
  • Journal Title: IEEE Transactions on Visualization and Computer Graphics Volume: 23 Issue: 11 Pages: 2463-2473
  • DOI: 10.1109/tvcg.2017.2734427
  • Peer Reviewed
• [Journal Article] A Survey of Calibration Methods for Optical See-Through Head-Mounted Displays (2017)
  • Author(s): Grubert Jens、Itoh Yuta、Moser Kenneth R.、Swan II J. Edward
  • Journal Title: IEEE Transactions on Visualization and Computer Graphics Volume: none Issue: 9 Pages: 1-14
  • DOI: 10.1109/tvcg.2017.2754257
  • Peer Reviewed / Open Access / Int'l Joint Research
• [Presentation] Light Attenuation Display: Subtractive See-Through Near-Eye Display via Spatial Color Filtering (2019)
  • Author(s): Itoh Yuta、Langlotz Tobias、Iwai Daisuke、Kiyokawa Kiyoshi、Amano Toshiyuki
  • Organizer: IEEE VR 2019
  • Int'l Joint Research
• [Presentation] Light Attenuation Display: Subtractive See-Through Near-Eye Display via Spatial Color Filtering (2019)
  • Author(s): Yuta Itoh
  • Organizer: OSA Frontiers in Optics (FiO) 2019, Theme: Virtual Reality and Augmented Vision, Washington, D.C. Thu, Aug. 19, 2019.
  • Invited
• [Presentation] Light Attenuation Display: Subtractive See-Through Near-Eye Display via Spatial Color Filtering (2019)
  • Author(s): Yuta Itoh
  • Organizer: SIGGRAPH 2019 TVCG Special Session on Mixed And Augmented Reality, L.A., US, July 28, 2019.
  • Invited
• [Presentation] Varifocal Occlusion for Optical See-Through Head-Mounted Displays using a Slide Occlusion Mask (2019)
  • Author(s): Hamasaki Takumi、Itoh Yuta
  • Organizer: IEEE Virtual Reality 2019
  • Int'l Joint Research
• [Presentation] Calibration Methods for Optical See-Through Head-Mounted Displays (2018)
  • Author(s): Jens Grubert, Yuta Itoh, Kenneth Moser, J. Edward Swan II
  • Organizer: IEEE Virtual Reality 2018: Tutorial
  • Int'l Joint Research
• [Remarks] 【メディア記事】東京工業大学など、背景からの光を差し引いて画像を形成する光学式シースルー
  • URL: https://shiropen.com/seamless/light-attenuation-display
• [Remarks] Varifocal Occlusion
  • URL: http://www.ar.c.titech.ac.jp/cpt_project/varifocal-occlusion/
• [Patent(Industrial Property Rights)] ディスプレイ装置 (2019)
  • Inventor(s): 伊藤勇太、浜崎巧
  • Industrial Property Rights Holder: 東京工業大学
  • Industrial Property Rights Type: 特許
  • Industrial Property Number: 2019-050959
  • Filing Date: 2019