• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Advancement of Vision Augmentation via Optical See-Through Head-Mounted Displays and Vision-Adaptive Image Processing

Research Project

Project/Area Number 17H04692
Research Category

Grant-in-Aid for Young Scientists (A)

Allocation TypeSingle-year Grants
Research Field Human interface and interaction
Research InstitutionTokyo Institute of Technology

Principal Investigator

Itoh Yuta  東京工業大学, 情報理工学院, 助教 (10781362)

Project Period (FY) 2017-04-01 – 2021-03-31
Project Status Completed (Fiscal Year 2020)
Budget Amount *help
¥24,310,000 (Direct Cost: ¥18,700,000、Indirect Cost: ¥5,610,000)
Fiscal Year 2019: ¥6,500,000 (Direct Cost: ¥5,000,000、Indirect Cost: ¥1,500,000)
Fiscal Year 2018: ¥6,240,000 (Direct Cost: ¥4,800,000、Indirect Cost: ¥1,440,000)
Fiscal Year 2017: ¥7,020,000 (Direct Cost: ¥5,400,000、Indirect Cost: ¥1,620,000)
Keywords拡張現実感 / AR / HMD / 光学遮蔽 / 可変焦点 / 視覚拡張 / 光学透過型 / 光学シースルーHMD / ヴァーチャルリアリティ / 人間拡張
Outline of Final Research Achievements

We have made the following major achievements toward the realization of visual augmentation technology using augmented reality (AR) with optical see-through HMDs.
# A new spatial image projection technology using a Beaming Projector (Achievement 1).# New image presentation technology using color subtraction (2, 3, 15). # A new spatial calibration method using deep learning that takes into account the viewpoint position.(10). # Comprehensive survey papers and tutorials on spatial calibration methods(6,13). # Research on depth perception of retinal projection images(8). # Glasses that correct colors according to the color vision characteristics(Achievement 9). # Glasses that can be programmed to a specific power (4) # A new AR image expression method to realize HDR(4). # A new AR image expression method to realize HDR(5)# See-through HMD to realize optical cloaking in combination with the background(7)

Academic Significance and Societal Importance of the Research Achievements

本研究は、AR技術を応用しウェアラブルディスプレイによって視覚を賢く補助する視覚拡張技術の基礎を開拓した。視覚拡張の研究ではディスプレイ技術の基礎研究から、実用を見越した応用的研究までを多岐に扱うことが望ましい。本研究ではARディスプレイ技術の根本的問題である位置合わせ問題に関しては、包括的サーベイから深層学習を用いた新しい校正手法の提案まで扱った。視覚特性推定関しては特に網膜投影ディスプレイに関する新しい知見を獲得した。最後に応用である視覚特性適応画像処理手は、色覚を始めとする様々な視覚機能を補助する技術のコンセプト実証を行った。こうした成果は今後の視覚拡張技術の発展に寄与すると考えている。

Report

(4 results)
  • 2020 Final Research Report ( PDF )
  • 2019 Annual Research Report
  • 2018 Annual Research Report
  • 2017 Annual Research Report
  • Research Products

    (19 results)

All 2020 2019 2018 2017 Other

All Int'l Joint Research (5 results) Journal Article (7 results) (of which Int'l Joint Research: 4 results,  Peer Reviewed: 6 results,  Open Access: 1 results) Presentation (5 results) (of which Int'l Joint Research: 4 results,  Invited: 1 results) Remarks (1 results) Patent(Industrial Property Rights) (1 results)

  • [Int'l Joint Research] Ecole Centrale de Nantes/Inria/University Rennes(フランス)

    • Related Report
      2019 Annual Research Report
  • [Int'l Joint Research] オタゴ大学(ニュージーランド)

    • Related Report
      2018 Annual Research Report
  • [Int'l Joint Research] Coburg University(Germany)

    • Related Report
      2017 Annual Research Report
  • [Int'l Joint Research] Mississippi State University(米国)

    • Related Report
      2017 Annual Research Report
  • [Int'l Joint Research] Otago University(New Zealand)

    • Related Report
      2017 Annual Research Report
  • [Journal Article] Can Retinal Projection Displays Improve Spatial Perception in Augmented Reality?2020

    • Author(s)
      Etienne , Yuta Itoh, Guillaume Moreau, Jean-Marie Normand, Anatole Lecuyer, Ferran Argelaguet
    • Journal Title

      Proceedings on 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)

      Volume: n.a. Pages: 80-89

    • DOI

      10.1109/ismar50242.2020.00028

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] OSTNet: Calibration Method for Optical See-Through Head-Mounted Displays via Non-Parametric Distortion Map Generation2019

    • Author(s)
      Someya Kiyosato、Hiroi Yuichi、Yamada Makoto、Itoh Yuta
    • Journal Title

      Proceedings on 2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)

      Volume: n.a Pages: 259-260

    • DOI

      10.1109/ismar-adjunct.2019.00-34

    • Related Report
      2019 Annual Research Report
  • [Journal Article] Light Attenuation Display: Subtractive See-Through Near-Eye Display via Spatial Color Filtering2019

    • Author(s)
      Itoh Yuta、Langlotz Tobias、Iwai Daisuke、Kiyokawa Kiyoshi、Amano Toshiyuki
    • Journal Title

      IEEE Transactions on Visualization and Computer Graphics

      Volume: 25 Issue: 5 Pages: 1951-1960

    • DOI

      10.1109/tvcg.2019.2899229

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] HySAR: Hybrid Material Rendering by an Optical See-Through Head-Mounted Display with Spatial Augmented Reality Projection2018

    • Author(s)
      Takumi Hamasaki, Yuta Itoh, Yuichi Hiroi, Daisuke Iwai, Maki Sugimoto
    • Journal Title

      IEEE Transactions on Visualization and Computer Graphics

      Volume: 24 Issue: 4 Pages: 1457-1466

    • DOI

      10.1109/tvcg.2018.2793659

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed
  • [Journal Article] ChromaGlasses2018

    • Author(s)
      Langlotz Tobias、Sutton Jonathan、Zollmann Stefanie、Itoh Yuta、Regenbrecht Holger
    • Journal Title

      ACM CHI proceedings

      Volume: none Pages: 1-12

    • DOI

      10.1145/3173574.3173964

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] A Survey of Calibration Methods for Optical See-Through Head-Mounted Displays2017

    • Author(s)
      Grubert Jens、Itoh Yuta、Moser Kenneth R.、Swan II J. Edward
    • Journal Title

      IEEE Transactions on Visualization and Computer Graphics

      Volume: none Issue: 9 Pages: 1-14

    • DOI

      10.1109/tvcg.2017.2754257

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Occlusion Leak Compensation for Optical See-Through Displays Using a Single-Layer Transmissive Spatial Light Modulator2017

    • Author(s)
      Itoh Yuta、Hamasaki Takumi、Sugimoto Maki
    • Journal Title

      IEEE Transactions on Visualization and Computer Graphics

      Volume: 23 Issue: 11 Pages: 2463-2473

    • DOI

      10.1109/tvcg.2017.2734427

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed
  • [Presentation] Can Retinal Projection Displays Improve Spatial Perception in Augmented Reality?2020

    • Author(s)
      Etienne , Yuta Itoh, Guillaume Moreau, Jean-Marie Normand, Anatole Lécuyer, Ferran Argelaguet
    • Organizer
      2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] OSTNet: Calibration Method for Optical See-Through Head-Mounted Displays via Non-Parametric Distortion Map Generation2019

    • Author(s)
      Someya Kiyosato、Hiroi Yuichi、Yamada Makoto、Itoh Yuta
    • Organizer
      2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Light Attenuation Display: Subtractive See-Through Near-Eye Display via Spatial Color Filtering2019

    • Author(s)
      Itoh Yuta、Langlotz Tobias、Iwai Daisuke、Kiyokawa Kiyoshi、Amano Toshiyuki
    • Organizer
      IEEE Virtual Reality 2019
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 視覚拡張に向けた最近のnear-eyeディスプレイ研究の発展に関して2018

    • Author(s)
      伊藤勇太
    • Organizer
      日本ヴァーチャルリアリティ学会 第57回 複合現実感研究会
    • Related Report
      2018 Annual Research Report
    • Invited
  • [Presentation] Calibration Methods for Optical See-Through Head-Mounted Displays2018

    • Author(s)
      Jens Grubert, Yuta Itoh, Kenneth Moser, J. Edward Swan II
    • Organizer
      IEEE Virtual Reality 2018: Tutorial
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Remarks] Light Attenuation Display

    • URL

      http://www.ar.c.titech.ac.jp/cpt_project/light-attenuation-display/

    • Related Report
      2018 Annual Research Report
  • [Patent(Industrial Property Rights)] 光学式シースルー型ディスプレイ2019

    • Inventor(s)
      伊藤勇太、Tobias Langlotz
    • Industrial Property Rights Holder
      東京工業大学
    • Industrial Property Rights Type
      特許
    • Industrial Property Number
      2019-050960
    • Filing Date
      2019
    • Related Report
      2018 Annual Research Report

URL: 

Published: 2017-04-28   Modified: 2022-05-23  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi