• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Optimization of the holographic video processing pipeline

Research Project

Project/Area Number 23K24863
Project/Area Number (Other) 22H03607 (2022-2023)
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeMulti-year Fund (2024)
Single-year Grants (2022-2023)
Section一般
Review Section Basic Section 61010:Perceptual information processing-related
Research InstitutionChiba University

Principal Investigator

下馬場 朋禄  千葉大学, 大学院工学研究院, 教授 (20360563)

Project Period (FY) 2022-04-01 – 2026-03-31
Project Status Granted (Fiscal Year 2024)
Budget Amount *help
¥16,770,000 (Direct Cost: ¥12,900,000、Indirect Cost: ¥3,870,000)
Fiscal Year 2025: ¥2,340,000 (Direct Cost: ¥1,800,000、Indirect Cost: ¥540,000)
Fiscal Year 2024: ¥4,160,000 (Direct Cost: ¥3,200,000、Indirect Cost: ¥960,000)
Fiscal Year 2023: ¥6,760,000 (Direct Cost: ¥5,200,000、Indirect Cost: ¥1,560,000)
Fiscal Year 2022: ¥3,510,000 (Direct Cost: ¥2,700,000、Indirect Cost: ¥810,000)
Keywordsホログラフィ / ホログラフィックディスプレイ / アルゴリズム / 3次元ディスプレイ / 深層学習 / 3次元ディスプレイ / 信号処理
Outline of Research at the Start

本研究課題は次々世代のディスプレイ技術と期待されているホログラフィック3次元ディスプレイの映像処理パイプラインの最適化を行い,その基盤技術を確立する.具体的には,パイプラインの各工程で課題となっている,(1) ホログラム計算の高速化,(2) 高画質な再生像を得ることができるエンコーディング技術(ホログラム表示素子の特性に合わせたデータに変換する技術),(3) 極めて簡易な光学システムの実現,について研究開発を行う.

Outline of Annual Research Achievements

本研究課題は,次々世代のディスプレイ技術と期待されているホログラフィック3次元ディスプレイで課題となっている,(1) ホログラム計算の高速化,(2) より簡易な光学システムの実現,(3) 高画質な再生像を得ることができるホログラム最適化技術,について研究開発を行うものである.(1)に関して,点群法とポリゴンホログラムのハイブリッド計算、深層学習を用いたホログラム計算について実装を行い,その有効性を確認した.深層学習をもちいたこの研究では,一般的にホログラム計算に必要とされる奥行データを用いずに3Dホログラム生成を行えることを示した.奥行き情報の取得には専用の装置が必要であったが,提案手法では不要になる.(2)に関しては,特殊な光学素子をホログラムと観察者の間に配置することで,ホログラム表示素子の空間帯域幅積を拡大できる手法を開発した.昨年はこの効果をシミュレーションで確認したが,今年は実機で視域拡大を行えることを示した.(3)に関しては,ホログラムの最適化技術として,これまでに反復計算を必要とする最適化計算が使われてきたが,深層学習ベースのホログラム最適化技術を開発した.

Current Status of Research Progress
Current Status of Research Progress

2: Research has progressed on the whole more than it was originally planned.

Reason

点群法とポリゴン法を組み合わせたハイブリッド法は,計算の効率面と画質面の両面で優れた性能を示した.また深層学習による2次元画像から3次元ホログラムを生成する手法を開発した.これらの関連論文の執筆や招待講演を行った.また,視域拡大手法が実機で確認できたことは大きな進捗であった.この検討の際に,派生研究(新しい回折計算手法)の検討を行えたことは,想定外の進捗であった.

Strategy for Future Research Activity

今後は、より高視域なホログラフィックディスプレイにおける高速計算技術をアルゴリズム面とハードウェア面の両方から検討を行っていきたい。また、高視域なホログラフィックディスプレイは、高精細で大画素数の空間光変調器が要求されるが、このようなハードウェアの開発は現実出来ではない。このようなハードウェアを使わずに、同等の画質・視域・像サイズを実現できる手法の開発を行う予定である。具体的には、周期的もしくは非周期的な拡散素子を利用する手法を考えている。

Report

(2 results)
  • 2023 Annual Research Report
  • 2022 Annual Research Report
  • Research Products

    (47 results)

All 2024 2023 2022 Other

All Int'l Joint Research (4 results) Journal Article (16 results) (of which Int'l Joint Research: 6 results,  Peer Reviewed: 15 results,  Open Access: 13 results) Presentation (26 results) (of which Int'l Joint Research: 13 results,  Invited: 8 results) Book (1 results)

  • [Int'l Joint Research] Vrije Universiteit Brussel(ベルギー)

    • Related Report
      2023 Annual Research Report
  • [Int'l Joint Research] Taiwan Normal University(その他の国・地域)

    • Related Report
      2023 Annual Research Report
  • [Int'l Joint Research] Warsaw University of technology(ポーランド)

    • Related Report
      2022 Annual Research Report
  • [Int'l Joint Research] Vrije Universiteit Brussel(VUB)(ベルギー)

    • Related Report
      2022 Annual Research Report
  • [Journal Article] Further aliasing-reduced shifted and scaled Fresnel diffraction2024

    • Author(s)
      Fujimori Soma、Ito Tomoyoshi、Shimobaba Tomoyoshi
    • Journal Title

      Optics and Lasers in Engineering

      Volume: 173 Pages: 107918-107918

    • DOI

      10.1016/j.optlaseng.2023.107918

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Rationalized diffraction calculations for high accuracy and high speed with few bits2024

    • Author(s)
      Fujimori Soma、Ito Tomoyoshi、Shimobaba Tomoyoshi
    • Journal Title

      Journal of the Optical Society of America A

      Volume: 41 Issue: 2 Pages: 303-303

    • DOI

      10.1364/josaa.510884

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Reducing the computational complexity of high-resolution hologram calculations using polynomial approximation2023

    • Author(s)
      Shiomi Harutaka、Shimobaba Tomoyoshi、Kakue Takashi、Ito Tomoyoshi
    • Journal Title

      Optics Express

      Volume: 31 Issue: 11 Pages: 18576-18576

    • DOI

      10.1364/oe.488726

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Point-polygon hybrid method for generating holograms2023

    • Author(s)
      Wang Fan、Blinder David、Ito Tomoyoshi、Shimobaba Tomoyoshi
    • Journal Title

      Optics Letters

      Volume: 48 Issue: 12 Pages: 3339-3339

    • DOI

      10.1364/ol.488915

    • Related Report
      2023 Annual Research Report
  • [Journal Article] Multi-depth hologram generation from two-dimensional images by deep learning2023

    • Author(s)
      Ishii Yoshiyuki、Wang Fan、Shiomi Harutaka、Kakue Takashi、Ito Tomoyoshi、Shimobaba Tomoyoshi
    • Journal Title

      Optics and Lasers in Engineering

      Volume: 170 Pages: 107758-107758

    • DOI

      10.1016/j.optlaseng.2023.107758

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Comparison of double-phase hologram and binary amplitude encoding: holographic projection and?vortex beam generation2023

    • Author(s)
      Shimobaba Tomoyoshi、Wang Fan、Starobrat Joanna、Kowalczyk Adam、Suszek Jaros?aw、Ito Tomoyoshi
    • Journal Title

      Applied Optics

      Volume: 62 Issue: 28 Pages: 7471-7471

    • DOI

      10.1364/ao.497066

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Deep hologram converter from low-precision to middle-precision holograms2023

    • Author(s)
      Harutaka Shiomi, David Blinder, Tobias Birnbaum, Yota Inoue, Fan Wang, Tomoyoshi Ito, Takashi Kakue, Peter Schelkens, Tomoyoshi Shimobaba
    • Journal Title

      Applied Optics

      Volume: 62 Issue: 7 Pages: 1723-1729

    • DOI

      10.1364/ao.482434

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] High-speed rendering pipeline for polygon-based holograms2023

    • Author(s)
      Fan Wang, Tomoyoshi Ito, Tomoyoshi Shimobaba
    • Journal Title

      Photonics Research

      Volume: 11 Issue: 2 Pages: 313-328

    • DOI

      10.1364/prj.474158

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Wavefront recording plane-like method for polygon-based holograms2023

    • Author(s)
      Fan Wang, David Blinder, Tomoyoshi Ito, Tomoyoshi Shimobaba,
    • Journal Title

      Optics Express

      Volume: 31 Issue: 2 Pages: 1224-1233

    • DOI

      10.1364/oe.479592

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Fully analytic shading model with specular reflections for polygon-based hologram2022

    • Author(s)
      Fan Wang, Harutaka Shiomi, Tomoyoshi Ito, Takashi Kakue, Tomoyoshi Shimobaba
    • Journal Title

      Optics and Lasers in Engineering

      Volume: 160 Pages: 107235-107235

    • DOI

      10.1016/j.optlaseng.2022.107235

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Dynamic complex opto-magnetic holography2022

    • Author(s)
      Michal Makowski, Jaroslaw Bomba, Antoni Frej, Mateusz Kolodziejczyk, Maciej Sypek, Tomoyoshi Shimobaba, Tomoyoshi Ito, Andrei Kirilyuk, Andrzej Stupakiewicz
    • Journal Title

      Nature Communications

      Volume: 13 Issue: 1 Pages: 7286-7286

    • DOI

      10.1038/s41467-022-35023-9

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] HORN-9: Special-purpose computer for electroholography with Hilbert transform2022

    • Author(s)
      Yota Yamamoto, Tomoyoshi Shimobaba, Tomoyoshi Ito
    • Journal Title

      Optics Express

      Volume: 30 Issue: 21 Pages: 38115-38127

    • DOI

      10.1364/oe.471720

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Accelerating hologram generation using oriented-separable convolution and wavefront recording planes2022

    • Author(s)
      Tomoyoshi Shimobaba, Michal Makowski, Harutaka Shiomi, Fan Wang, Takayuki Hara, Maciej Sypek, Jaroslaw Suszek, Takashi Nishitsuji, Atsushi Shiraki, Takashi Kakue, Tomoyoshi Ito
    • Journal Title

      Optics Express

      Volume: 30 Issue: 20 Pages: 36564-36575

    • DOI

      10.1364/oe.472121

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Fast hologram calculation method using wavelet transform: WASABI-22022

    • Author(s)
      Harutaka Shiomi, Tomoyoshi Shimobaba, Takashi Kakue, Tomoyoshi Ito
    • Journal Title

      Optics Communications

      Volume: 525 Pages: 128836-128836

    • DOI

      10.1016/j.optcom.2022.128836

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Controllable energy angular spectrum method2022

    • Author(s)
      Fan Wang, Tomoyoshi Shimobaba, Takashi Kakue, Tomoyoshi Ito
    • Journal Title

      Optics Communications

      Volume: 520 Pages: 128506-128506

    • DOI

      10.1016/j.optcom.2022.128506

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] The state-of-the-art in computer generated holography for 3D display2022

    • Author(s)
      David Blinder, Tobias Birnbaum, Tomoyoshi Ito, Tomoyoshi Shimobaba
    • Journal Title

      Light: Advanced Manufacturing

      Volume: 3 Issue: 3 Pages: 35-35

    • DOI

      10.37188/lam.2022.035

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Presentation] Polygon-based holograms production pipeline: from 3D modeling to optical reconstruction2023

    • Author(s)
      Fan Wang, David Blinder, Harutaka Shiomi, Tomoyoshi Ito, Tomoyoshi Shimobaba
    • Organizer
      DH2023
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Diffraction calculation using low-quantization signals2023

    • Author(s)
      Tomoyoshi Shimobaba, Tatsuki Tahara, Fan Wang, Harutaka Shiomi, Takayuki Hara, Takashi Nishitsuji, Atsushi Shiraki, Tomoyoshi Ito
    • Organizer
      DH2023
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Numerical investigation of inline digital holography using axicon phase and gradient descent2023

    • Author(s)
      Tomoyoshi Shimobaba, Vipin Tiwari, Anuj Gupta, Fan Wang, Harutaka Shiomi, Chau-Jern Cheng, Tomoyoshi Ito
    • Organizer
      FiO2023
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Lighter and memory-saving diffraction calculations2023

    • Author(s)
      Tomoyoshi Shimobaba, Tatsuki Tahara, Fan Wang, Harutaka Shiomi, David Blinder, Takayuki Hara, Takashi Nishitsuji, Atsushi Shiraki, Tomoyoshi Ito
    • Organizer
      FiO2023
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Wavelet shrinkage-based superposition WASABI-3 for hologram calculations from multi-layer image2023

    • Author(s)
      Harutaka Shiomi, Tomoyoshi Ito, Tomoyoshi Shimobaba, "Wavelet shrinkage-based superposition WASABI-3 for hologram calculations from multi-layer images
    • Organizer
      FiO2023
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Advances in computer-generated hologram for rendering and acceleration based on the point-polygon hybrid method2023

    • Author(s)
      Fan Wang, David Blinder, Tomoyoshi Ito, and Tomoyoshi Shimobaba
    • Organizer
      SPIE Photonics ASIA
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Simplified wide viewing angle electronic holography using a checkered hologram generated by a lens array2023

    • Author(s)
      Soma Fujimori, Tomoyoshi Ito, Tomoyoshi Shimobaba
    • Organizer
      3DSA2023
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] The generation pipeline of polygon-based holograms2023

    • Author(s)
      Fan Wang, Tomoyoshi Ito, Tomoyoshi Shimobaba,
    • Organizer
      令和5年第2回ホログラフィック・ディスプレイ研究会
    • Related Report
      2023 Annual Research Report
    • Invited
  • [Presentation] 高精度な低ビット回折計算2023

    • Author(s)
      藤森颯真,下馬場朋禄,伊藤智義
    • Organizer
      Optics & Photonics Japan 2023
    • Related Report
      2023 Annual Research Report
  • [Presentation] 深層学習を用いた2次元画像からホログラムの生成:Instant-NeRFと3DGaussian Splattingの比較2023

    • Author(s)
      熊野開, 姜旻成, 王帆, 伊藤智義, 下馬場朋禄
    • Organizer
      HODIC学生シンポジウム
    • Related Report
      2023 Annual Research Report
  • [Presentation] "シングルステップフレネル回折とダウンサンプリングによる回折計算の高速化2023

    • Author(s)
      森和磨, 伊藤智義, 下馬場朋禄
    • Organizer
      情報フォトニクス研究会第18回関東学生研究論文講演会
    • Related Report
      2023 Annual Research Report
  • [Presentation] 深層学習を用いた2次元画像からのホログラム生成 Instant-NeRFと3D Gaussian Splattingの比較2023

    • Author(s)
      熊野開, 姜旻成, 王帆, 伊藤智義, 下馬場朋禄
    • Organizer
      情報フォトニクス研究会第18回関東学生研究論文講演会
    • Related Report
      2023 Annual Research Report
  • [Presentation] 拡散モデルを用いたホログラムのセグメンテーション2023

    • Author(s)
      山澤優, 伊藤智義, 下馬場朋禄
    • Organizer
      情報フォトニクス研究会第18回関東学生研究論文講演会
    • Related Report
      2023 Annual Research Report
  • [Presentation] Evaluation of the generalization ability of the deep neural network inferring from low to high-precision hologram2022

    • Author(s)
      Harutaka Shiomi, Tomoyoshi Shimobaba, Takashi Kakue, Tomoyoshi Ito
    • Organizer
      The 12th Korea-Japan Workshop on Digital Holography and Information Photonics (DHIP2022)
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Hilbert transform-like hologram calculation via deep learning2022

    • Author(s)
      Tomoyoshi Shimobaba, Takuya Hirahara, Harutaka Shiomi, David Blinder, Tobias Birnbaum, Fan Wang, Takashi Kakue, Peter Schelkens, Tomoyoshi Ito
    • Organizer
      3DSA2022
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Strategies for the next generation of special-purpose computers for holography2022

    • Author(s)
      Tomoyoshi Shimobaba, Takayuki Takahashi, Ikuo Hoshi, Fan Wang, Harutaka Shiomi, Takayuki Hara, Takashi Nishitsuji, Takashi Kakue, Atsushi Shiraki, Tomoyoshi Ito
    • Organizer
      SPIE/Photonics Asia 108: PA 109: Holography, Diffractive Optics and Applications XII
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Overview of recent hologram computation algorithm2022

    • Author(s)
      Tomoyoshi Shimobaba, Tomoyoshi Ito
    • Organizer
      The 13th International Conference on Information Optics and Photonics (CIOP2022)
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Holographic projection using phase-only spatial light modulators2022

    • Author(s)
      Tomoyoshi Shimobaba, Michal Makowski, Takashi Kakue and Tomoyoshi Ito
    • Organizer
      ISOM2022
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Numerical investigation of fast layer hologram calculation with compressing layer images and point spread functions2022

    • Author(s)
      Harutaka Shiomi, Tomoyoshi Shimobaba, Takashi Kakue, Tomoyoshi Ito
    • Organizer
      DH2022
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 低精度ホログラムから高精度ホログラムを推論する深層学習ネットワークとその小型化2022

    • Author(s)
      塩見日隆, 下馬場朋禄, 角江崇, 伊藤智義
    • Organizer
      レーザー学会
    • Related Report
      2022 Annual Research Report
  • [Presentation] 深層学習を用いたホログラム計算のポストプロセッシング2022

    • Author(s)
      下馬場朋禄, 塩見日隆, 平原拓弥, 王帆, 原貴之, Yogi Udjaja, 西辻崇, 白木厚司, 角江崇, 伊藤智義
    • Organizer
      令和4年第4回ホログラフィック・ディスプレイ研究会
    • Related Report
      2022 Annual Research Report
    • Invited
  • [Presentation] 拡散素子を用いた電子ホログラフィの簡易な視野・視域拡大手法2022

    • Author(s)
      藤森颯真, 下馬場朋禄, 角江崇, 伊藤智義
    • Organizer
      日本光学会年次学術講演会(OPJ2022)
    • Related Report
      2022 Annual Research Report
  • [Presentation] 多項式近似を用いたホログラムにおける多重像除去2022

    • Author(s)
      塩見日隆, 下馬場朋禄, 角江崇, 伊藤 智義
    • Organizer
      令和4年第3回ホログラフィック・ディスプレイ研究会
    • Related Report
      2022 Annual Research Report
  • [Presentation] 勾配降下法を用いた物体面およびホログラム面の位相分布最適化2022

    • Author(s)
      姜旻成, 下馬場朋禄, 角江崇, 伊藤智義
    • Organizer
      3次元画像コンファレンス2022
    • Related Report
      2022 Annual Research Report
  • [Presentation] 深層学習を用いたPhase-Added Stereogramの画質改善2022

    • Author(s)
      馬場真広, 下馬場朋禄, 角江崇, 伊藤智義
    • Organizer
      3次元画像コンファレンス2022
    • Related Report
      2022 Annual Research Report
  • [Presentation] レイヤ画像と点拡がり関数のウェーブレット圧縮 によるホログラム高速計算2022

    • Author(s)
      塩見日隆, 下馬場朋禄, 角江崇, 伊藤智義
    • Organizer
      3次元画像コンファレンス2022
    • Related Report
      2022 Annual Research Report
  • [Book] Hardware Acceleration of Computational Holograp2023

    • Author(s)
      Tomoyoshi Shimobaba, Topmoyoshi Ito
    • Total Pages
      300
    • Publisher
      Springer
    • Related Report
      2023 Annual Research Report

URL: 

Published: 2022-04-19   Modified: 2024-12-25  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi