• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

HDR video generation based on dynamic mode decomposition and its applications

Research Project

Project/Area Number 18K18073
Research Category

Grant-in-Aid for Early-Career Scientists

Allocation TypeMulti-year Fund
Review Section Basic Section 61010:Perceptual information processing-related
Research InstitutionThe University of Kitakyushu (2020-2021)
Kyushu Institute of Technology (2019)
Kagawa University (2018)

Principal Investigator

Matsuoka Ryo  北九州市立大学, 国際環境工学部, 准教授 (40780391)

Project Period (FY) 2018-04-01 – 2022-03-31
Project Status Completed (Fiscal Year 2021)
Budget Amount *help
¥4,160,000 (Direct Cost: ¥3,200,000、Indirect Cost: ¥960,000)
Fiscal Year 2020: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Fiscal Year 2019: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2018: ¥1,690,000 (Direct Cost: ¥1,300,000、Indirect Cost: ¥390,000)
Keywords高ダイナミックレンジ画像 / スパースコーディング / 画像復元 / 凸最適化 / 動的モード分解 / 動画像復元
Outline of Final Research Achievements

When taking a photograph in a high dynamic range (HDR) scene, the accuracy of object recognition is significantly degraded due to under/over-exposed pixels. This can be solved by using an HDR sensor that faithfully preserves the optical information of the scene, but it is very expensive. Therefore, image-blending-based HDR camera technology using a low dynamic range sensor is required. However, existing image blending techniques require huge computational costs and large computational resources, and many challenges remain for practical applications.
In this research project, we proposed an efficient and practical HDR video generation technique. In addition, we developed reconstruction algorithms based on sparse modeling to achieve high-quality HDR video restoration.

Academic Significance and Societal Importance of the Research Achievements

本研究の主要な成果は, 既存の画像統合型HDR動画像生成技術に比べて低計算量でかつ効率的なHDR動画像の復元が可能な手法であるため, 自動運転技術や監視カメラ技術の飛躍的な発展が期待できる. さらに, HDR動画像が重要な役割を果たす産業・サイエンス・工学の諸分野に大きく貢献するものである. また, 計算量の観点から実現が困難であった画期的な動画像処理応用を切り開き, 医療・農業・産業などの広範な分野に大きなインパクトを与えるものであると考えられる.

Report

(5 results)
  • 2021 Annual Research Report   Final Research Report ( PDF )
  • 2020 Research-status Report
  • 2019 Research-status Report
  • 2018 Research-status Report
  • Research Products

    (27 results)

All 2021 2020 2019 2018 Other

All Journal Article (5 results) (of which Peer Reviewed: 4 results,  Open Access: 5 results) Presentation (16 results) (of which Int'l Joint Research: 11 results,  Invited: 1 results) Remarks (6 results)

  • [Journal Article] 私のブックマーク:高ダイナミックレンジ画像処理2021

    • Author(s)
      松岡 諒
    • Journal Title

      Journal of the Japanese Society for Artificial Intelligence

      Volume: 36 Issue: 1 Pages: 90-96

    • DOI

      10.11517/jjsai.36.1_90

    • NAID

      130007965708

    • ISSN
      2188-2266, 2435-8614
    • Year and Date
      2021-01-01
    • Related Report
      2020 Research-status Report
    • Open Access
  • [Journal Article] TNNG: Total Nuclear Norms of Gradients for Hyperspectral Image Prior2021

    • Author(s)
      Yuzuriha Ryota、Kurihara Ryuji、Matsuoka Ryo、Okuda Masahiro
    • Journal Title

      Remote Sensing

      Volume: 13 Issue: 4 Pages: 819-819

    • DOI

      10.3390/rs13040819

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Reference-based local color distribution transformation method and its application to image integration2019

    • Author(s)
      Matsuoka Ryo、Shirai Keiichiro、Okuda Masahiro
    • Journal Title

      Signal Processing: Image Communication

      Volume: 76 Pages: 231-242

    • DOI

      10.1016/j.image.2019.04.020

    • Related Report
      2019 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Transformed-Domain Robust Multiple-Exposure Blending With Huber Loss2019

    • Author(s)
      Matsuoka Ryo、Ono Shunsuke、Okuda Masahiro
    • Journal Title

      IEEE Access

      Volume: 7 Pages: 162282-162296

    • DOI

      10.1109/access.2019.2951817

    • Related Report
      2019 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Joint Sparsity and Order Optimization Based on ADMM with Non-Uniform Group Hard Thresholding2018

    • Author(s)
      Ryo Matsuoka, Seisuke Kyochi, Shunsuke Ono, Masahiro Okuda
    • Journal Title

      IEEE Transactions on Circuits and Systems I: Regular Papers

      Volume: 65 Issue: 5 Pages: 1602-1613

    • DOI

      10.1109/tcsi.2017.2763969

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Open Access
  • [Presentation] 四方向差分型L0,1正則化によるJPEGノイズ除去に関する考察2021

    • Author(s)
      小林伊織、松岡諒
    • Organizer
      第34回回路とシステムワークショップ
    • Related Report
      2021 Annual Research Report
  • [Presentation] Total Nuclear Norms of Gradients for Hyperspectral Image Pansharpening2020

    • Author(s)
      Yuzuriha, Ryo Matsuoka, Masahiro Okuda
    • Organizer
      IEEE International Geoscience and Remote Sensing Symposium (IGARSS)
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] Constrained Design of Two-Dimensional FIR Filters with Sparse Coefficients2020

    • Author(s)
      Itsuki Itasaka, Ryo Matsuoka, Masahiro Okuda
    • Organizer
      Asia-Pacific Signal and Information Processing Association, Annual Summit and Conference (APSIPA ASC)
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] スパースな係数を持つ二次元FIRフィルタの制約付き設計2020

    • Author(s)
      板坂樹生, 松岡諒, 奥田正浩
    • Organizer
      電子情報通信学会 ソサイエティ大会
    • Related Report
      2020 Research-status Report
  • [Presentation] L0勾配正則化に基づく画像平滑化とその応用2020

    • Author(s)
      松岡諒
    • Organizer
      電子情報通信学会
    • Related Report
      2020 Research-status Report
    • Invited
  • [Presentation] 雨の軌跡除去を考慮した露光合成に関する考察2019

    • Author(s)
      赤井優志, 松岡諒, 和田紗月, 堀川洋
    • Organizer
      電子情報通信学会ソサイエティ大会
    • Related Report
      2019 Research-status Report
  • [Presentation] 勾配制約付き画像平滑化によるノイズを考慮したコントラスト強調に関する検討2019

    • Author(s)
      赤井優志, 松岡諒, 堀川洋, 奥田正浩
    • Organizer
      電子情報通信学会SIPシンポジウム
    • Related Report
      2019 Research-status Report
  • [Presentation] Multiscale Structure Tensor Total Variation for Image Recovery2019

    • Author(s)
      Multiscale Structure Tensor Total Variation for Image Recovery
    • Organizer
      IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Rain Streak Removal Using Under-/Over-Exposed Images2019

    • Author(s)
      Yuji Akai, Ryo Matsuoka, Satsuki Wada, Yo Horikawa
    • Organizer
      IEEE Global Conference on Consumer Electronics (GCCE)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Multiscale Structure Tensor Total Variation for Image Recovery2019

    • Author(s)
      Makoto Watanabe, Ryo Matsuoka, Shunsuke Ono, Masahiro Okuda
    • Organizer
      IEEE International Conference on Acoustics, Speech, and Signal Processing
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] 'High Dynamic Range Image Generation Based on Convolutional Weight Optimization Robust to Mixed Noise Removal2018

    • Author(s)
      Ryo Matsuoka, Shunsuke Ono, Masahiro Okuda
    • Organizer
      Asia-Pacific Signal and Information Processing Association, Annual Summit and Conference
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Reflection Removal Using RGB-D Images2018

    • Author(s)
      Toshihiro Shibata, Yuji Akai, Ryo Matsuoka
    • Organizer
      IEEE International Conference on Image Processing
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] L0 Smoothing Based on Gradient Constraints," IEEE International Conference on Image Processing2018

    • Author(s)
      Yuji Akai, Toshihiro Shibata, Ryo Matsuoka, Masahiro Okuda
    • Organizer
      IEEE International Conference on Image Processing
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Joint Sparsity and Order Optimization based on ADMM with Non-uniform Group Hard Thresholding2018

    • Author(s)
      Ryo Matsuoka, Seisuke Kyochi, Shunsuke Ono, Masahiro Okuda
    • Organizer
      IEEE International Symposium on Circuits and Systems
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] 深度マップを用いた映り込み除去に関する一検討2018

    • Author(s)
      柴田峻敬, 赤井優志, 松岡 諒
    • Organizer
      電子情報通信学会技術研究報告書
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] 勾配レンジ制約に基づくロバスト画像平滑化2018

    • Author(s)
      赤井優志, 柴田峻敬, 松岡 諒, 奥田正浩
    • Organizer
      電子情報通信学会技術研究報告書
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Remarks] 研究者HP

    • URL

      https://www.sites.google.com/site/phdmatsuokadx/home

    • Related Report
      2021 Annual Research Report
  • [Remarks] 業績紹介HP

    • URL

      https://sites.google.com/site/phdmatsuokadx/achievements

    • Related Report
      2021 Annual Research Report
  • [Remarks] [備考] 研究者HP

    • URL

      https://sites.google.com/site/phdmatsuokadx

    • Related Report
      2020 Research-status Report
  • [Remarks] [備考] 業績紹介HP(研究者作成)

    • URL

      https://sites.google.com/site/phdmatsuokadx/achievements

    • Related Report
      2020 Research-status Report
  • [Remarks] 研究者HP

    • URL

      https://sites.google.com/site/phdmatsuokadx

    • Related Report
      2019 Research-status Report 2018 Research-status Report
  • [Remarks] 業績紹介HP(研究者作成)

    • URL

      https://sites.google.com/site/phdmatsuokadx/achievements

    • Related Report
      2019 Research-status Report 2018 Research-status Report

URL: 

Published: 2018-04-23   Modified: 2023-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi