• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Data-driven Filter Design and Implementation for Snapshot Hyperspectral Imaging

Research Project

Project/Area Number 19K20307
Research Category

Grant-in-Aid for Early-Career Scientists

Allocation TypeMulti-year Fund
Review Section Basic Section 61010:Perceptual information processing-related
Research InstitutionNational Institute of Informatics

Principal Investigator

ZHENG YINQIANG  国立情報学研究所, コンテンツ科学研究系, 准教授 (30756896)

Project Period (FY) 2019-04-01 – 2021-03-31
Project Status Completed (Fiscal Year 2020)
Budget Amount *help
¥4,160,000 (Direct Cost: ¥3,200,000、Indirect Cost: ¥960,000)
Fiscal Year 2020: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Fiscal Year 2019: ¥2,730,000 (Direct Cost: ¥2,100,000、Indirect Cost: ¥630,000)
KeywordsSpectral Imaging / Deep Learning / Filter Selection / Filter Design / spectral imaging / filter design / deep learning
Outline of Research at the Start

Existing multi-channel devices, such as the widespread three-channel RGB cameras, are not necessarily optimal for hyperspectral reconstruction. This research proposal aims to optimize the filter response for multispectral-to-hyperspectral reconstruction using deep neural networks.

Outline of Final Research Achievements

The research purpose of this project is to find the best spectral response functions for accurate multispectral-to-hyperspectral reconstruction using deep neural networks, and when necessary, implement the deeply learned filters by using film manufacturing technologies. We have tried to indentify the best camera spectral response curves from a given camera database, and design the optimal IR-cut filter for RGB-based spectral reconstruction. We have also examined fusion based spectral reconstruction, and found the best camera spectral response curves. Finally, we have gone beyond spectral reconstruction and examined the effect of spectral response fuctions for high-level task of scene classification.

Academic Significance and Societal Importance of the Research Achievements

深層学習を用いてイメージングハードウェアの最適化はとても挑戦的な研究課題です。本研究では、カメラの感度曲線の最適化方法を開発する上、スペクトル再構成の精度を向上させた。更に、製造上の拘束も考慮したので、アルゴリズムによる設計結果はフィルターで忠実に実装が可能であることも示した。

Report

(3 results)
  • 2020 Annual Research Report   Final Research Report ( PDF )
  • 2019 Research-status Report
  • Research Products

    (10 results)

All 2021 2020 2019 Other

All Int'l Joint Research (2 results) Journal Article (4 results) (of which Int'l Joint Research: 3 results,  Peer Reviewed: 4 results,  Open Access: 2 results) Presentation (4 results) (of which Int'l Joint Research: 4 results,  Invited: 1 results)

  • [Int'l Joint Research] University of Southern California(米国)

    • Related Report
      2020 Annual Research Report
  • [Int'l Joint Research] Shanghai Jiao Tong University/Anhui Normal University/Beijing Institute of Technology(中国)

    • Related Report
      2020 Annual Research Report
  • [Journal Article] Deep Unsupervised Fusion Learning for Hyperspectral Image Super Resolution2021

    • Author(s)
      Liu Zhe、Zheng Yinqiang、Han Xian-Hua
    • Journal Title

      Sensors

      Volume: 21 Issue: 7 Pages: 2348-2348

    • DOI

      10.3390/s21072348

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Joint Camera Spectral Response Selection and Hyperspectral Image Recovery2020

    • Author(s)
      Fu Ying、Zhang Tao、Zheng Yinqiang、Zhang Debing、Huang Hua
    • Journal Title

      IEEE Transactions on Pattern Analysis and Machine Intelligence

      Volume: na. Issue: 1 Pages: 256-272

    • DOI

      10.1109/tpami.2020.3009999

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] CSR-Net: Camera Spectral Response Network for Dimensionality Reduction and Classification in Hyperspectral Imagery2020

    • Author(s)
      Zou Yunhao、Fu Ying、Zheng Yinqiang、Li Wei
    • Journal Title

      Remote Sensing

      Volume: 12 Issue: 20 Pages: 3294-3294

    • DOI

      10.3390/rs12203294

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Hyperspectral Reconstruction with Redundant Camera Spectral Sensitivity Functions2020

    • Author(s)
      Xian-Hua Han, Yinqiang Zheng, Jiande Sun, Yen-Wei Chen
    • Journal Title

      ACM Transactions on Multimedia Computing, Communications, and Applications

      Volume: 16 Issue: 2 Pages: 1-15

    • DOI

      10.1145/3386313

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Presentation] Turning the IR-Cut Filter for Illumination-aware Spectral Reconstruction from RGB2021

    • Author(s)
      Bo Sun, Junchi Yan, Xiao Zhou, Yinqiang Zheng
    • Organizer
      IEEE Conference on Computer Vision and Pattern Recognition
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Unsupervised Multispectral and Hyperspectral Image Fusion with Deep Spatial and Spectral Priors2020

    • Author(s)
      Zhe Liu, Yinqiang Zheng, Xian-Hua Han
    • Organizer
      The Third Workshop on Machine Learning and Computing for Visual Semantic Analysis
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Hyperspectral Image Super-Resolution With Optimized RGB Guidance2019

    • Author(s)
      Ying Fu, Tao Zhang, Yinqiang Zheng, Debing Zhang, Hua Huang
    • Organizer
      IEEE Conference on Computer Vision and Pattern Recognition
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Multi-Level and Multi-Scale Spatial and Spectral Fusion CNN for Hyperspectral Image Super-Resolution2019

    • Author(s)
      Xian-Hua Han, Yinqiang Zheng, Yen-Wei Chen
    • Organizer
      IEEE International Conference on Computer Vision Workshop
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research

URL: 

Published: 2019-04-18   Modified: 2022-01-27  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi