• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Highly sensitive hyper spectral imaging by sensor fusion and numerically resolved cross-talks

Research Project

Project/Area Number 16K12457
Research Category

Grant-in-Aid for Challenging Exploratory Research

Allocation TypeMulti-year Fund
Research Field Perceptual information processing
Research InstitutionTokyo Institute of Technology

Principal Investigator

Kumazawa Itsuo  東京工業大学, 科学技術創成研究院, 教授 (70186469)

Project Period (FY) 2016-04-01 – 2019-03-31
Project Status Completed (Fiscal Year 2018)
Budget Amount *help
¥3,510,000 (Direct Cost: ¥2,700,000、Indirect Cost: ¥810,000)
Fiscal Year 2017: ¥1,690,000 (Direct Cost: ¥1,300,000、Indirect Cost: ¥390,000)
Fiscal Year 2016: ¥1,820,000 (Direct Cost: ¥1,400,000、Indirect Cost: ¥420,000)
Keywordsマルチスペクトルカメラ / ハイパースペクトル / ディープラーニング / 逆問題 / マイクロプリズムアレイ / センサー融合 / マルチスペクトル画像センサ / クロストーク除去 / 凸射影法 / 不良設定問題 / 幾何光学的校正 / センサ融合 / デコンボリューション / 分光
Outline of Final Research Achievements

Traditional multi-spectrum cameras have been trying to use sophisticated optical systems to resolve spectrum bands. In this study, we used a very simple optical system and tried to resolve the cross-talks among spectrum bands and pixels resulting from such a simple optical system by numerical processing of the images. For this purpose, we developed a sensor fusion system using a mono-chrome camera with a micro-prism-array and a standard color camera. And as the numerical processing to resolve cross-talk, we developed convex-projection-based optimization techniques and deep neural networks (U-net).
,

Academic Significance and Societal Importance of the Research Achievements

近年工場自動化の製品検査工程、植物工場における植物の生育状態診断、医療画像診断、航空機やドローンによる農場や植生の監視等、様々な場面でマルチスペクトルカメラが重要な役割を果たすようになった。しかしながら現状のマルチスペクトルカメラは高度な光学系を使用しているため高価で重く、一度に計測できるのが線上の範囲となるため二次元の画像の計測に時間を要することが、利用上の制約になっていた。本課題では、光学系を画期的に簡単化してコストを下げ、軽く、二次元の画像を短時間に計測できるようにし、光学系が単純なために生じる低下する画質を高度な数値処理やディープラーニングで改善する技術を開発する。

Report

(4 results)
  • 2018 Annual Research Report   Final Research Report ( PDF )
  • 2017 Research-status Report
  • 2016 Research-status Report
  • Research Products

    (17 results)

All 2019 2018 2017 2016

All Journal Article (2 results) (of which Int'l Joint Research: 1 results,  Peer Reviewed: 2 results) Presentation (15 results) (of which Int'l Joint Research: 10 results)

  • [Journal Article] Robust and effective hyperspectral pansharpening using spatio-spectral total variation2018

    • Author(s)
      Saori Takeyama, Shunsuke Ono, Itsuo Kumazawa
    • Journal Title

      IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

      Volume: 1 Pages: 1603-1607

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Image Restoration with Multiple Hard Constraints on Data-Fidelity to Blurred/Noisy Image Pair2017

    • Author(s)
      武山 彩織 , 小野 峻佑 , 熊澤 逸夫
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E100.D Issue: 9 Pages: 1953-1961

    • DOI

      10.1587/transinf.2016PCP0003

    • NAID

      130006038514

    • ISSN
      0916-8532, 1745-1361
    • Related Report
      2017 Research-status Report
    • Peer Reviewed
  • [Presentation] ハイパースペクトルイメージングのための圧縮pansharpening の検討2019

    • Author(s)
      武山彩織 , 小野峻佑 , 熊澤逸夫
    • Organizer
      電子情報通信学会技術研究報告
    • Related Report
      2018 Annual Research Report
  • [Presentation] ガウシアンノイズを考慮した ハイパースペクトル画像とマルチスペクトル画像の合成法2018

    • Author(s)
      武山彩織 , 小野峻佑 , 熊澤逸夫
    • Organizer
      第33回信号処理シンポジウム予稿集
    • Related Report
      2018 Annual Research Report
  • [Presentation] Hyperspectral Pansharpening Using Noisy Panchromatic Image2018

    • Author(s)
      Saori Takeyama, Shunsuke Ono, Itsuo kumazawa
    • Organizer
      Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) 2018
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Hyperspectral Image Restoration and Pansharpening2018

    • Author(s)
      Saori Takeyama, Shunsuke Ono, Itsuo kumazawa
    • Organizer
      Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) 2018
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] ハイパースペクトル画像の混合ノイズ除去におけるパラメータ設定に関する検討2018

    • Author(s)
      武山彩織 , 小野峻佑 , 熊澤逸夫
    • Organizer
      2018年電子情報通信学会ソサイエティ大会予稿集
    • Related Report
      2018 Annual Research Report
  • [Presentation] Text Detection and Recognition on traffic panel in roadside imagery2017

    • Author(s)
      Sarwar Khan, Somying Thainimit, Sanparith Marukatat, Itsuo Kumazawa
    • Organizer
      The 8th International Conference on Information and Communication Technology for Embedded Systems
    • Place of Presentation
      Bangsaen Heritage Hotel, Chonburi Beach, THAILAND
    • Year and Date
      2017-05-07
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] RGB-D Classification using Feature Selection on the Combination of Different Features2017

    • Author(s)
      Wasif Khan, Ekachai Phaisangittisagul, Luqman Ali1c, Duangrat Gansawat, Itsuo Kumazawa
    • Organizer
      The 8th International Conference on Information and Communication Technology for Embedded Systems
    • Place of Presentation
      Bangsaen Heritage Hotel, Chonburi Beach, THAILAND
    • Year and Date
      2017-05-07
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] On the Multi-resolution Image Land Cover Mapping Using Deep Learning2017

    • Author(s)
      Watsana Bupphawat, Teerasit Kasetkasem, Preesan Rakwatin, Itsuo Kumazawa, Thitiporn Chanwimaluang
    • Organizer
      The 8th International Conference on Information and Communication Technology for Embedded Systems
    • Place of Presentation
      Bangsaen Heritage Hotel, Chonburi Beach, THAILAND
    • Year and Date
      2017-05-07
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] 空間-波長方向の正則化を用いたノイズにロバストなHyperspectral Pansharpning2017

    • Author(s)
      武山彩織 , 小野峻佑 , 熊澤逸夫
    • Organizer
      第32回信号処理シンポジウム予稿集
    • Related Report
      2017 Research-status Report
  • [Presentation] パンクロマティック画像に含まれるガウシアンノイズを考慮したhyperspectral pansharpeningに関する手法2017

    • Author(s)
      武山彩織 , 小野峻佑 , 熊澤逸夫
    • Organizer
      電子情報通信学会技術研究報告
    • Related Report
      2017 Research-status Report
  • [Presentation] ANN Approach for Predicting Economic Trends based on Electric Energy Consumption during Natural Disaster Period2017

    • Author(s)
      Akanit Kwangkaew , Virach Sornlertlamvanich , Itsuo Kumazawa , Siriya Skolthanarat
    • Organizer
      Proceedings of 11th International Conference on Knowledge, Information and Creativity Support Systems
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] On the Multi-resolution Image Land Cover Mapping Using Deep Learning2017

    • Author(s)
      Watsana Bupphawat , Teerasit Kasetkasem , Preesan Rakwatin , Itsuo Kumazawa , Thitiporn Chanwimaluang
    • Organizer
      The 8th International Conference on Information and Communication Technology for Embedded Systems
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] RGB-D Classification using Feature Selection on the Combination of Different Features2017

    • Author(s)
      Wasif Khan , Ekachai Phaisangittisagul , Luqman Ali1c , Duangrat Gansawat , Itsuo Kumazawa
    • Organizer
      The 8th International Conference on Information and Communication Technology for Embedded Systems
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Text Detection and Recognition on traffic panel in roadside imagery2017

    • Author(s)
      Sarwar Khan , Somying Thainimit , Sanparith Marukatat , Itsuo Kumazawa
    • Organizer
      The 8th International Conference on Information and Communication Technology for Embedded Systems
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] ANN Approach for Predicting Economic Trends based on Electric Energy Consumption during Natural Disaster Period2016

    • Author(s)
      Akanit Kwangkaew, Virach Sornlertlamvanich, Itsuo Kumazawa, and Siriya Skolthanarat
    • Organizer
      2016 11th International Conference on Knowledge, Information and Creativity Support Systems
    • Place of Presentation
      Yogyakarta Indonesia
    • Year and Date
      2016-11-10
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research

URL: 

Published: 2016-04-21   Modified: 2020-03-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi