Development of computational ultra-fast compound-eye image sensor and its applications to range imaging and laser processing monitoring

• Project/Area Number: 15H03989
• Research Category: Grant-in-Aid for Scientific Research (B)
• Allocation Type: Single-year Grants
• Section: 一般
• Research Field: Electron device/Electronic equipment
• Research Institution: Shizuoka University
• Principal Investigator: Kagawa Keiichiro 静岡大学, 電子工学研究所, 准教授 (30335484)
• Co-Investigator(Kenkyū-buntansha): 沖原 伸一朗 光産業創成大学院大学, その他の研究科, 准教授 (50410535) ; 宮崎 大介 大阪市立大学, 大学院工学研究科, 准教授 (60264800)
• Project Period (FY): 2015-04-01 – 2018-03-31
• Project Status: Completed (Fiscal Year 2017)
• Budget Amount: ¥16,770,000 (Direct Cost: ¥12,900,000、Indirect Cost: ¥3,870,000); Fiscal Year 2017: ¥3,640,000 (Direct Cost: ¥2,800,000、Indirect Cost: ¥840,000); Fiscal Year 2016: ¥5,980,000 (Direct Cost: ¥4,600,000、Indirect Cost: ¥1,380,000); Fiscal Year 2015: ¥7,150,000 (Direct Cost: ¥5,500,000、Indirect Cost: ¥1,650,000)
• Keywords: 超高速カメラ / CMOSイメージセンサ / コンピュテーショナルイメージング / レーザー加工 / 光飛行時間距離画像計測 / イメージセンサ / 距離画像計測 / 光飛行時間 / 光加工 / 圧縮センシング

Outline of Final Research Achievements

A dedicated CMOS image sensor which films phenomena with a 1-ns time resolution in cooperation with optics and signal processing. With a multi-aperture-based ultra-fast image sensor, separation of surface reflection in time-of-flight range imaging and single-shot filming of a plasma generated in laser processing were demonstrated. A focal-plane-multi-aperture ultra-fast CMOS image sensor with a 1-ns time resolution was designed and fabricated. Operation of the timing generator was verified.

Research Products

• [Journal Article] Separation of multi-path components in sweep-less time-of-flight depth imaging with a temporally-compressive multi-aperture image sensor (2018)
  • Author(s): F. Mochizuki, K. Kagawa, R. Miyagi, M-W. Seo, B. Zhang, T. Takasawa, K. Yasutomi, and S. Kawahito
  • Journal Title: ITE Trans. on MTA Volume: -
  • Peer Reviewed / Open Access
• [Journal Article] [Paper] Time-of-flight Range Image Sensor Based on Exposure Coding with a Multi-aperture Imaging System (2016)
  • Author(s): K. Moriguchi, D. Miyazaki, T. Mukai, F. Mochizuki, K. Kagawa, S. Kawahito
  • Journal Title: ITE Transactions on Media Technology and Applications Volume: 4 Issue: 1 Pages: 78-83
  • DOI: 10.3169/mta.4.78
  • NAID: 130005117877
  • ISSN: 2186-7364
  • Peer Reviewed / Open Access
• [Journal Article] [Paper] Regionally Adaptive Enhancement of Frame Rate and Resolution with a Multi-aperture Image Capturing System Using Rolling Shutter Effect (2015)
  • Author(s): D. Miyazaki, T. Ebata, K. Moriguchi and T. Mukai
  • Journal Title: ITE Transactions on Media Technology and Applications Volume: 3 Issue: 4 Pages: 240-244
  • DOI: 10.3169/mta.3.240
  • NAID: 130005102470
  • ISSN: 2186-7364
  • Peer Reviewed / Open Access
• [Presentation] Gfps領域を目指す画素内時間圧縮型超高速コンピュテーショナルCMOSイメージセンサ (2018)
  • Author(s): 望月風太, 香川景一郎, 沖原伸一郎, 徐珉雄, 張博, 高澤大志, 安富啓太, 川人祥二
  • Organizer: 第12回計算オプティクス研究会
• [Presentation] ０億枚毎秒を目指す像面マルチアパーチャ方式時間圧縮型CMOSイメージセンサの開発 (2017)
  • Author(s): 佐藤祐人, 望月風太, 香川景一郎, ソ ミン ウン, 高澤大志, 安富啓太, 川人祥
  • Organizer: 映像情報メディア学会 情報センシング研究会
• [Presentation] 光学・デバイス・信号処理の融合による画素内圧縮型超高速CMOSイメージセンサ (2017)
  • Author(s): 望月風太, 香川景一郎, 沖原伸一朗, ソミンウン, 高澤大志, 安富啓太
  • Organizer: 第18回情報フォトニクス研究グループ研究会
  • Invited
• [Presentation] High-frame-rate image capturing for time-of-flight range imager based on exposure coding with a multi-aperture imaging system (2017)
  • Author(s): D. Miyazaki, T. Ebata, K. Arimori, F. Mochizuki, K. Kagawa, S. Kawahit
  • Organizer: 日本光学会年次学術講演会
• [Presentation] 超高速マルチアパーチャCMOSイメージセンサを用いた圧縮型光飛行時間距離画像撮影 (2017)
  • Author(s): 望月 風太, 宮城 亮太, 香川 景一郎, 高澤 大志, 安富 啓太 , ソ ミン ウン, 川人 祥二
  • Organizer: 日本光学会年次学術講演会
• [Presentation] Single-shot/repetitive 200Mfps compressive CMOS image sensor (2016)
  • Author(s): F. Mochizuki, K. Kagawa, S. Okihara, M-W. Seo, B. Zhang, T. Takasawa, K. Yasutomi, S. Kawahito
  • Organizer: The 31st International Congress on High-Speed Imaging and Photonics
  • Place of Presentation: Hotel Hankyu Expo Park (Suita, Japan)
  • Year and Date: 2016-11-07
  • Int'l Joint Research / Invited
• [Presentation] 像面マルチアパーチャ方式画素内圧縮型超高速CMOS イメージセンサにおける圧縮率の評価 (2016)
  • Author(s): 望月 風太, 佐藤 祐人, 香川 景一郎, ソ ミンウン, 高澤 大志, 安富 啓太, 川人 祥二
  • Organizer: Optics ＆ Photonics Japan 2016
  • Place of Presentation: 筑波大学東京キャンパス文京校舎 (東京都文京区)
  • Year and Date: 2016-10-30
• [Presentation] Enhancement of temporal resolution by a compound-eye image capturing system with a rolling shutter image sensor (2016)
  • Author(s): D. Miyazaki,T. Ebata, K. Wakabayashi,T. Muka
  • Organizer: OSJ - OSA Joint Symposia
  • Place of Presentation: Tokyo Bunkyo School Building , University of Tsukuba (Tokyo, Japan)
  • Year and Date: 2016-10-30
  • Int'l Joint Research
• [Presentation] 10 億枚/秒以上を目指す超高速時間圧縮CMOSイメージセン (2016)
  • Author(s): 佐藤祐人, 香川景一郎
  • Organizer: VDECデザイナーズフォーラム2016
  • Place of Presentation: 東京大学武田先端知ビル (東京都文京区)
  • Year and Date: 2016-08-25
• [Presentation] 像面マルチアパーチャ方式画素内圧縮型超高速CMOSイメージセンサの提案 (2016)
  • Author(s): 望月風太，佐藤祐人，香川景一郎，ソ ミンウン，高澤大志，安富啓太，川人祥二
  • Organizer: LSIとシステムのワークショップ2016
  • Place of Presentation: 東京大学 生産技術研究所 (東京都目黒区)
  • Year and Date: 2016-05-16
• [Presentation] Multi-aperture ultra-high-speed imaging with lateral electric field charge modulator, (2016)
  • Author(s): K. Kagawa, F. Mochizuki, M. W, Seo, K. Yasutomi, and S. Kawahito
  • Organizer: Photonics West 2016
  • Place of Presentation: The Moscone Center (San Francisco, USA)
  • Year and Date: 2016-02-13
  • Int'l Joint Research / Invited
• [Presentation] 光学系・イメージセンサ・処理を融合した超高速撮像 (2015)
  • Author(s): 香川景一郎, 望月風太, 徐珉雄, 安富啓太, 川人祥二
  • Organizer: 高速度イメージングとフォトニクスに関する総合シンポジウム2015
  • Place of Presentation: いわて県民情報交流センター アイーナ(岩手県盛岡市)
  • Year and Date: 2015-11-05
  • Invited
• [Presentation] Computational 200Mfps ultra-high-speed image sensor based on multi-aperture optics (2015)
  • Author(s): F. Mochizuki, K. Kagawa, S. Okihara, M. W, Seo, B. Zhang, T. Takasawa, K. Yasutomi, and S. Kawahito
  • Organizer: Int’l conf. on Advance Tech. in Experimental Mechanics 2015
  • Place of Presentation: LOISIR HOTEL TOYOHASHI (Toyohashi, Japan)
  • Year and Date: 2015-10-04
  • Int'l Joint Research
• [Presentation] High-frame-rate image capturing based on temporal encoding and multi-aperture imaging system (2015)
  • Author(s): D. Miyazaki
  • Organizer: 5th Korea-Japan Workshop on Digital Holography and Information Photonics
  • Place of Presentation: KIST (Gangneung, Korea)
  • Year and Date: 2015-09-17
  • Int'l Joint Research
• [Presentation] A multi-aperture compressive time-of-flight CMOS imager for pixel-wise coarse histogram acquisition (2015)
  • Author(s): F. Mochizuki, K. Kagawa, M. W, Seo, T. Takasawa, K. Yasutomi, S. Kawahito
  • Organizer: 2015 Int’l Image Sensor Workshop
  • Place of Presentation: Castle Vaalsbroek (Vaals, The Netherland)
  • Year and Date: 2015-06-08
  • Int'l Joint Research