• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

深層学習と圧縮センシングを融合した革新的超低消費電力イメージングシステムの実現

Research Project

Project/Area Number 22K12101
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Review Section Basic Section 61010:Perceptual information processing-related
Research InstitutionHosei University

Principal Investigator

周 金佳  法政大学, 理工学部, 准教授 (50723392)

Co-Investigator(Kenkyū-buntansha) 谷口 一徹  大阪大学, 大学院情報科学研究科, 准教授 (40551453)
Project Period (FY) 2022-04-01 – 2025-03-31
Project Status Granted (Fiscal Year 2023)
Budget Amount *help
¥4,160,000 (Direct Cost: ¥3,200,000、Indirect Cost: ¥960,000)
Fiscal Year 2024: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Fiscal Year 2023: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Fiscal Year 2022: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
KeywordsImage sensing / Deep learning / Compressive sensing
Outline of Research at the Start

This research proposes a new optical coding with AI based measurement coding and smart sparse recovery system that can greatly reduce the sensing power and compression power at the same time. It is the first time to design a sensing pattern that can efficiently compress the signal during sensing.

Outline of Annual Research Achievements

The following tasks have been completed. (1) On the encoder side, building upon the adaptive sensing technique developed last year, we further optimized it and applied an edge detection-based and region-of-interest detection based adaptive sensing framework to enhance the quality of the reconstructed videos. (2) On the decoder side, we proposed an adaptive stage-activated unfolding network to adaptively control the complexity of reconstruction. (3) We optimized the entire system at the system level to realize a computer vision-oriented compressive sensing system. (4) To reduce the power consumption of the whole system, we proposed a framework for partial pre-calculation-based image encoding and decoding.

Current Status of Research Progress
Current Status of Research Progress

2: Research has progressed on the whole more than it was originally planned.

Reason

As planned, the adaptive sampling algorithms based on key information extraction achieved excellent results in reducing computational complexity and improving the quality of reconstructed images/videos. Furthermore, the system-level optimization also yielded positive outcomes. We will continue to improve the performance of the whole system.

Strategy for Future Research Activity

This project is divided into three main tasks, each building upon the progress made in the previous stages. The first task of developing measurement coding system at the encoder side has already been successfully completed. In the second task, we focused on extracting moving objects, edge information and region-of-interest as key information during the FY2022 and FY2023. Our plan in FY2024 is to refine and enhance the key information extraction algorithms, incorporating new techniques to effectively selecting the sampling ratio while maintaining video quality. Additionally, we aim to optimize the entire system for reducing the power consumption.

Report

(2 results)
  • 2023 Research-status Report
  • 2022 Research-status Report
  • Research Products

    (9 results)

All 2024 2023 Other

All Int'l Joint Research (2 results) Journal Article (3 results) (of which Int'l Joint Research: 1 results,  Peer Reviewed: 3 results,  Open Access: 1 results) Presentation (4 results) (of which Int'l Joint Research: 4 results)

  • [Int'l Joint Research] Fudan University(中国)

    • Related Report
      2023 Research-status Report
  • [Int'l Joint Research] Fudan University(中国)

    • Related Report
      2022 Research-status Report
  • [Journal Article] Compressive Sensing Based Image Codec With Partial Pre-Calculation2024

    • Author(s)
      Xu Jiayao、Yang Jian、Kimishima Fuma、Taniguchi Ittetsu、Zhou Jinjia
    • Journal Title

      IEEE Transactions on Multimedia

      Volume: 26 Pages: 4871-4883

    • DOI

      10.1109/tmm.2023.3327534

    • Related Report
      2023 Research-status Report
    • Peer Reviewed
  • [Journal Article] aVCSR: Adaptive Video Compressive Sensing Using Region-of-Interest Detection in the Compressed Domain2024

    • Author(s)
      Yang Jian、Wang Haixin、Taniguchi Ittetsu、Fan Yibo、Zhou Jinjia
    • Journal Title

      IEEE MultiMedia

      Volume: 31 Issue: 1 Pages: 19-32

    • DOI

      10.1109/mmul.2023.3342062

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Compressive Sensing in Image/Video Compression: Sampling, Coding, Reconstruction, and Codec Optimization2024

    • Author(s)
      Zhou Jinjia、Yang Jian
    • Journal Title

      Information

      Volume: 15 Issue: 2 Pages: 75-75

    • DOI

      10.3390/info15020075

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Open Access
  • [Presentation] Block based Adaptive Compressive Sensing with Sampling Rate Control2023

    • Author(s)
      Kosuke Iwama, Ryugo Morita, Jinjia Zhou
    • Organizer
      ACM Multimedia Asia 2023
    • Related Report
      2023 Research-status Report
    • Int'l Joint Research
  • [Presentation] Adaptive Sampling for Computer Vision-Oriented Compressive Sensing2023

    • Author(s)
      Luyang Liu, Hiroki Nishikawa, Jinjia Zhou, Ittetsu Taniguchi, Takao Onoye
    • Organizer
      ACM Multimedia Asia 2023
    • Related Report
      2023 Research-status Report
    • Int'l Joint Research
  • [Presentation] VCSL: Video Compressive Sensing with Low-complexity ROI Detection in Compressed Domain2023

    • Author(s)
      Jian Yang, Haixin Wang, Yibo Fan, and Jinjia Zhou
    • Organizer
      2023 Data Compression Conference (DCC)
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] Zigzag Ordered Walsh Matrix for Compressed Sensing Image Sensor2023

    • Author(s)
      Jinyao Zhou, Jiayao Xu, Jirayu Peetakul, Jinjia Zhou
    • Organizer
      2023 Data Compression Conference (DCC)
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research

URL: 

Published: 2022-04-19   Modified: 2024-12-25  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi