| 研究課題/領域番号 |
23K16861
|
|---|
| 研究種目 |
若手研究
|
| 配分区分 | 基金 |
|---|
| 審査区分 |
小区分60040:計算機システム関連
|
|---|
| 研究機関 | 横浜国立大学 |
|---|
研究代表者 |
孫 鶴鳴 横浜国立大学, 大学院工学研究院, 准教授 (90835886)
|
|---|
| 研究期間 (年度) |
2023-04-01 – 2026-03-31
|
| 研究課題ステータス |
交付 (2023年度)
|
| 配分額 *注記 |
4,680千円 (直接経費: 3,600千円、間接経費: 1,080千円)
2025年度: 650千円 (直接経費: 500千円、間接経費: 150千円)
2024年度: 1,820千円 (直接経費: 1,400千円、間接経費: 420千円)
2023年度: 2,210千円 (直接経費: 1,700千円、間接経費: 510千円)
|
|---|
| キーワード | Image Compression / 画像圧縮 / 深層学習 |
|---|
| 研究開始時の研究の概要 |
Learned image compression (LIC) has shown a superior coding ability than the traditional image compression standards. However, current LIC is still not practical due to several problems. This research aims at a practical LIC system by the co-development of both algorithm and architecture.
|
| 研究実績の概要 |
This year, I mainly worked on two topics. First is the algorithm-architecture co-optimization of learned image compression (LIC) on FPGA. Based on a pipelined architecture, the input and output channel parallelism is restricted to ease the routing phase, so that more DSP can be used. After that, the neural network channel is searched to improve the DSP efficiency. With high DSP utilization and efficiency, compared with the recent work, the throughput can be improved by at most 1.5x. Besides, the compression efficiency will not be affected after the neural network search.
Second is the privacy of LIC for machine. The overall framework includes the client side which captures image and the cloud side which conducts the machine vision. To avoid the privacy leakage in the cloud side, feature of captured image is generated at the client side, coded by an LIC autoencoder and sent to the cloud side. The cloud side then decodes the feature and performs the machine vision based on the decoded feature. By optimizing the layer number of feature, we can not only reach a good trade-off between rate for the feature transmission and accuracy for the machine vision, but also avoid leaking the privacy information in the cloud.
|
| 現在までの達成度 (区分) |
現在までの達成度 (区分)
2: おおむね順調に進展している
理由
This year, I have presented one domestic conference at IPSJ. In addition, one paper at IEEE international conference ISCAS and one paper at IEEE Journal on Emerging and Selected Topics in Circuits and Systems have been accepted. The domestic conference and journal paper are about the algorithm-architecture co-optimization of LIC. ISCAS paper is about the privacy of LIC on the usage of machine vision.
Therefore, the research is undergoing well as scheduled.
|
| 今後の研究の推進方策 |
There are two plans. First is to realize the variable bitrate (VBR). Currently, multiple LIC models are required to support VBR, which is very memory consuming. To solve this problem, the most efficient way is to add a gain unit which is learnable through the training. However, adding the gain unit cannot realize an effective result on the high bitrate. To solve this problem, we plan to add the gain unit not only in the bottleneck layer, but also in the intermediate layers. Second is to improve the robustness of LIC network. Since the attacker can use FGSM to generate the adversarial samples. The bit consumption will become larger or the reconstruction quality will become worse. To solve this problem, we plan to use adversarial training to include the adversarial samples in the training.
|
