| 研究課題/領域番号 |
17K00326
|
|---|
| 研究機関 | 国立研究開発法人理化学研究所 |
|---|
研究代表者 |
ZHAO QIBIN 国立研究開発法人理化学研究所, 革新知能統合研究センター, ユニットリーダー (30599618)
|
|---|
| 研究分担者 |
曹 建庭 埼玉工業大学, 工学部, 教授 (20306989)
|
|---|
| 研究期間 (年度) |
2017-04-01 – 2020-03-31
|
| キーワード | Tensor ring / Deep multi-task learning |
|---|
| 研究実績の概要 |
We studied multi-task deep learning models by using high-order tensor network technology. The existing multi-task deep learning models mostly based on sharing the lower layers and having individual upper layers for each task. The problem is that such framework cannot handle the case when different tasks have different input dimensions and when different tasks have heterogenous network architecture. To solve this challenging problem, we proposed a new framework, which allows us to use heterogenous network architecture for individual tasks, by leveraging tensor ring representation of weight parameters of each layer and some of latent core tensors sharing between tasks. The experiments demonstrated that our method is more flexible with high performance.
We studied tensor ring decomposition for data completion and developed several different methods to reconstruct the original tensor. The results show that tensor ring model is more powerful than traditional tensor decomposition models. We also give the theoretical support for our proposed methods.
We propose a new type of tensor decomposition to find the latent low-rank tensors under reshuffling operations. This is quite useful for image steganography. And the theoretical analysis shows the uniqueness condition of our new algorithm.
|
| 現在までの達成度 (区分) |
現在までの達成度 (区分)
2: おおむね順調に進展している
理由
The project is performing smoothly.
|
| 今後の研究の推進方策 |
In this fiscal year, we plan to conduct following two research works.
1. The current CNN for 3D data like video clip needs computation cost that is exponentially with dimension of data, which is a challenging problem if the data is higher dimensions much larger than 3. We attempt to solve this problem by using tensor network representation to improve the computation cost to be linear with the dimension of data.
2. We will also study how to learning an optimal tensor network structure from given data. This is an open problem in tensor research field.
|
| 次年度使用額が生じた理由 |
The conference paper accepted in 2018 will be held in 2019.
|
