• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Rank estimation and optimization methods for tensor network decomposition, and its applications

Research Project

Project/Area Number 20H04208
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Review Section Basic Section 61010:Perceptual information processing-related
Research InstitutionNagoya Institute of Technology

Principal Investigator

Yokota Tatsuya  名古屋工業大学, 工学(系)研究科(研究院), 准教授 (80733964)

Co-Investigator(Kenkyū-buntansha) ZHAO QIBIN  国立研究開発法人理化学研究所, 革新知能統合研究センター, チームリーダー (30599618)
本谷 秀堅  名古屋工業大学, 工学(系)研究科(研究院), 教授 (60282688)
Project Period (FY) 2020-04-01 – 2023-03-31
Project Status Completed (Fiscal Year 2022)
Budget Amount *help
¥15,470,000 (Direct Cost: ¥11,900,000、Indirect Cost: ¥3,570,000)
Fiscal Year 2022: ¥3,640,000 (Direct Cost: ¥2,800,000、Indirect Cost: ¥840,000)
Fiscal Year 2021: ¥5,980,000 (Direct Cost: ¥4,600,000、Indirect Cost: ¥1,380,000)
Fiscal Year 2020: ¥5,850,000 (Direct Cost: ¥4,500,000、Indirect Cost: ¥1,350,000)
Keywordsテンソル分解 / テンソルネットワーク分解 / MMアルゴリズム / ランダム化特異値分解 / ランク推定 / 数理最適化 / ランダム化アルゴリズム / CP分解 / タッカー分解 / テンソルトレイン分解 / テンソルネットワーク / ベイズテンソル分解 / ランダム射影法 / スケッチ法 / サンプリング法 / 数値最適化 / 高速最適化
Outline of Research at the Start

高階な大規模テンソルデータを複数の低階な小規模潜在テンソルの組み合わせに分解するデータ表現法をテンソルネットワーク(TN)分解と呼ぶ.TN分解は大規模データを効率よく圧縮分散表現できる最先端のモデルである.
本研究では,TN分解をより実用的な技術として確立するため,高精度かつ高速なランク推定法の確立および省メモリかつ高速な最適化手法の確立を目指す.さらに,構築した理論基盤,アルゴリズム基盤を活かして信号復元やパターン認識などの応用展開について検討する.特に,テンソルデータ復元の問題において,テンソルデータの高階化,ランク推定,最適化,復元までの一貫した信号処理の枠組みを実現する.

Outline of Final Research Achievements

In this project, various researches were conducted such as rank estimation, fast algorithms, stable optimization for tensor network decompositions and their applications. For rank estimation, we investigated and developed several approaches based on the greedy method, the Bayesian method, and the singular value information. As for the fast algorithms, we investigated and developed algorithms using randomized SVD and fast Fourier transform. We also investigated and developed stable optimization using the MM algorithm. In addition, through activities such as invited talks, tutorial lectures, and contributions to chapters of books, we contributed to improve the theory of tensor decompositions.

Academic Significance and Societal Importance of the Research Achievements

テンソルネットワーク分解は信号処理,機械学習,パターン認識,物理シミュレーション,量子計算など幅広い学術分野と密接な関わりがある。本研究成果は,テンソルネットワーク分解における理論やアルゴリズム,方法論に関する基本的な部分に取り組んだものであるため,これらの幅広い分野に対して貢献できる可能性がある。特に,情報圧縮や高速処理の技術は,高度情報社会となった現代における記憶,通信,解析などのさまざまな目的において重要である。

Report

(4 results)
  • 2022 Annual Research Report   Final Research Report ( PDF )
  • 2021 Annual Research Report
  • 2020 Annual Research Report
  • Research Products

    (33 results)

All 2023 2022 2021 2020 Other

All Int'l Joint Research (5 results) Journal Article (4 results) (of which Int'l Joint Research: 4 results,  Peer Reviewed: 4 results,  Open Access: 3 results) Presentation (23 results) (of which Int'l Joint Research: 13 results,  Invited: 7 results) Book (1 results)

  • [Int'l Joint Research] CONICET(アルゼンチン)

    • Related Report
      2022 Annual Research Report
  • [Int'l Joint Research] Skoltech(ロシア連邦)

    • Related Report
      2021 Annual Research Report
  • [Int'l Joint Research] CONICET(アルゼンチン)

    • Related Report
      2021 Annual Research Report
  • [Int'l Joint Research] Skoltech(ロシア連邦)

    • Related Report
      2020 Annual Research Report
  • [Int'l Joint Research] Huawei(中国)

    • Related Report
      2020 Annual Research Report
  • [Journal Article] Bayesian Tensor Completion and Decomposition with Automatic CP Rank Determination Using MGP Shrinkage Prior2022

    • Author(s)
      Takayama Hiromu、Zhao Qibin、Hontani Hidekata、Yokota Tatsuya
    • Journal Title

      SN Computer Science

      Volume: 3 Issue: 3 Pages: 1-17

    • DOI

      10.1007/s42979-022-01119-8

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Manifold Modeling in Embedded Space: An Interpretable Alternative to Deep Image Prior2022

    • Author(s)
      Yokota Tatsuya、Hontani Hidekata、Zhao Qibin、Cichocki Andrzej
    • Journal Title

      IEEE Transactions on Neural Networks and Learning Systems

      Volume: 33 Issue: 3 Pages: 1022-1036

    • DOI

      10.1109/tnnls.2020.3037923

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Matrix and Tensor Completion in Multiway Delay Embedded Space Using Tensor Train, With Application to Signal Reconstruction2020

    • Author(s)
      Sedighin Farnaz、Cichocki Andrzej、Yokota Tatsuya、Shi Qiquan
    • Journal Title

      IEEE Signal Processing Letters

      Volume: 27 Pages: 810-814

    • DOI

      10.1109/lsp.2020.2990313

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Block Hankel Tensor ARIMA for Multiple Short Time Series Forecasting2020

    • Author(s)
      Shi Qiquan、Yin Jiaming、Cai Jiajun、Cichocki Andrzej、Yokota Tatsuya、Chen Lei、Yuan Mingxuan、Zeng Jia
    • Journal Title

      Proceedings of the AAAI Conference on Artificial Intelligence

      Volume: 34 Issue: 04 Pages: 5758-5766

    • DOI

      10.1609/aaai.v34i04.6032

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Presentation] 遅延埋め込み空間におけるテンソル分解と多様体学習2023

    • Author(s)
      横田達也
    • Organizer
      電子情報通信学会総合大会
    • Related Report
      2022 Annual Research Report
    • Invited
  • [Presentation] Memorization Weights for Instance Reweighting in Adversarial Training2023

    • Author(s)
      Jianfu Zhang, Yan Hong, and Qibin Zhao
    • Organizer
      AAAI
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Fast Algorithm for Low-rank Tensor Completion in Delay-embedded Space2022

    • Author(s)
      R. Yamamoto, H. Hontani, A. Imakura, and T. Yokota
    • Organizer
      CVPR
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Fast Signal Completion Algorithm With Cyclic Convolutional Smoothing2022

    • Author(s)
      H. Takayama, and T. Yokota
    • Organizer
      APSIPA-ASC
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Consistent MDT-Tucker: A Hankel Structure Constrained Tucker Decomposition in Delay Embedded Space2022

    • Author(s)
      R. Yamamoto, H. Hontani, A. Imakura, and T. Yokota
    • Organizer
      APSIPA-ASC
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] MGP縮退事前分布を用いたテンソル補完及びランク決定法2022

    • Author(s)
      高山拓夢,Qibin Zhao,本谷秀堅,横田達也
    • Organizer
      情報論的学習理論ワークショップ(IBIS2022)
    • Related Report
      2022 Annual Research Report
  • [Presentation] ランダム化アルゴリズムを用いたテンソル分解の高速化2022

    • Author(s)
      渡邉大樹,本谷秀堅,横田達也
    • Organizer
      信号処理シンポジウム
    • Related Report
      2022 Annual Research Report
  • [Presentation] テンソル分解の基礎と応用2022

    • Author(s)
      横田達也
    • Organizer
      MIRU2022
    • Related Report
      2022 Annual Research Report
    • Invited
  • [Presentation] テンソル分解のアルゴリズムとその応用2022

    • Author(s)
      横田達也
    • Organizer
      離散的手法による場と時空のダイナミクス2022
    • Related Report
      2022 Annual Research Report
    • Invited
  • [Presentation] Are we pruning the correct channels in image-to-image translation models2022

    • Author(s)
      Yiyong Li, Zhun Sun, Chao Li
    • Organizer
      BMVC
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Rethinking Prototypical Contrastive Learning through Alignment, Uniformity and Correlation2022

    • Author(s)
      Shentong Mo, Zhun Sun, Chao Li
    • Organizer
      BMVC
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] MMT: Multi-Way Multi-Modal Transformer for Multimodal Learning2022

    • Author(s)
      Jiajia Tang, Kang Li1, Ming Hou, Xuanyu Jin, Wanzeng Kong, Yu Ding and Qibin Zhao
    • Organizer
      IJCAI
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] SPD domain-specific batch normalization to crack interpretable unsupervised domain adaptation in EEG2022

    • Author(s)
      Reinmar J. Kobler, Jun-ichiro Hirayama, Qibin Zhao, Motoaki Kawanabe
    • Organizer
      NeurIPS
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Permutation Search of Tensor Network Structures via Local Sampling2022

    • Author(s)
      Chao Li, Junhua Zeng, Zerui Tao, Qibin Zhao
    • Organizer
      ICML
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Tutorial Talk: Advanced Topics of Prior-based Image Restoration: Tensors and Neural Networks2021

    • Author(s)
      T. Yokota
    • Organizer
      APSIPA ASC 2021
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] FAST ALGORITHM FOR LOW-RANK TENSOR COMPLETION IN DELAY EMBEDDED SPACE2021

    • Author(s)
      R. Yamamoto, T. Yokota, A. Imakura, H. Hontani
    • Organizer
      APSIPA ASC
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Neural Tangent KernelによるDeep Image Priorの解析2021

    • Author(s)
      藤田和真,本谷秀堅,横田達也
    • Organizer
      信号処理シンポジウム
    • Related Report
      2021 Annual Research Report
  • [Presentation] Tutorial Talk: Tensor Representations in Signal Processing and Machine Learning2020

    • Author(s)
      T. Yokota
    • Organizer
      APSIPA ASC 2020
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 信号処理と機械学習による画像復元2020

    • Author(s)
      横田達也
    • Organizer
      第5回統計・機械学習若手シンポジウム
    • Related Report
      2020 Annual Research Report
    • Invited
  • [Presentation] Non-negative Matrix Factorization in Application to Dynamic PET Image Reconstruction2020

    • Author(s)
      T. Yokota
    • Organizer
      RIKEN-AIP Open Seminar Series
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] 画像復元のための高階埋め込み多様体モデルの研究2020

    • Author(s)
      横田達也
    • Organizer
      MI研究会/FIT2020
    • Related Report
      2020 Annual Research Report
    • Invited
  • [Presentation] Dynamic PET Image Reconstruction Using Nonnegative Matrix Factorization Incorporated With Deep Image Prior2020

    • Author(s)
      横田達也
    • Organizer
      MIRU
    • Related Report
      2020 Annual Research Report
    • Invited
  • [Presentation] 高階埋め込み空間における低ランクテンソル補完の高速アルゴリズム2020

    • Author(s)
      山本龍宣,横田達也,今倉暁,本谷秀堅
    • Organizer
      PRMU研究会
    • Related Report
      2020 Annual Research Report
  • [Book] Tensors for Data Processing2021

    • Author(s)
      Yipeng Liu
    • Total Pages
      596
    • Publisher
      Elsevier
    • Related Report
      2021 Annual Research Report

URL: 

Published: 2020-04-28   Modified: 2024-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi