• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Structured Tensor Approximation under Kronecker Graph and Its Application on Hydrological Data

Research Project

Project/Area Number 20K19875
Research Category

Grant-in-Aid for Early-Career Scientists

Allocation TypeMulti-year Fund
Review Section Basic Section 61030:Intelligent informatics-related
Research InstitutionInstitute of Physical and Chemical Research

Principal Investigator

Li Chao  国立研究開発法人理化学研究所, 革新知能統合研究センター, 研究員 (10869837)

Project Period (FY) 2020-04-01 – 2022-03-31
Project Status Completed (Fiscal Year 2021)
Budget Amount *help
¥4,160,000 (Direct Cost: ¥3,200,000、Indirect Cost: ¥960,000)
Fiscal Year 2021: ¥1,950,000 (Direct Cost: ¥1,500,000、Indirect Cost: ¥450,000)
Fiscal Year 2020: ¥2,210,000 (Direct Cost: ¥1,700,000、Indirect Cost: ¥510,000)
Keywordstensor network / Tensor network / Machine learning / time series forecasting / Tensor Learning / complex graph
Outline of Research at the Start

Tensor decomposition (TD) is becoming a promising tool in various fields. However, how to exploit the inherent graphical structure of the data is not widely explored. To this end, we plan to develop new TD methods based on the Kronecker structure of the large-scale complex graph. In addition, we will generalize the existing theoretical studies such that the new theory can guide us to analyse the performance of the methods. Finally, we will apply the new methods to the task of hydrological data restoration, which is of importance for the subsequent prediction and analysis tasks.

Outline of Final Research Achievements

Tensor models have been widely applied to resolving extremely high-dimensional tasks in various fields. However, there remain many unexplored problems for tensors, particularly for tensor network structure search (TN-SS) and the analysis of the tensor learning dynamics (TLD). In this project, we conduct a thorough investigation of the preceding issues. For TN-SS, we found that the optimal tensor network structure can be obtained by sampling-based algorithms, for which we propose two efficient sampling schemes with theoretical analysis of the search space. For analyzing TLD in time series forecasting, our study reveals the relationship between the models’ memory mechanism and the tensor orders. We also propose a new forecasting method called the fractional tensor recurrent unit (fTRU), which can maximize the benefit of the long-memory effect by tensors. Extensive experimental results on real-world data demonstrate the usefulness of the methods studied in the project.

Academic Significance and Societal Importance of the Research Achievements

Tensor is a promising framework, which tightly bonds many scientific fields for the human society. The results of the project reveal how the tensor structures impact its behavior in machine learning and practically provides methods to maximize the performance in real-world applications.

Report

(3 results)
  • 2021 Annual Research Report   Final Research Report ( PDF )
  • 2020 Research-status Report
  • Research Products

    (17 results)

All 2021 2020 Other

All Int'l Joint Research (2 results) Journal Article (5 results) (of which Int'l Joint Research: 5 results,  Peer Reviewed: 5 results,  Open Access: 3 results) Presentation (5 results) (of which Int'l Joint Research: 5 results) Remarks (5 results)

  • [Int'l Joint Research] Bigo Technology PTE. LTD, Singapore(シンガポール)

    • Related Report
      2021 Annual Research Report
  • [Int'l Joint Research] Carnegie Mellon University(米国)

    • Related Report
      2021 Annual Research Report
  • [Journal Article] Hide Chopin in the Music: Efficient Information Steganography Via Random Shuffling2021

    • Author(s)
      Sun Zhun、Li Chao、Zhao Qibin
    • Journal Title

      Proceeding of ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

      Volume: 1 Pages: 2370-2374

    • DOI

      10.1109/icassp39728.2021.9413357

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] On the Memory Mechanism of Tensor-Power Recurrent Models2021

    • Author(s)
      Qiu, Hejia and Li, Chao and Weng, Ying and Sun, Zhun and He, Xingyu and Zhao, Qibin
    • Journal Title

      Proceedings of the International Conference on Artificial Intelligence and Statistics

      Volume: 1

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Evolutionary topology search for tensor network decomposition2020

    • Author(s)
      Li, Chao and Sun, Zhun
    • Journal Title

      Proceedings of the International Conference on Machine Learning

      Volume: 1

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Tpfn: Applying outer product along time to multimodal sentiment analysis fusion on incomplete data2020

    • Author(s)
      Li, Binghua and Li, Chao and Duan, Feng and Zheng, Ning and Zhao, Qibin
    • Journal Title

      Computer Vision -- ECCV 2020

      Volume: 1 Pages: 431-447

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Low Tensor-Ring Rank Completion by Parallel Matrix Factorization2020

    • Author(s)
      Yu Jinshi、Zhou Guoxu、Li Chao、Zhao Qibin、Xie Shengli
    • Journal Title

      IEEE Transactions on Neural Networks and Learning Systems

      Volume: 1 Issue: 7 Pages: 1-14

    • DOI

      10.1109/tnnls.2020.3009210

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Presentation] HIDE CHOPIN IN THE MUSIC: EFFICIENT INFORMATION STEGANOGRAPHY VIA RANDOM SHUFFLING2021

    • Author(s)
      Chao Li
    • Organizer
      ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Siamese Prototypical Contrastive Learning2021

    • Author(s)
      Chao Li
    • Organizer
      BMVC 2021
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] On the Memory Mechanism of Tensor-Power Recurrent Models2021

    • Author(s)
      Li, Chao
    • Organizer
      International Conference on Artificial Intelligence and Statistics
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] Evolutionary topology search for tensor network decomposition2020

    • Author(s)
      Li, Chao
    • Organizer
      International Conference on Machine Learning
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] Tpfn: Applying outer product along time to multimodal sentiment analysis fusion on incomplete data2020

    • Author(s)
      Li, Chao
    • Organizer
      European Conference on Computer Vision
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Remarks] The paper published in ICASSP 2021

    • URL

      https://ieeexplore.ieee.org/document/9413357

    • Related Report
      2021 Annual Research Report
  • [Remarks] Siamese Prototypical Contrastive Learning

    • URL

      https://www.bmvc2021-virtualconference.com/assets/papers/0890.pdf

    • Related Report
      2021 Annual Research Report
  • [Remarks] Paper 1

    • URL

      http://proceedings.mlr.press/v130/qiu21a/qiu21a.pdf

    • Related Report
      2020 Research-status Report
  • [Remarks] Paper 2

    • URL

      http://proceedings.mlr.press/v119/li20l/li20l.pdf

    • Related Report
      2020 Research-status Report
  • [Remarks] Paper 3

    • URL

      http://www.ecva.net/papers/eccv_2020/papers_ECCV/papers/123690426.pdf

    • Related Report
      2020 Research-status Report

URL: 

Published: 2020-04-28   Modified: 2023-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi