• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

High-Order Deep Learning Models: Theoretical Study and Applications

Research Project

Project/Area Number 17K00326
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Research Field Intelligent informatics
Research InstitutionInstitute of Physical and Chemical Research

Principal Investigator

Zhao Qibin  国立研究開発法人理化学研究所, 革新知能統合研究センター, ユニットリーダー (30599618)

Co-Investigator(Kenkyū-buntansha) 曹 建庭  埼玉工業大学, 工学部, 教授 (20306989)
Project Period (FY) 2017-04-01 – 2020-03-31
Project Status Completed (Fiscal Year 2019)
Budget Amount *help
¥4,550,000 (Direct Cost: ¥3,500,000、Indirect Cost: ¥1,050,000)
Fiscal Year 2019: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Fiscal Year 2018: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Fiscal Year 2017: ¥1,820,000 (Direct Cost: ¥1,400,000、Indirect Cost: ¥420,000)
KeywordsTensor decomposition / Tensor networks / Multi-modal learning / Tensor completion / Tensor Ring / Deep Multimodal Learning / Tensor ring / Deep multi-task learning / Deep neural network / PU learning / GAN / Tensor Decomposition / Deep Learning / Tensor Networks
Outline of Final Research Achievements

Tensor decomposition and tensor networks (TNs) have recently gained increasing attentions in machine learning, data mining and computer vision fields due to its effectiveness in efficient computation and model compression in deep learning. However, there are many open problems that are still unexplored, which limits its impact in machine learning. In this project, we studied the fundamental model and theory of tensor networks and applied it for data representation and model representation. We have introduced a novel tensor decomposition model together with fast and scalable algorithms which can be applied to large-scale data completion and image denoising. In addition, we also developed deep multi-task, multi-model learning and multiple GANs methods based on tensor network representations, which shows powerful expressive ability and economic model complexity.

Academic Significance and Societal Importance of the Research Achievements

Tensor representation and tensor networks have shown to be useful in deep learning models. This project has further promoted to solve the challenging problems in deep learning methods by using TN technology.

Report

(4 results)
  • 2019 Annual Research Report   Final Research Report ( PDF )
  • 2018 Research-status Report
  • 2017 Research-status Report
  • Research Products

    (32 results)

All 2020 2019 2018 2017

All Journal Article (12 results) (of which Int'l Joint Research: 8 results,  Peer Reviewed: 12 results,  Open Access: 4 results) Presentation (20 results) (of which Int'l Joint Research: 19 results)

  • [Journal Article] Rank Minimization on Tensor Ring: An Efficient Approach for Tensor Decomposition and Completion2019

    • Author(s)
      Longhao Yuan, Chao Li, Jianting Cao and Qibin Zhao
    • Journal Title

      Machine Learning

      Volume: 109 Issue: 3 Pages: 603-622

    • DOI

      10.1007/s10994-019-05846-7

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Remote sensing image reconstruction using tensor ring completion and total-variation2019

    • Author(s)
      W. He, N. Yokoya, L. Yuan, and Q. Zhao
    • Journal Title

      IEEE Transactions on Geoscience and Remote Sensing

      Volume: 57 Issue: 11 Pages: 8998-9009

    • DOI

      10.1109/tgrs.2019.2924017

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Multidimensional clinical data denosing via Bayesian CP factorization2019

    • Author(s)
      Cui Gaochao, Zhu Li, Gui Lihua, Zhao Qibin, Zhang Jianhai, Cao Jianting
    • Journal Title

      Science China (Technological Sciences)

      Volume: 62 Issue: 2 Pages: 1-10

    • DOI

      10.1007/s11431-018-9493-9

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] High-order tensor completion via gradient-based optimization under tensor train format2019

    • Author(s)
      Yuan Longhao、Zhao Qibin、Gui Lihua、Cao Jianting
    • Journal Title

      Signal Processing: Image Communication

      Volume: 73 Pages: 53-61

    • DOI

      10.1016/j.image.2018.11.012

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Image and video completion by using Bayesian tensor decomposition2018

    • Author(s)
      L. Gui, X. Zhao, Q. Zhao, and J. Cao.
    • Journal Title

      International Journal of Computer Science Issues

      Volume: 15 Pages: 1-8

    • DOI

      10.5281/ZENODO.1467644

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Non-local image denoising by using Bayesian low- rank tensor factorization on high-order patches2018

    • Author(s)
      L. Gui, X. Zhao, Q. Zhao, and J. Cao.
    • Journal Title

      International Journal of Computer Science Issues

      Volume: 15 Pages: 16-25

    • DOI

      10.5281/ZENODO.1467648

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Feature Extraction for Incomplete Data Via Low-Rank Tensor Decomposition With Feature Regularization2018

    • Author(s)
      Shi Qiquan、Cheung Yiu-Ming、Zhao Qibin、Lu Haiping
    • Journal Title

      IEEE Transactions on Neural Networks and Learning Systems

      Volume: x Issue: 6 Pages: 1-15

    • DOI

      10.1109/tnnls.2018.2873655

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Brain-Computer Interface with Corrupted EEG Data: a Tensor Completion Approach2018

    • Author(s)
      Sole-Casals J.、Caiafa C. F.、Zhao Q.、Cichocki A.
    • Journal Title

      Cognitive Computation

      Volume: 10 Issue: 6 Pages: 1062-1074

    • DOI

      10.1007/s12559-018-9574-9

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Two-Stage Frequency Recognition Method Based on Correlated Component Analysis for SSVEP-Based BCI2018

    • Author(s)
      Zhang Yangsong、Yin Erwei、Li Fali、Zhang Yu、Tanaka Toshihisa、Zhao Qibin、Cui Yan、Xu Peng、Yao Dezhong、Guo Daqing
    • Journal Title

      IEEE Transactions on Neural Systems and Rehabilitation Engineering

      Volume: 26 Issue: 7 Pages: 1314-1323

    • DOI

      10.1109/tnsre.2018.2848222

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Correlated Component Analysis for Enhancing the Performance of SSVEP-Based Brain-Computer Interface2018

    • Author(s)
      Zhang Yangsong、Guo Daqing、Li Fali、Yin Erwei、Zhang Yu、Li Peiyang、Zhao Qibin、Tanaka Toshihisa、Yao Dezhong、Xu Peng
    • Journal Title

      IEEE Transactions on Neural Systems and Rehabilitation Engineering

      Volume: 26 Issue: 5 Pages: 948-956

    • DOI

      10.1109/tnsre.2018.2826541

    • Related Report
      2017 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Completion of High Order Tensor Data with Missing Entries via Tensor-Train Decomposition2017

    • Author(s)
      Yuan Longhao、Zhao Qibin、Cao Jianting
    • Journal Title

      Lecture Notes in Computer Science

      Volume: 10634 Pages: 222-229

    • DOI

      10.1007/978-3-319-70087-8_24

    • ISBN
      9783319700861, 9783319700878
    • Related Report
      2017 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Feature Extraction for Incomplete Data via Low-rank Tucker Decomposition2017

    • Author(s)
      Shi Qiquan、Cheung Yiu-ming、Zhao Qibin
    • Journal Title

      Lecture Notes in Computer Science

      Volume: 10534 Pages: 564-581

    • DOI

      10.1007/978-3-319-71249-9_34

    • ISBN
      9783319712482, 9783319712499
    • Related Report
      2017 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Presentation] Classification of Epileptic IEEG Signals by CNN and Data Augmentation2020

    • Author(s)
      Xuyang Zhao, Jordi Sole-Casals, Binghua Li, Zihao Huang, Andong Wang, Jianting Cao
    • Organizer
      IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Robust Tensor Decomposition via Orientation Invariant Tubal Nuclear Norms2020

    • Author(s)
      Andong Wang, Chao Li, Zhong Jin, Qibin Zhao
    • Organizer
      Proceedings of the AAAI Conference on Artificial Intelligence (AAAI)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Beyond unfolding: Exact recovery of latent convex tensor decomposition under reshuffling2020

    • Author(s)
      Chao Li, Mohammad Emtiyaz Khan, Zhun Sun, Gang Niu, Bo Han, Shengli Xie, Qibin Zhao
    • Organizer
      Proceedings of the AAAI Conference on Artificial Intelligence (AAAI)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Learning efficient tensor representa- tions with ring structure networks2019

    • Author(s)
      Qibin Zhao, Masashi Sugiyama, Longhao Yuan, Andrzej Cichocki
    • Organizer
      EEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Tensor Ring Decomposition with Rank Minimization on Latent Space: An Efficient Approach for Tensor Completion2019

    • Author(s)
      Longhao Yuan, Chao Li, Danilo Mandic, Jianting Cao, Qibin Zhao
    • Organizer
      Proceedings of the AAAI Conference on Artificial Intelligence (AAAI)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Randomized Tensor Ring Decomposition and Its Application to Large-scale Data Reconstruction2019

    • Author(s)
      Longhao Yuan, Chao Li, Jianting Cao, Qibin Zhao
    • Organizer
      IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Localization of Epileptic Foci by Using Convolutional Neural Network Based on iEEG2019

    • Author(s)
      Linfeng Sui, Xuyang Zhao, Qibin Zhao, Toshihisa Tanaka, Jianting Cao
    • Organizer
      IFIP International Conference on Artificial Intelligence Applications and Innovations
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Low-rank Embedding of Kernels in Convolutional Neural Networks under Random Shuffling2019

    • Author(s)
      Chao Li, Zhun Sun, Jinshi Yu, Ming Hou, Qibin Zhao
    • Organizer
      IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Guaranteed Matrix Completion under Multiple Linear Transformations2019

    • Author(s)
      Chao Li ; Wei He ; Longhao Yuan ; Zhun Sun ; Qibin Zhao
    • Organizer
      IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A One-Dimensional Convolutional Neural Network Model for Automated Localization of Epileptic Foci2019

    • Author(s)
      Boning Li ; Xuyang Zhao ; Qibin Zhao ; Toshihisa Tanaka ; Jianting Cao
    • Organizer
      Signal and Information Processing Association Annual Summit and Conference (APSIPA)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Deep multimodal multilinear fusion with high-order polynomial pooling2019

    • Author(s)
      Ming Hou, Jiajia Tang, Jianhai Zhang, Wanzeng Kong, Qibin Zhao
    • Organizer
      Advances in Neural Information Processing Systems 32 (NIPS 2019)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Quasi-brain-death eeg diagnosis based on tensor train decomposition2019

    • Author(s)
      Qipeng ChenLonghao YuanYao MiaoQibin ZhaoToshihisa TanakaJianting Cao
    • Organizer
      International Symposium on Neural Networks
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Higher-dimension tensor completion via low-rank tensor ring decomposition2018

    • Author(s)
      L. Yuan, J. Cao, X. Zhao, Q. Wu, and Q. Zhao.
    • Organizer
      APSIPA-ASC 2018
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Epileptic focus localization based on iEEG by using positive unlabeled (PU) learning2018

    • Author(s)
      X. Zhao, T. Tanaka, W. Kong, Q. Zhao, J. Cao, H. Sugano, and N. Yoshida
    • Organizer
      APSIPA-ASC
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Detection of Epileptic Foci Based on Interictal iEEG by Using Convolutional Neural Network2018

    • Author(s)
      Xuyang Zhao, Qibin Zhao, Toshihisa Tanaka, Jianting Cao, Wanzeng Kong, Hidenori Sugano and Noboru Yoshida∥
    • Organizer
      International Conference on Digital Signal Processing
    • Related Report
      2018 Research-status Report
  • [Presentation] HIGH-ORDER TENSOR COMPLETION FOR DATA RECOVERY VIA SPARSE TENSOR-TRAIN OPTIMIZATION2018

    • Author(s)
      Longhao Yuan, Qibin Zhao, Jianting Cao
    • Organizer
      2018 IEEE International Conference on Acoustics, Speech and Signal Processing
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Generative Adversarial Positive-Unlabelled Learning2018

    • Author(s)
      Ming Hou, Brahim Chaib-draa, Qibin Zhao
    • Organizer
      27th International Joint Conference on Artificial Intelligence and the 23rd European Conference on Artificial Intelligence
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] TGAN: TENSORIZING GENERATIVE ADVERSARIAL NETS2018

    • Author(s)
      Xingwei Cao, Xuyang Zhao, Qibin Zhao
    • Organizer
      The Third International Conference On Consumer Electronics (ICCE) Asia
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] A Hybrid Brain Computer Interface Based on Audiovisual Stimuli P3002018

    • Author(s)
      Xuyang Zhao, Gaochao Cui, Longhao Yuan, Toshihisa, Tanaka, Qibin Zhao, Jianting Cao
    • Organizer
      The Third International Conference On Consumer Electronics (ICCE) Asia
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Brain Image Completion by Bayesian Tensor Decomposition2017

    • Author(s)
      Lihua Gui, Qibin Zhao, Jianting Cao
    • Organizer
      2017 22nd International Conference on Digital Signal Processing (DSP)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research

URL: 

Published: 2017-04-28   Modified: 2021-02-19  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi