• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Developing Generative Machine Learning and its Digital Circuit Implementation by Leveraging Neuronal Stochastic Behavior

Research Project

Project/Area Number 16K12487
Research Category

Grant-in-Aid for Challenging Exploratory Research

Allocation TypeMulti-year Fund
Research Field Intelligent informatics
Research InstitutionKobe University

Principal Investigator

Matsubara Takashi  神戸大学, システム情報学研究科, 助教 (70756197)

Co-Investigator(Kenkyū-buntansha) 上原 邦昭  神戸大学, システム情報学研究科, 教授 (60160206)
Project Period (FY) 2016-04-01 – 2019-03-31
Project Status Completed (Fiscal Year 2018)
Budget Amount *help
¥3,380,000 (Direct Cost: ¥2,600,000、Indirect Cost: ¥780,000)
Fiscal Year 2018: ¥650,000 (Direct Cost: ¥500,000、Indirect Cost: ¥150,000)
Fiscal Year 2017: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2016: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Keywordsニューラルネットワーク / ゆらぎ / 機械学習 / 非同期順序回路 / 人工ニューラルネットワーク / 生体神経細胞 / 生成モデル / 電子回路
Outline of Final Research Achievements

This study aimed at developing a new generative machine learning algorithm and implementation method by leveraging the stochastic behavior (uncertainty) and spike-time coding, which biological neural networks have and artificial ones do not. We derived a mathematical model bridging the gap between stochasticity and homeostasis of neurons. We proposed a biologically-plausible learning algorithm by considering the discrete spikes as sampled drawn from a probabilistic distribution. For circuit implementation, we proposed a new approximation method that requires only one-third circuit resources. We also proposed some practical methods based on the stochasticity.

Academic Significance and Societal Importance of the Research Achievements

本研究は(1)生物の脳が学習するメカニズムにおいて,従来不明であったゆらぎの貢献や時間的な適応について,数式によるモデルを構築できた.(2)確率的な現象をモデル化できる機械学習手法であるボルツマンマシンを,高密度に電子回路実装する手法を開発した.(3)いわゆる深層学習に確率的要素(ゆらぎや不確実性)を持ち込むことで,高い精度を達成したり,小規模データへ適応可能な手法を開発できた.

Report

(4 results)
  • 2018 Annual Research Report   Final Research Report ( PDF )
  • 2017 Research-status Report
  • 2016 Research-status Report
  • Research Products

    (40 results)

All 2019 2018 2017 2016

All Journal Article (10 results) (of which Peer Reviewed: 10 results,  Open Access: 6 results) Presentation (30 results) (of which Int'l Joint Research: 13 results)

  • [Journal Article] Deep Neural Generative Model of Functional MRI Images for Psychiatric Disorder Diagnosis2019

    • Author(s)
      Takashi Matsubara, Tetsuo Tashiro, and Kuniaki Uehara
    • Journal Title

      IEEE Transactions on Biomedical Engineering

      Volume: - Issue: 10 Pages: 2768-2779

    • DOI

      10.1109/tbme.2019.2895663

    • NAID

      120006733117

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Bayesian estimation and model averaging of convolutional neural networks by hypernetwork2019

    • Author(s)
      Kenya Ukai, Takashi Matsubara, and Kuniaki Uehara
    • Journal Title

      Nonlinear Theory and Its Applications, IEICE

      Volume: 10 Issue: 1 Pages: 45-59

    • DOI

      10.1587/nolta.10.45

    • NAID

      130007542515

    • ISSN
      2185-4106
    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Asynchronous network of cellular automaton-based neurons for efficient implementation of Boltzmann machines2018

    • Author(s)
      Matsubara Takashi、Uehara Kuniaki
    • Journal Title

      Nonlinear Theory and Its Applications, IEICE

      Volume: 9 Issue: 1 Pages: 24-35

    • DOI

      10.1587/nolta.9.24

    • NAID

      130006301355

    • ISSN
      2185-4106
    • Related Report
      2017 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Stock Price Prediction by Deep Neural Generative Model of News Articles2018

    • Author(s)
      Takashi MATSUBARA, Ryo AKITA, Kuniaki UEHARA
    • Journal Title

      IEICE TRANSACTIONS on Information and Systems

      Volume: E101-D Pages: 901-908

    • NAID

      130006602354

    • Related Report
      2017 Research-status Report
    • Peer Reviewed
  • [Journal Article] A Novel Weight-Shared Multi-Stage CNN for Scale Robustness2018

    • Author(s)
      Ryo Takahashi, Takashi Matsubara, and Kuniaki Uehara
    • Journal Title

      IEEE Transactions on Circuits and Systems for Video Technology

      Volume: 印刷中 Issue: 4 Pages: 1090-1101

    • DOI

      10.1109/tcsvt.2018.2822773

    • NAID

      120006733116

    • Related Report
      2017 Research-status Report
    • Peer Reviewed
  • [Journal Article] Conduction Delay Learning Model for Unsupervised and Supervised Classification of Spatio-Temporal Spike Patterns2017

    • Author(s)
      Matsubara Takashi
    • Journal Title

      Frontiers in Computational Neuroscience

      Volume: 11

    • DOI

      10.3389/fncom.2017.00104

    • NAID

      120006375913

    • Related Report
      2017 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Auto-encoder with Adversarially Regularized Latent Variables for Semi-Supervised Learning2017

    • Author(s)
      Ryosuke Tachibana, Takashi Matsubara, Kuniaki Uehara
    • Journal Title

      Information Engineering Express

      Volume: 3 Pages: 11-20

    • Related Report
      2017 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Deep Manga Colorization with Color Style Extraction by Conditional Adversarially Learned Inference2017

    • Author(s)
      Yusuke Kataoka, Takashi Matsubara, Kuniaki Uehara
    • Journal Title

      Information Engineering Express

      Volume: 3 Pages: 55-66

    • Related Report
      2017 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Homeostatic Plasticity Achieved by Incorporation of Random Fluctuations and Soft-Bounded Hebbian Plasticity in Excitatory Synapses2016

    • Author(s)
      Takashi Matsubara and Kuniaki Uehara
    • Journal Title

      Frontiers in Neural Circuits

      Volume: 10 Pages: 1-17

    • DOI

      10.3389/fncir.2016.00042

    • Related Report
      2016 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Deep Learning for Stock Prediction Using Numerical and Textual Information2016

    • Author(s)
      Ryo Akita, Akira Yoshihara, Takashi Matsubara, and Kuniaki Uehara
    • Journal Title

      International Journal of Computer & Information Science

      Volume: 17 Pages: 11-16

    • Related Report
      2016 Research-status Report
    • Peer Reviewed
  • [Presentation] Structured Deep Generative Model of FMRI Signals for Mental Disorder Diagnosis2018

    • Author(s)
      Takashi Matsubara, Tetsuo Tashiro, and Kuniaki Uehara
    • Organizer
      Medical Image Computing and Computer Assisted Intervention
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] ハイパーネットによる畳み込みニューラルネットワークの暗黙的事後分布推定2018

    • Author(s)
      鵜飼健矢, 松原崇, 上原邦昭
    • Organizer
      複雑コミュニケーションサイエンス研究会
    • Related Report
      2018 Annual Research Report
  • [Presentation] 深層生成モデルの構造化によるfMRI画像からの特徴抽出2018

    • Author(s)
      田代哲生, 松原崇, 上原邦昭
    • Organizer
      複雑コミュニケーションサイエンス研究会
    • Related Report
      2018 Annual Research Report
  • [Presentation] 構造化深層生成モデルによるfMRI画像を用いた精神疾患診断2018

    • Author(s)
      田代哲生, 松原崇, 上原邦昭
    • Organizer
      第32回人工知能学会全国大会
    • Related Report
      2018 Annual Research Report
  • [Presentation] 深層生成モデルによる非正則化異常度を用いた工業製品の異常検知2018

    • Author(s)
      立花亮介, 松原崇, 上原邦昭
    • Organizer
      第32回人工知能学会全国大会
    • Related Report
      2018 Annual Research Report
  • [Presentation] 多様な仮想空間を構築するための画像モダリティ変換2018

    • Author(s)
      益田慎太, 松原崇, 上原邦昭
    • Organizer
      第32回人工知能学会全国大会
    • Related Report
      2018 Annual Research Report
  • [Presentation] ハイパーネットによる識別モデルのベイズ推定とモデル平均化2018

    • Author(s)
      鵜飼健矢, 松原崇, 上原邦昭
    • Organizer
      第32回人工知能学会全国大会
    • Related Report
      2018 Annual Research Report
  • [Presentation] Anomaly Machine Component Detection by Deep Generative Model with Unregularized Score2018

    • Author(s)
      Takashi Matsubara, Ryosuke Tachibana, and Kuniaki Uehara
    • Organizer
      Proc. of The 2018 International Joint Conference on Neural Networks (IJCNN2018)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] 非正規化異常度を用いた深層生成モデルによる工業製品の異常検知2018

    • Author(s)
      立花亮介,松原崇,上原邦昭
    • Organizer
      電子情報通信学会総合大会講演論文集
    • Related Report
      2017 Research-status Report
  • [Presentation] CNN のフィルタを生成するサブネットワークによるサイズ可変なCNN2018

    • Author(s)
      鵜飼健矢,松原崇,上原邦昭
    • Organizer
      電子情報通信学会総合大会講演論文集
    • Related Report
      2017 Research-status Report
  • [Presentation] 深層生成モデルによるfMRIデータの患者個人特徴量抽出とそれを用いた精神疾患診断2018

    • Author(s)
      松原崇,田代哲生,上原邦昭
    • Organizer
      第5回 JAMI医用知能情報学研究会-JSAI医用人工知能研究会 合同研究会
    • Related Report
      2017 Research-status Report
  • [Presentation] Spike Timing-Dependent Conduction Delay Learning Model Classifying Spatio-Temporal Spike Patterns2017

    • Author(s)
      Takashi Matsubara
    • Organizer
      The 2017 International Joint Conference on Neural Networks (IJCNN2017)
    • Place of Presentation
      Anchorage, Alaska
    • Year and Date
      2017-05-15
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] スパイク時刻依存遅延学習モデルによるスパイク列の学習2017

    • Author(s)
      松原崇
    • Organizer
      電子情報通信学会総合大会講演論文集
    • Place of Presentation
      名城大学(愛知県名古屋市)
    • Year and Date
      2017-03-22
    • Related Report
      2016 Research-status Report
  • [Presentation] 深層学習における敵対的ネットワークを用いた漫画画像の自動カラー化2017

    • Author(s)
      片岡裕介, 松原崇, 上原邦昭
    • Organizer
      情報処理学会 コンピュータビジョンとイメージメディア研究会
    • Place of Presentation
      国立情報学研究所(東京)
    • Year and Date
      2017-03-09
    • Related Report
      2016 Research-status Report
  • [Presentation] Deep Neural Generative Model for fMRI Image Based Diagnosis of Mental Disorder2017

    • Author(s)
      Tetsuo Tashiro, Takashi Matsubara, and Kuniaki Uehara
    • Organizer
      Proc. of The 2017 International Symposium on Nonlinear Theory and its Applications (NOLTA2017)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Multi-Stage Convolutional Neural Networks for Robustness to Scale Transformation2017

    • Author(s)
      Ryo Takahashi, Takashi Matsubara, and Kuniaki Uehara
    • Organizer
      Proc. of The 2017 International Symposium on Nonlinear Theory and its Applications (NOLTA2017)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Scale-Invariant Recognition by Weight-Shared CNNs in Parallel2017

    • Author(s)
      Ryo Takahashi, Takashi Matsubara, and Kuniaki Uehara
    • Organizer
      Proc. of The 9th Asian Conference on Machine Learning (ACML 2017)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Automatic Manga Colorization with Color Style by Generative Adversarial Nets2017

    • Author(s)
      Yuusuke Kataoka, Takashi Matsubara, and Kuniaki Uehara
    • Organizer
      Proc. of The 18th IEEE/ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD2017)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Developing Game AI Agent Behaving Like Human by Mixing Reinforcement Learning and Supervised Learning2017

    • Author(s)
      Shohei Miyashita, Xinyu Lian, Xiao Zeng, Takashi Matsubara, and Kuniaki Uehara
    • Organizer
      Proc. of The 18th IEEE/ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD2017)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Spike Timing-Dependent Conduction Delay Learning Model Classifying Spatio-Temporal Spike Patterns2017

    • Author(s)
      Takashi Matsubara
    • Organizer
      Proc. of The 2017 International Joint Conference on Neural Networks (IJCNN2017)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Feedback Alignmentに基づく自己符号化器のヘブ則様学習アルゴリズムの検討2017

    • Author(s)
      松原崇
    • Organizer
      電子情報通信学会技術研究報告 複雑コミュニケーションサイエンス研究会
    • Related Report
      2017 Research-status Report
  • [Presentation] 脳機能画像解析のための深層生成モデル2017

    • Author(s)
      田代哲生,松原崇,上原邦昭
    • Organizer
      2017年度 第30回人工知能学会全国大会 (JSAI2017)
    • Related Report
      2017 Research-status Report
  • [Presentation] 幾何学的不変性獲得のための多段CNNの提案2017

    • Author(s)
      高橋良,松原崇,上原邦昭
    • Organizer
      2017年度 第30回人工知能学会全国大会 (JSAI2017)
    • Related Report
      2017 Research-status Report
  • [Presentation] Efficient Implementation of Boltzmann Machine using Asynchronous Network of Cellular Automaton-based Neurons2016

    • Author(s)
      Takashi Matsubara and Kuniaki Uehara
    • Organizer
      The 2016 International Symposium on Nonlinear Theory and its Applications (NOLTA2016)
    • Place of Presentation
      Yugawara, Japan
    • Year and Date
      2016-11-30
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] A Novel Homeostatic Plasticity Model Realized by Random Fluctuations in Excitatory Synapses2016

    • Author(s)
      Takashi Matsubara and Kuniaki Uehara
    • Organizer
      The 2016 International Joint Conference on Neural Networks (IJCNN2016)
    • Place of Presentation
      Vancouver, Canada
    • Year and Date
      2016-07-25
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] Image Generation Using Generative Adversarial Networks and Attention Mechanism2016

    • Author(s)
      Yuusuke Kataoka, Takashi Matsubara, and Kuniaki Uehara
    • Organizer
      the 15th IEEE/ACIS International Conference on Computer and Information Science (ICIS 2016)
    • Place of Presentation
      Okayama, Japan
    • Year and Date
      2016-06-28
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] Semi-Supervised Learning Using Adversarial Networks2016

    • Author(s)
      Ryosuke Tachibana, Takashi Matsubara, and Kuniaki Uehara
    • Organizer
      the 15th IEEE/ACIS International Conference on Computer and Information Science (ICIS 2016)
    • Place of Presentation
      Okayama, Japan
    • Year and Date
      2016-06-28
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] 神経パルス信号と高次可塑性を用いた深層学習システムの構築2016

    • Author(s)
      小西創, 松原崇, 上原邦昭
    • Organizer
      第30回人工知能学会全国大会 (JSAI2016)
    • Place of Presentation
      北九州国際会議場(福岡県北九州市)
    • Year and Date
      2016-06-06
    • Related Report
      2016 Research-status Report
  • [Presentation] 深層学習における敵対的ネットワークと注視を用いた画像生成の試み2016

    • Author(s)
      片岡裕介, 松原崇, 上原邦昭
    • Organizer
      第30回人工知能学会全国大会 (JSAI2016)
    • Place of Presentation
      北九州国際会議場(福岡県北九州市)
    • Year and Date
      2016-06-06
    • Related Report
      2016 Research-status Report
  • [Presentation] 深層学習における敵対的ネットワークによるラベル推定と半教師あり学習2016

    • Author(s)
      立花亮介, 松原崇, 上原邦昭
    • Organizer
      第30回人工知能学会全国大会 (JSAI2016)
    • Place of Presentation
      北九州国際会議場(福岡県北九州市)
    • Related Report
      2016 Research-status Report

URL: 

Published: 2016-04-21   Modified: 2020-03-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi