• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

a practical designing theory for deep learning models

Research Project

Project/Area Number 15K00330
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Research Field Soft computing
Research InstitutionYamagata University

Principal Investigator

Yasuda Muneki  山形大学, 大学院理工学研究科, 准教授 (20532774)

Co-Investigator(Renkei-kenkyūsha) Kataoka Shun  小樽商科大学, 商学部, 准教授 (50737278)
Project Period (FY) 2015-04-01 – 2018-03-31
Project Status Completed (Fiscal Year 2017)
Budget Amount *help
¥4,680,000 (Direct Cost: ¥3,600,000、Indirect Cost: ¥1,080,000)
Fiscal Year 2017: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Fiscal Year 2016: ¥1,820,000 (Direct Cost: ¥1,400,000、Indirect Cost: ¥420,000)
Fiscal Year 2015: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Keywords深層学習 / 統計的機械学習 / 確率的情報処理 / 情報統計力学 / 理論解析 / アルゴリズム開発 / 深層ボルツマンマシン / 制限ボルツマンマシン / 情報理論
Outline of Final Research Achievements

The aim of this research is to find a mathematical and information theoretical background of deep learning systems and to obtain effective algorithms for them in terms of the techniques in the probabilistic information processing and in the information statistical mechanics. We obtained the following results during this research period. (1) clarifying a mathematical background of the pre-training in deep Boltzmann machines, (2) a novel general theorem for restricted Boltzmann machines (RBMs) that states that, when mean-field methods are employed, inference results obtained from marginalized models are more accurate than those obtained from original models, and (3) a very fast test method for noise robustness of deep neural networks.

Report

(4 results)
  • 2017 Annual Research Report   Final Research Report ( PDF )
  • 2016 Research-status Report
  • 2015 Research-status Report
  • Research Products

    (50 results)

All 2018 2017 2016 2015 Other

All Journal Article (14 results) (of which Peer Reviewed: 14 results,  Open Access: 3 results,  Acknowledgement Compliant: 6 results) Presentation (33 results) (of which Int'l Joint Research: 11 results,  Invited: 13 results) Book (1 results) Remarks (2 results)

  • [Journal Article] Linear-Time Algorithm in Bayesian Image Denoising based on Gaussian Markov Random Field2018

    • Author(s)
      Muneki Yasuda, Jyunpei Watanabe, Shun Kataoka, and Kazuyuki Tanaka
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: 印刷中

    • NAID

      130007382462

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Solving Non-parametric Inverse Problem in Continuous Markov Random Field using Loopy Belief Propagation2017

    • Author(s)
      Muneki Yasuda and Shun Kataoka
    • Journal Title

      Journal of the Physical Society of Japan

      Volume: 86 Issue: 8 Pages: 084806-084806

    • DOI

      10.7566/jpsj.86.084806

    • NAID

      40021286383

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Estimation System of Blood Pressure Variation with Photo-Plethysmograph Signals using Neural Network2017

    • Author(s)
      Seung-Il Cho, Takumi Negishi, Muneki Yasuda and Michio Yokoyama
    • Journal Title

      Proceedings of the 30th International Conference on Computer Applications in Industry and Engineering (CAINE2017)

      Volume: なし Pages: 155-160

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed
  • [Journal Article] A fast test method for noise robustness of deep neural networks2017

    • Author(s)
      Muneki Yasuda, Hironori Sakata, Seung-Il Cho, Tomochika Harada
    • Journal Title

      Proceedings of the 2017 International Symposium on Nonlinear Theory and its Applications (NOLTA2017)

      Volume: なし Pages: 46-49

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Analysis of Social Networks and its Evaluation using Big Data Analyzing Technique2017

    • Author(s)
      Atsushi Tanaka, Seung-Il Cho, Muneki Yasuda, Tomochika Harada and Michio Yokoyama
    • Journal Title

      Proceedings of the 2017 International Symposium on Nonlinear Theory and its Applications (NOLTA2017)

      Volume: なし Pages: 54-57

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Evaluation of Sleep Quality Based on Environmental and Vital Sensor Signals using Big Data Analysis and Deep Learning2017

    • Author(s)
      Minami Tsuchiya, Atsushi Tanaka, Muneki Yasuda, Tomochika Harada and Michio Yokoyama
    • Journal Title

      Proceedings of the 2017 International Symposium on Nonlinear Theory and its Applications (NOLTA2017)

      Volume: なし Pages: 38-41

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Multiple Sensor Data Acquisition System using Commonly Available Sensor Devices for Sleep and Car Conditions2017

    • Author(s)
      Tomochika Harada, Michio Yokoyama, Seung-Il Cho, Atsushi Tanaka, and Muneki Yasuda
    • Journal Title

      Proceedings of the 2017 International Symposium on Nonlinear Theory and its Applications (NOLTA2017)

      Volume: なし Pages: 50-53

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Perturbative Interpretation of Adaptive Thouless-Anderson-Palmer Free Energy2016

    • Author(s)
      Muneki Yasuda, Chako Takahashi, Kazuyuki Tanaka
    • Journal Title

      Journal of the Physical Society of Japan

      Volume: 85 Issue: 7 Pages: 1-2

    • DOI

      10.7566/jpsj.85.075001

    • NAID

      210000134023

    • Related Report
      2016 Research-status Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Boltzmann-machine learning of prior distributions of binarized natural images2016

    • Author(s)
      Tomoyuki Obuchi, Hirokazu Koma, Muneki Yasuda
    • Journal Title

      Journal of the Physical Society of Japan

      Volume: 85 Issue: 11 Pages: 1-17

    • DOI

      10.7566/jpsj.85.114803

    • NAID

      40020994962

    • Related Report
      2016 Research-status Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Community Detection Algorithm Combining Stochastic Block Model and Attribute Data Clustering2016

    • Author(s)
      Shun Kataoka, Takuto Kobayashi, Muneki Yasuda, Kazuyuki Tanaka
    • Journal Title

      Journal of the Physical Society of Japan

      Volume: 85 Issue: 11 Pages: 1-10

    • DOI

      10.7566/jpsj.85.114802

    • NAID

      40020994946

    • Related Report
      2016 Research-status Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Relationship between PreTraining and Maximum Likelihood Estimation in Deep Boltzmann Machines2016

    • Author(s)
      Muneki Yasuda
    • Journal Title

      Proceedings of the 19th International Conference on Artificial Intelligence and Statistics

      Volume: 2016 Pages: 582-590

    • Related Report
      2016 Research-status Report 2015 Research-status Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] Mean-Field Inference in Gaussian Restricted Boltzmann Machine2016

    • Author(s)
      Chako Takahashi and Muneki Yasuda
    • Journal Title

      Journal of the Physical Society of Japan

      Volume: 85 Issue: 3 Pages: 034001-034001

    • DOI

      10.7566/jpsj.85.034001

    • NAID

      40020761351

    • Related Report
      2015 Research-status Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Belief Propagation Algorithm for Portfolio Optimization Problems2015

    • Author(s)
      Takashi Shinzato and Muneki Yasuda
    • Journal Title

      PLoS ONE

      Volume: 10

    • Related Report
      2015 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Statistical analysis of loopy belief propagation in random fields2015

    • Author(s)
      Muneki Yasuda, Shun Kataoka and Kazuyuki Tanaka
    • Journal Title

      Physical Review E

      Volume: 92 Issue: 4 Pages: 1-15

    • DOI

      10.1103/physreve.92.042120

    • Related Report
      2015 Research-status Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Presentation] 誤ラベルを含むデータ集合を用いた統計的機械学習2018

    • Author(s)
      鈴木美香,安田宗樹
    • Organizer
      情報処理学会第80回全国大会
    • Related Report
      2017 Annual Research Report
  • [Presentation] スパース化された隠れ変数を持つ制限ボルツマンマシン2018

    • Author(s)
      横山悠貴,安田宗樹
    • Organizer
      情報処理学会第80回全国大会
    • Related Report
      2017 Annual Research Report
  • [Presentation] Improved Susceptibility Propagation と Diagonal Trick Method による適応 Thouless-Anderson-Palmer 方程式の導出2018

    • Author(s)
      高橋茶子,安田宗樹,田中和之
    • Organizer
      情報処理学会第80回全国大会
    • Related Report
      2017 Annual Research Report
  • [Presentation] 統計的機械学習理論とボルツマン機械学習2017

    • Author(s)
      安田宗樹
    • Organizer
      情報・データ科学との連携・融合による物性物理・量子化学の新展開
    • Place of Presentation
      理化学研究所計算科学研究機構
    • Year and Date
      2017-03-22
    • Related Report
      2016 Research-status Report
    • Invited
  • [Presentation] パターン認識システムに対する高速なノイズ耐性検査手法2017

    • Author(s)
      坂田浩規,安田宗樹
    • Organizer
      情報処理学会第79回全国大会
    • Place of Presentation
      名古屋大学
    • Year and Date
      2017-03-16
    • Related Report
      2016 Research-status Report
  • [Presentation] 誤り教師データを含むデータセットを用いた統計的機械学習に関する研究2017

    • Author(s)
      小堀美香,安田宗樹
    • Organizer
      情報処理学会第79回全国大会
    • Place of Presentation
      名古屋大学
    • Year and Date
      2017-03-16
    • Related Report
      2016 Research-status Report
  • [Presentation] 多値表現の隠れ変数を持つ制限ボルツマンマシン2017

    • Author(s)
      横山裕貴,安田宗樹
    • Organizer
      情報処理学会第79回全国大会
    • Place of Presentation
      名古屋大学
    • Year and Date
      2017-03-16
    • Related Report
      2016 Research-status Report
  • [Presentation] 深層ボルツマンマシンに対する高性能な平均場近似アルゴリズム2017

    • Author(s)
      高橋茶子,安田宗樹
    • Organizer
      情報処理学会第79回全国大会
    • Place of Presentation
      名古屋大学
    • Year and Date
      2017-03-16
    • Related Report
      2016 Research-status Report
  • [Presentation] Mean-field approach to Gaussian-Bernoulli restricted Boltzmann machine2017

    • Author(s)
      Chako Takahashi and Muneki Yasuda
    • Organizer
      Workshop on Statistical physics, Learning, Inference and Network
    • Place of Presentation
      Les Houches Physics School (フランス)
    • Year and Date
      2017-02-26
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] Relationship between pre-training and maximum likelihood estimation in deep Boltzmann machines2017

    • Author(s)
      Muneki Yasuda
    • Organizer
      Workshop on Statistical Physics of Disordered Systems and Its Applications
    • Place of Presentation
      佐勘(仙台秋保)
    • Year and Date
      2017-02-08
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] Estimation System of Blood Pressure Variation with Photo-Plethysmograph Signals using Neural Network2017

    • Author(s)
      Seung-Il Cho, Takumi Negishi, Muneki Yasuda and Michio Yokoyama
    • Organizer
      the 30th International Conference on Computer Applications in Industry and Engineering (CAINE2017)
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A fast test method for noise robustness of deep neural networks2017

    • Author(s)
      Muneki Yasuda, Hironori Sakata, Seung-Il Cho, Tomochika Harada, Atushi Tanaka, and Michio Yokoyama
    • Organizer
      the 2017 International Symposium on Nonlinear Theory and its Applications (NOLTA2017)
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Analysis of Social Networks and its Evaluation using Big Data Analyzing Technique2017

    • Author(s)
      Atsushi Tanaka, Seung-Il Cho, Muneki Yasuda, Tomochika Harada and Michio Yokoyama
    • Organizer
      the 2017 International Symposium on Nonlinear Theory and its Applications (NOLTA2017)
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Evaluation of Sleep Quality Based on Environmental and Vital Sensor Signals using Big Data Analysis and Deep Learning2017

    • Author(s)
      Minami Tsuchiya, Atsushi Tanaka, Muneki Yasuda, Tomochika Harada and Michio Yokoyama
    • Organizer
      the 2017 International Symposium on Nonlinear Theory and its Applications (NOLTA2017)
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Multiple Sensor Data Acquisition System using Commonly Available Sensor Devices for Sleep and Car Conditions2017

    • Author(s)
      Tomochika Harada, Michio Yokoyama, Seung-Il Cho, Atsushi Tanaka, and Muneki Yasuda
    • Organizer
      the 2017 International Symposium on Nonlinear Theory and its Applications (NOLTA2017)
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] レプリカ法を用いたクラス分類システムのノイズ耐性検査アルゴリズム2017

    • Author(s)
      安田宗樹
    • Organizer
      日本物理学会 2017年秋季大会
    • Related Report
      2017 Annual Research Report
  • [Presentation] ディープラーニングとパターン認識、最先端の人工知能へ2017

    • Author(s)
      安田宗樹
    • Organizer
      株式会社トリケップスセミナー
    • Place of Presentation
      オームビル
    • Related Report
      2016 Research-status Report
    • Invited
  • [Presentation] Approximate techniques for Boltzmann machines2016

    • Author(s)
      Muneki Yasuda
    • Organizer
      The fifth International Conference on Continuous Optimization
    • Place of Presentation
      National Graduate Institute for Policy Studies
    • Year and Date
      2016-08-06
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] Relationship between PreTraining and Maximum Likelihood Estimation in Deep Boltzmann Machines2016

    • Author(s)
      Muneki Yasuda
    • Organizer
      The 19th International Conference on Artificial Intelligence and Statistics
    • Place of Presentation
      Parador Hotel (スペイン)
    • Year and Date
      2016-05-09
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] Effective Learning Algorithms for Boltzmann Machines2016

    • Author(s)
      Muneki Yasuda
    • Organizer
      Probabilistic Graphical Model Workshop: Sparsity, Structure and High-dimensionality
    • Place of Presentation
      統計数理研究所
    • Year and Date
      2016-03-24
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] ディープラーニングの基礎と実践-データサイエンスの今2016

    • Author(s)
      安田宗樹
    • Organizer
      株式会社日本テクノセンター(JTC)セミナー
    • Place of Presentation
      日本テクノセンター研修室
    • Year and Date
      2016-03-23
    • Related Report
      2015 Research-status Report
    • Invited
  • [Presentation] 平均場近似を用いた Gaussian-Bernoulli restricted Boltzmann machine の推定アルゴリズム2016

    • Author(s)
      高橋茶子,安田宗樹
    • Organizer
      日本物理学会 第71回年次大会
    • Place of Presentation
      東北学院大学
    • Year and Date
      2016-03-22
    • Related Report
      2015 Research-status Report
  • [Presentation] 適応 TAP 近似 を用いたガウス型制限ボルツマンマシンの学習2016

    • Author(s)
      高橋茶子,安田宗樹
    • Organizer
      情報処理学会 第78回全国大会
    • Place of Presentation
      慶応大学
    • Year and Date
      2016-03-10
    • Related Report
      2015 Research-status Report
  • [Presentation] 確率的深層学習の基礎数理-深層ボルツマンマシンの真相に迫る-2016

    • Author(s)
      安田宗樹
    • Organizer
      情報数物研究会(兼 通研講演会)
    • Place of Presentation
      東北大学
    • Year and Date
      2016-01-25
    • Related Report
      2015 Research-status Report
    • Invited
  • [Presentation] 制限ボルツマンマシン-深層学習の足場2016

    • Author(s)
      安田宗樹
    • Organizer
      情報数理工学セミナー
    • Place of Presentation
      電気通信大学
    • Related Report
      2016 Research-status Report
    • Invited
  • [Presentation] ディープラーニングとは何か?2016

    • Author(s)
      安田宗樹
    • Organizer
      ネットワークが創発する知能研究会
    • Place of Presentation
      日本大学
    • Related Report
      2016 Research-status Report
    • Invited
  • [Presentation] ディープラーニングの基礎知識-最新の人工知能のタネ明かし2016

    • Author(s)
      安田宗樹
    • Organizer
      株式会社情報機構セミナー
    • Place of Presentation
      東京大井町きゅりあん
    • Related Report
      2016 Research-status Report
    • Invited
  • [Presentation] ディープラーニングの基礎と実践-DNNとCNNの仕組みと実践例2016

    • Author(s)
      安田宗樹
    • Organizer
      株式会社日本テクノセンター(JTC)セミナー
    • Place of Presentation
      日本テクノセンター研修室
    • Related Report
      2016 Research-status Report
    • Invited
  • [Presentation] 深層ボルツマン入門2015

    • Author(s)
      安田宗樹
    • Organizer
      utorial of Markov Random Field Modeling 2015
    • Place of Presentation
      早稲田大学
    • Year and Date
      2015-11-12
    • Related Report
      2015 Research-status Report
    • Invited
  • [Presentation] An Effective Algorithm for Boltzmann Machine Learning2015

    • Author(s)
      Muneki Yasuda
    • Organizer
      International Workshop on Innovative Algorithms for Big Data
    • Place of Presentation
      京都テルサ
    • Year and Date
      2015-09-18
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] Gaussian-Bernoulli restricted Boltzmann machineに対する平均場近似2015

    • Author(s)
      高橋茶子,安田宗樹
    • Organizer
      第14回科学技術フォーラム
    • Place of Presentation
      愛媛大学
    • Year and Date
      2015-09-17
    • Related Report
      2015 Research-status Report
  • [Presentation] ディープボルツマンマシン入門2015

    • Author(s)
      安田宗樹
    • Organizer
      電子情報通信学会北陸支部講演会
    • Place of Presentation
      金沢大学
    • Year and Date
      2015-09-07
    • Related Report
      2015 Research-status Report
    • Invited
  • [Presentation] ディープラーニングの基礎と活用のポイントおよび人工知能の最新技術2015

    • Author(s)
      安田宗樹
    • Organizer
      株式会社日本テクノセンター(JTC)セミナー
    • Place of Presentation
      日本テクノセンター研修室
    • Year and Date
      2015-07-02
    • Related Report
      2015 Research-status Report
    • Invited
  • [Book] 深層学習: Deep Learning2015

    • Author(s)
      安田宗樹(分担執筆:第2章担当)
    • Total Pages
      267
    • Publisher
      近代科学社
    • Related Report
      2015 Research-status Report
  • [Remarks] Muneki Yasuda's Home Page

    • URL

      http://www.adv-pip.yz.yamagata-u.ac.jp/~muneki/index.html

    • Related Report
      2017 Annual Research Report
  • [Remarks] Muneki Yasuda's Home Page

    • URL

      http://www.adv-pip.yz.yamagata-u.ac.jp/~muneki/

    • Related Report
      2016 Research-status Report

URL: 

Published: 2015-04-16   Modified: 2019-03-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi