• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Robust training based on combined online/batch training techniques

Research Project

Project/Area Number 23500189
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Research Field Intelligent informatics
Research InstitutionShonan Institute of Technology

Principal Investigator

HIROSHI Ninomiya  湘南工科大学, 工学部, 教授 (60308335)

Co-Investigator(Renkei-kenkyūsha) KOBAYASHI Manabu  湘南工科大学, 工学部, 教授 (80308204)
Project Period (FY) 2011 – 2013
Project Status Completed (Fiscal Year 2013)
Budget Amount *help
¥3,770,000 (Direct Cost: ¥2,900,000、Indirect Cost: ¥870,000)
Fiscal Year 2013: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2012: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Fiscal Year 2011: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Keywordsニューラルネットワーク / 学習アルゴリズム / 準ニュートン法 / オンライン学習 / バッチ学習 / 並列アルゴリズム / オンライン学習法 / バッチ学習法
Research Abstract

In this research, it is a purpose to enable the approximation model by the feedforward neural networks for the function or the system with the highly nonlinear behavior by the following studies. Specifically, "Proposal of a novel training algorithm using combined online/batch quasi-Newton techniques", and "Analysis on the robustness of the proposed algorithm". Here, robustness in this research means that the proposed algorithm has strong ability to search a global minimum without being trapped into local minimum. Furthermore, this approach is useful for the circuit modeling for the design and optimization, where analytical formulas are not available or original model is computationally too expensive. A neural model is trained once, and can be used again and again. This avoids repetitive circuit simulations where a change in the physical dimension requires a re-simulation of the circuit structure.

Report

(4 results)
  • 2013 Annual Research Report   Final Research Report ( PDF )
  • 2012 Research-status Report
  • 2011 Research-status Report
  • Research Products

    (36 results)

All 2014 2013 2012 2011 Other

All Journal Article (20 results) (of which Peer Reviewed: 19 results) Presentation (15 results) Remarks (1 results)

  • [Journal Article] Reconfigurable Circuit Design based on Arithmetic Logic Unit Using Double-Gate CNTFETs2014

    • Author(s)
      Ninomiya, H., Kobayashi, M., Miura, Y . and Watanabe S
    • Journal Title

      IEICE Trans. on Fundamentals

      Volume: vol.E97-A,no.2 Pages: 675-678

    • NAID

      130003394763

    • Related Report
      2013 Final Research Report
    • Peer Reviewed
  • [Journal Article] Reconfigurable Circuit Design based on Arithmetic Logic Unit Using Double-Gate CNTFETs2014

    • Author(s)
      Hiroshi Ninomiya, Manabu Kobayashi, Yasuyuki Miura and Shigeyoshi Watanabe
    • Journal Title

      IEICE Trans. on Fundamentals.

      Volume: E97-A Pages: 675-678

    • NAID

      130003394763

    • Related Report
      2013 Annual Research Report
    • Peer Reviewed
  • [Journal Article] DRDLC Generating t-Term Boolean Functions Based on DG-CNTFETs2014

    • Author(s)
      Manabu Kobayashi, Hiroshi Ninomiya, Yasuyuki Miura and Shigeyoshi Watanabe
    • Journal Title

      Proc. 2014 RISP International Workshop on Nonlinear Circuits, Communications and Signal Processing

      Volume: 1 Pages: 81-84

    • Related Report
      2013 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Reduced Reconfigurable Logic Circuit Design based on Double Gate CNTFETs using Ambipolar Binary Decision Diagram2013

    • Author(s)
      Ninomiya, H., Kobayashi, M. and Watanabe S
    • Journal Title

      IEICE Trans. on Fundamentals

      Volume: vol.E96-A,no.1 Pages: 356-359

    • NAID

      10031167126

    • Related Report
      2013 Final Research Report
    • Peer Reviewed
  • [Journal Article] A Linear Time ADMM Decoding for LDPC Codes over MIMO Channels2013

    • Author(s)
      Kobayashi, M., Ninomiya, H., Matsushima, T ., and Hirasawa, S
    • Journal Title

      Proc. 2013 RISP International Workshop on Nonlinear Circuits, Communications and Signal Processing (NCSP'13)

      Pages: 185-188

    • Related Report
      2013 Final Research Report
    • Peer Reviewed
  • [Journal Article] Dynamic Sample Size Selection based quasi-Newton Training for Highly Nonlinear Function Approximation using Multilayer Neural Networks2013

    • Author(s)
      Ninomiya, H
    • Journal Title

      Proc. IEEE&INNS/IJCNN'13

      Pages: 1932-1937

    • Related Report
      2013 Final Research Report
    • Peer Reviewed
  • [Journal Article] Dynamic Sample Size Selection based quasi-Newton Training for Highly Nonlinear Function Approximation using Multilayer Neural Networks2013

    • Author(s)
      Hiroshi Ninomiya
    • Journal Title

      Proc. IEEE&INNS/IJCNN'13

      Volume: 1 Pages: 1932-1937

    • Related Report
      2013 Annual Research Report
    • Peer Reviewed
  • [Journal Article] A Linear Time ADMM Decoding for LDPC Codes over MIMO Channels2013

    • Author(s)
      M. Kobayashi, H. Ninomiya,, T. Matsushima, and S. Hirasawa
    • Journal Title

      Proc. 2013 RISP International Workshop on Nonlinear Circuits, Communications and Signal Processing

      Volume: 1 Pages: 185-188

    • Related Report
      2012 Research-status Report
    • Peer Reviewed
  • [Journal Article] パラメータ化オンライン準ニュートン法による階層型ニューラルネットワークの学習2012

    • Author(s)
      二宮 洋
    • Journal Title

      信学論 A

      Volume: vol.J95-A,no.8 Pages: 698-703

    • NAID

      110009489990

    • Related Report
      2013 Final Research Report
    • Peer Reviewed
  • [Journal Article] 階層型ニューラルネットワークの学習に対する online/batch ハイブリッド型準ニュー トン法の有効性に関する研究2012

    • Author(s)
      阿倍俊和, 坂下善彦, 二宮 洋
    • Journal Title

      Journal of Signal Processing

      Volume: vol.16,no.5 Pages: 451-458

    • NAID

      130004457037

    • Related Report
      2013 Final Research Report
    • Peer Reviewed
  • [Journal Article] An Error Probability Estimation of the Document Classification Using Markov Model2012

    • Author(s)
      Kobayashi, M., Ninomiya, H., Matsushima, T ., and Hirasawa, S
    • Journal Title

      Proc. 2012 International Symposium on Information Theory and its Applications (ISITA'12)

      Pages: 712-716

    • Related Report
      2013 Final Research Report
    • Peer Reviewed
  • [Journal Article] パラメータ化オンライン準ニュートン法による階層型ニューラルネットワークの学習2012

    • Author(s)
      二宮 洋
    • Journal Title

      信学論A

      Volume: vol.J95-A, no.8 Pages: 698-703

    • NAID

      110009489990

    • Related Report
      2012 Research-status Report
  • [Journal Article] 階層型ニューラルネットワークの学習に対するonline/batch ハイブリッド型準ニュートン法の有効性に関する研究2012

    • Author(s)
      阿倍俊和,坂下善彦,二宮 洋
    • Journal Title

      Journal of Signal Processing

      Volume: vol.16, no.5 Pages: 451-458

    • NAID

      130004457037

    • Related Report
      2012 Research-status Report
    • Peer Reviewed
  • [Journal Article] Robust Training of Feedforward Neural Networks using Combined Online/Batch quasi-Newton Techniques2012

    • Author(s)
      Hiroshi Ninomiya
    • Journal Title

      Lecture Notes in Computer Science(Proc. 2012 International Conference on Artificial Neural Networks)

      Volume: vol.7553 Pages: 74-83

    • Related Report
      2012 Research-status Report
    • Peer Reviewed
  • [Journal Article] An Error Probability Estimation of the Document Classification Using Markov Model2012

    • Author(s)
      M. Kobayashi, H. Ninomiya,, T. Matsushima, and S. Hirasawa
    • Journal Title

      Proc. 2012 International Symposium on Information Theory and its Applications

      Volume: 1 Pages: 712-716

    • Related Report
      2012 Research-status Report
    • Peer Reviewed
  • [Journal Article] Parameterized Online quasi-Newton Training for High-Nonlinearity Function Approximation using Multilayer Neural Networks2011

    • Author(s)
      Ninomiya, H
    • Journal Title

      Proc. IEEE&INNS/IJCNN'11

      Pages: 2770-2777

    • Related Report
      2013 Final Research Report
    • Peer Reviewed
  • [Journal Article] Microwave Neural Network Models Using Improved Online quasi-Newton Training Algorithm2011

    • Author(s)
      Ninomiya, H
    • Journal Title

      Journal of Signal Processing

      Volume: vol.15,no.6 Pages: 483-488

    • NAID

      40019081817

    • Related Report
      2013 Final Research Report
    • Peer Reviewed
  • [Journal Article] Parameterized Online quasi-Newton Training for High-Nonlinearity Function Approximation using Multilayer Neural Networks2011

    • Author(s)
      Hiroshi Ninomiya
    • Journal Title

      Proc. IEEE&INNS/IJCNN'11

      Volume: 1 Pages: 2770-2777

    • Related Report
      2011 Research-status Report
    • Peer Reviewed
  • [Journal Article] Microwave Neural Network Models Using Improved Online quasi-Newton Training Algorithm2011

    • Author(s)
      Hiroshi Ninomiya
    • Journal Title

      Journal of Signal Processing

      Volume: 15 Pages: 483-488

    • NAID

      40019081817

    • Related Report
      2011 Research-status Report
    • Peer Reviewed
  • [Journal Article] Robust Training of Multilayer Neural Networks using Parameterized Online quasi-Newton Algorithm2011

    • Author(s)
      Hiroshi Ninomiya
    • Journal Title

      Proc. IEEE/ICMLA'11

      Volume: 1 Pages: 311-316

    • Related Report
      2011 Research-status Report
    • Peer Reviewed
  • [Presentation] 寿命付きリーダーを用いたローカル粒子群最適化についての研究2014

    • Author(s)
      佐伯 誠,坂下善彦,二宮 洋
    • Organizer
      情報処理学会 第76回 全国大会
    • Place of Presentation
      東京電機大学
    • Related Report
      2013 Annual Research Report
  • [Presentation] 分散並列環境における準ニュートン学習アルゴリズムの有効性2013

    • Author(s)
      佐伯 誠, 坂下善彦, 二宮 洋
    • Organizer
      電子情報通信学会信学技報 非線形問題研究会
    • Related Report
      2013 Final Research Report
  • [Presentation] Dynamic Sample Size Selection in Improved Online quasi-Newton Method for Robust Training of Feedforward Neural Networks2013

    • Author(s)
      Ninomiya, H
    • Organizer
      The Fifth International Conference on Advanced Cognitive T echnologies and Applications (COGNITIVE2013)
    • Related Report
      2013 Final Research Report
  • [Presentation] 動的サンプルサイズ選択法に基づく準ニュートン法による階層型ニューラルネットワークの学習2013

    • Author(s)
      二宮 洋
    • Organizer
      電子情報通信学会 信学技報 非線形問題研究会
    • Related Report
      2013 Final Research Report
  • [Presentation] 改良型分散準ニュートン法によるニューラルネットワークの学習2013

    • Author(s)
      佐伯 誠, 坂下善彦, 二宮 洋
    • Organizer
      電子情報通信学会 基礎・境界ソサイエティ大会
    • Related Report
      2013 Final Research Report
  • [Presentation] Dynamic Sample Size Selection in Improved Online quasi-Newton Method for Robust Training of Feedforward Neural Networks2013

    • Author(s)
      Hiroshi Ninomiya
    • Organizer
      The Fifth International Conference on Advanced Cognitive Technologies and Applications (COGNITIVE2013)
    • Place of Presentation
      Valencia, Spain
    • Related Report
      2013 Annual Research Report
  • [Presentation] 動的サンプルサイズ選択法に基づく準ニュートン法による階層型ニューラルネットワークの学習2013

    • Author(s)
      二宮 洋
    • Organizer
      電子情報通信学会 信学技報 非線形問題研究会
    • Place of Presentation
      宮古島
    • Related Report
      2013 Annual Research Report
  • [Presentation] 改良型分散準ニュートン法によるニューラルネットワークの学習2013

    • Author(s)
      佐伯 誠,坂下善彦,二宮 洋
    • Organizer
      電子情報通信学会 基礎・境界ソサイエティ大会
    • Place of Presentation
      福岡工業大学
    • Related Report
      2013 Annual Research Report
  • [Presentation] Online/Batch ハイブリット型準ニュートン法によるニューラルネットワークの学習アルゴリズム2012

    • Author(s)
      阿部俊和, 坂下善彦 , 二宮洋
    • Organizer
      情報処理学会第74回全国大会
    • Related Report
      2013 Final Research Report
  • [Presentation] MIMO 通信における相互情報量基準に基づく量子化器の設計法2012

    • Author(s)
      小林 学, 八木秀樹, 二宮 洋, 平澤茂一
    • Organizer
      電子情報通信学会 情報理論研究会 信学技報
    • Related Report
      2013 Final Research Report
  • [Presentation] Online/Batchハイブリット型準ニュートン法によるニューラルネットワークの学習アルゴリズム2012

    • Author(s)
      阿部俊和,坂下善彦,二宮 洋
    • Organizer
      情報処理学会 第74回 全国大会
    • Place of Presentation
      名古屋工業大学(名古屋市)
    • Related Report
      2011 Research-status Report
  • [Presentation] online/batch ハイブリッド型準ニュートン法による階層型ニューラルネットワークのロバスト学習に関する研究2011

    • Author(s)
      阿部俊和, 坂下善彦 , 二宮洋
    • Organizer
      電子情報通信学会 非線形問題研究会信学技報
    • Related Report
      2013 Final Research Report
  • [Presentation] online/batchハイブリッド型準ニュートン法による階層型ニューラルネットワークのロバスト学習に関する研究2011

    • Author(s)
      阿部俊和,坂下善彦,二宮 洋
    • Organizer
      電子情報通信学会 非線形問題研究会
    • Place of Presentation
      沖縄県
    • Related Report
      2011 Research-status Report
  • [Presentation] MIMO通信における相互情報量基準に基づく量子化器の設計法

    • Author(s)
      小林 学,八木秀樹,二宮 洋,平澤茂一
    • Organizer
      電子情報通信学会 情報理論研究会
    • Place of Presentation
      草津セミナーハウス
    • Related Report
      2012 Research-status Report
  • [Presentation] 分散並列環境における準ニュートン学習アルゴリズムの有効性

    • Author(s)
      佐伯 誠,坂下善彦,二宮 洋
    • Organizer
      電子情報通信学会 非線形問題研究会
    • Place of Presentation
      北海道大学
    • Related Report
      2012 Research-status Report
  • [Remarks]

    • URL

      http://www.info.shonan-it.ac.jp/ninomiya-lab/ninomiya.html

    • Related Report
      2013 Final Research Report

URL: 

Published: 2011-08-05   Modified: 2019-07-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi