• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Dynamics of Module-Based Artificial Neural Networks

Research Project

Project/Area Number 12680403
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field Intelligent informatics
Research InstitutionRyukoku University

Principal Investigator

TSUTSUMI Kazuyoshi  Ryukoku University, Department of Mechanical and Systems Engineering, Professor, 理工学部, 教授 (30197735)

Project Period (FY) 2000 – 2002
Project Status Completed (Fiscal Year 2002)
Budget Amount *help
¥3,400,000 (Direct Cost: ¥3,400,000)
Fiscal Year 2002: ¥600,000 (Direct Cost: ¥600,000)
Fiscal Year 2001: ¥2,100,000 (Direct Cost: ¥2,100,000)
Fiscal Year 2000: ¥700,000 (Direct Cost: ¥700,000)
Keywordsneural network / dynamics / mapping / relaxation / module structure / hopfield / back-propagation / warped space / 冗長性 / モジュール / ミニマム / アトラクタ / 最適化問題
Research Abstract

Some biologically-plausible fundamental principles for neural networks were proposed so far; among them, "mapping" and "relaxation" are important. If both the mapping and the relaxation are reasonable and really exist in a biological brain, it is natural to consider that they work separately but they function cooperatively in a higher framework. In order to investigate the possibility of the higher framework, we tried to propose new models of module-based artificial neural networks and grasp the dynamical properties of the network.
In general, static neurons generate the mapping function and dynamical neurons do the relaxation. According to this idea, as a goal, we proposed a module-based neural network composed of static and dynamical neurons, and discussed what effect can be produced by the integration of mapping and relaxation. The proposed network can be obtained when a specially-designed total energy function is minimized. Although the derivation process is similar to the case of t … More he well-known Hopfield network, state variables in the network include, in addition to the output and the potential of dynamical neurons, another type of state variable converted from the direct output of dynamical neurons using a mapping function. If we suppose a layered network with only static neurons corresponding to the mapping function, the layered network comprises a forward subnet and a backward subnet; connection weights in the forward and backward subnets are modified based on propagated error signals through the backward subnet, and, at the same time, the final output of the backward subnet is utilized for overall network-dynamics.
As a result, the proposed network offers a higher framework in which relaxation can be carried out in a warped space due to the cooperation of static and dynamical neurons. Furthermore, it gives an interpretation for the back propagated error signals in the case of delta-rule based learning; although the backward subnet for calculating the delta values is usually assumed to be virtual, it must actually exist for network relaxation in the proposed network. Less

Report

(4 results)
  • 2002 Annual Research Report   Final Research Report Summary
  • 2001 Annual Research Report
  • 2000 Annual Research Report
  • Research Products

    (18 results)

All Other

All Publications (18 results)

  • [Publications] 小澤誠一, 堤 一義, 馬場則夫: "遺伝的アルゴリズムを用いたモジュール型動的ニュートラルネットの構造決定法"計測自動制御学会論文誌. 36. 298-305 (2000)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] K.Tsutsumi, K.Nakajima: "Dynamics and Local Minima of a Simple Neural Network for Optimization"Proc. of International Joint (IEEE/INNS) Conference on Neural Networks (IJCNN-2001). 353-358 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] K.Tsutsumi: "Module-Based Neural Architecture : Some Effects by the Cooperation of Static and Dynamical Neurons"Fifth International Conference on Knowledge-Based Intelligent Information Engineering Systems & Allied Technologies (KES-2001). 293-297 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Y.Kusano, K.Tsutsumi: "Hopping Height Control of an Active Suspension Type of Leg Module Based on Reinforcement Learning and a Neural Network"2002 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS-2002). 2672-2677 (2002)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] K.KANO, S.Kitayama, N.Yamamoto, K.Tsutsumi: "Design and Prototype of a Remote Arm-Wrestling System"2002 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS-2002). 2985-2990 (2002)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] K.Tsutsumi: "Relaxing in a Warped Space : An Effect Due to the Cooperation of Static and Dynamical Neurons"Proc. of International Joint (IEEE/INNS) Conference on Neural Networks (IJCNN-2003). (印刷中). (2003)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Seiichi Ozawa, Kazuyoshi Tsutsumi & Norio Baba: "An Architecture Design Method of Modular Dynamical Neural Networks Using Genetic Algorithms (in Japanese)"Trans. Of the Society of Instrument and Control Engineers. Vol. 36, No. 3. 298-305 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Kazuyoshi Tsutsumi & Kazuo Nakajima: "Dynamics and Local Minima of a Simple Neural Network for Optimization"Proc. Of International Joint (IEEE/INNS) Conference on Neural Networks (IJCNN-2001). 353-358 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Kazuyoshi Tsutsumi: "Module-Based Neural Architecture: Some Effects by the Cooperation of Static and Dynamical Neurons"Fifth International Conference on Knowledge-Based Intelligent Information Engineering Systems & Allied Technologies (KES-2001). 293-297 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Yoshinori Kusano & Kazuyoshi Tsutsumi: "Hopping Height Control of an Active Suspension Type of Leg Module Based on Reinforcement Learning and a Neural Network"2002 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS-2002). 2672-2677 (2002)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Kunihiko Kano, Shinya Kitayama, Naoki Yamamoto & Kazuyoshi Tsutsumi: "Design and Prototype of a Remote Arm-Wrestling System"2002 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS-2002). 2986-2990 (2002)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Kazuyoshi Tsutsumi: "Relaxing in a Warped Space: An Effect Due to the Cooperation of Static and Dynamical Neurons"Proc. Of International Joint (IEEE/INNS) Conference on Neural Networks (IJCNN-2003). (in printing). (2003)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Y.Kusano, K.Tsutsumi: "Hopping Height Control of an Active Suspension Type of Leg Module Based on Reinforcement Learning and a Neural Network"Proc. of 2002 IEEE/RSJ International Conference on Intelligent Robots and Systems. 2672-2677 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] K.Kano, S.Kitayama, N.Yamamoto, K.Tsutsumi: "Design and Prototype of a Remote Arm-Wrestling System"Proc. of 2002 IEEE/RSJ International Conference on Intelligent Robots and Systems. 2985-2990 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] K.Tsutsumi: "Relaxing in a Warped Space : An Effect Due to the Cooperation of Static and Dynamical Neurons"Proc. of International Joint Conference on Neural Networks(IEEE/INNS). (印刷中).

    • Related Report
      2002 Annual Research Report
  • [Publications] Kazuyoshi TSUTSUMI, Kazuo NAKAJIMA: "Dynamics and Local Minima of a Simple Neural Network for Optimization"Proc. of International Joint (IEEE/INNS) Conference on Neural Networks (IJCNN-2001). 353-358 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] Kazuyoshi TSUTSUMI: "Module-Based Neural Architecture : Some Effects by the Cooperation of Static and Dynamical Neurons"Fifth International Conference on Knowledge-Based Intelligent Information Engineering Systems & Allied Technologies. 293-297 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] K.Tsutsumi,K.Nakajima: "Dynamics and Local Minima of a Simple Neural Network for Optimization"Proc. of International Conference on Neural Networks (IJCNN'01-WashingtonDC). (予定). (2001)

    • Related Report
      2000 Annual Research Report

URL: 

Published: 2000-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi