• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

A NEURON-MOS NEURAL NETWORK FEATURING ON-CHIP SELF-LEARNING CAPABILITY

Research Project

Project/Area Number 05505003
Research Category

Grant-in-Aid for Developmental Scientific Research (A)

Allocation TypeSingle-year Grants
Research Field Electronic materials/Electric materials
Research InstitutionTOHOKU UNIVERSITY

Principal Investigator

SHIBATA Tadashi  Associate Professor, Dept.Electric Engineering Tohoku University, 工学部, 助教授 (00187402)

Co-Investigator(Kenkyū-buntansha) MORITA Mizuho  Associate Professor, Graduate School of Information Sciences Tohoku University, 大学院情報科学研究科, 助教授 (50157905)
OHMI Tadahiro  Professor, Dept.Electric Engineering Tohoku University, 工学部, 教授 (20016463)
Project Period (FY) 1993 – 1994
Project Status Completed (Fiscal Year 1994)
Budget Amount *help
¥32,900,000 (Direct Cost: ¥32,900,000)
Fiscal Year 1994: ¥10,100,000 (Direct Cost: ¥10,100,000)
Fiscal Year 1993: ¥22,800,000 (Direct Cost: ¥22,800,000)
KeywordsNEURAL NETWORK / SELF LEARNING / HARDWARE LEARNING / NEURON MOS TRANSISTOR / SYNAPSE / EEPROM / BACK PROPAGATION / GENERALIZATION / 学習アルゴリズム / ヘブルール / 自己学習 / アナログニューラルネットワーク / フローティングゲート / ハードウェア学習アルゴリズム
Research Abstract

Neural network hardware having an on-chip self-learning capability has been developed using a high-functionality device called Neuron MOS Transistor (vMOS) as a key circuit element. A vMOS can perform weighted summation of multiple input signals and thresholding all at a single transistor level based the charge sharing among multiple capacitors. An electronic synapse cell been constructed with six transistors by merging a floating-gate EEPROM memory cell into a new-concept vMOS differential-source-follower circuitry. The synapse can represent both positive (excitatory) and negative (inhibitory) weights under single V_<DD> power supply and is free from standby power dissipation. An excellent linearity in the weight updating characteristics of the synapse memory has been also established by employing a simple self-feedback regime in each cell circuitry, thus making in fully compatible to the on-chip self-learning architecture of vMOS neural networks. A new hardware-oriented learning algorithm called Hardware Backpropagation (HBP) has been developed by simplifyng and modifying the original Backpropagation (BP) algorithm. As a result, all learning actions are controlled by only digital signals with simple on-chip digital circuitry, thus enabling the direct implementation of the learning algorithm on the chip. The analog nature of the learning control is created by vMOS circuit technology. A new concept of "learning enhancement" has been introduced in order to guarantee the long-term stability of the learned state of analog neural networks. After optimization of the circuit parameters by extensive computer simulation, it has been demonstrated that HBP is superior to original BP both in the learning performance and in the generalization capability. The basic operation of the vMOS neural network having all above features has been experimentally verified using test circuits fabricated by a double-polysilicon CMOS process.

Report

(3 results)
  • 1994 Annual Research Report   Final Research Report Summary
  • 1993 Annual Research Report
  • Research Products

    (40 results)

All Other

All Publications (40 results)

  • [Publications] H.Ishii: "Hardware-learning meural metwork LSI Using a highly functional transistor simulating neuron actions" Proc.Internationsl Joint Conference on Neura Networks. 907-910 (1993)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] H.Kosaka: "An excellent weight-up dating-linearity synapse memory cell for self-learning neuron MOS neural networks"

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] International Electron Devices meeting (IEDM) Technical Digest. 623-626 (1993)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] T.Shibata: "Implementing Intelligence on Silicon using Neuron-like functional MOS transistors" Proc.7th Conference on Neural Information Processing Systems : Natural and Synthetic,(NIPS'93). (1994)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] H.Ishii: "An experimontal neuron MOS neural network chip featuring onchip self-learning circuitry and Low-power synapse cells" Proc.International Conferanee on Advanced Microelectronic Devies and Processing. 641-646 (1994)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] T.Shibata: "Hardware Implementation of Intelligence on silicon using four-terminal devices" Proc.International Conference an Advanced Microelectronic Deviees and Processing. 743-750 (1994)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] T.Ohmi: "The concept of bour-terminal-device and its significance in the implementation of intelligent electronic circuits" IEICE Transactions in Electronics. (1994)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] T.Shibata: "A NeuronMOS Neural Network UsingLow-Power Self-Learning Compatible Synapes Cells" Ext.Abstracts,1994 Int.Conf.Solid State Devices. 346-348 (1994)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] H.Ishii: "Hardware-Oriented Learning Algorithm Implemented on Silicon Using Neuron MOS Technology" Ext.Abstracts,1994 Int.Cnf.Conf.Solid State Devices and Materials,Yokshama. 382-384 (1994)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] S.Kondo: "Superior Generalization characteristics of NueronMOS Nueral Networks in Mirror-Symmetry Problem Learning" Ext.Abstracts,1994 Int.Conf.Solid state Devices and Materials,Yokohama. 385-387 (1994)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] H.Kosaka: "An Excellent Weiglot-Updating-Linearity EEPROM Synapse Memory Cell for Self-Learning Neuron-MOS Neural Networks" IEEE Trans.Electron Devices. 42. 135-143 (1995)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] T.Shibata: "A Neuron-MOS Neural Network using self-Learning Compatible Synapse Circuits" IEEE Journal of Solid State Circuits. 30(8月号に出版予定). (1995)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] Tadashi Shibata, Hideo Kosaka, Hiroshi Ishii, and Tadahiro Ohmi: "A neuron MOS neural network using self-learnig-compatible synapse circuits" IEEE J.Solid State Circuits. (accepted for publication).

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] T.Shibata, H.Kosaka, H.Ishii, and T.Ohmi: "A neuron-MOS neural network using low-power self-learning-compatible synapse cells" Extended Abstact, 1994 International Conference on Solid State Devices and Materials, Yokohama, August. 23-26. 346-348 (1994)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] H.Ishii, T.Shibata, H.Kosaka, and T.Ohmi: "An experimental Neuron-MOS neural network chip featuring on-chip self-learning. circuitry and low-power synapse cells" the Proc.Int.Conf.Advanced Microolectronic Devices and Processing, Sendai, March 3-5. 641-646 (1994)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] Hiroshi Ishii, Tadashi Shibata, Hideo Kosaka, and Tadahiro Ohmi: "Hardware learning neural network LSI using a highly functional transistor simulating neuron actions" Proceedings of the International Joint Conference on Neural Networks (IJCNN'93), Nagoya, October. 907-910 (1993)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] Hideo Kosaka, Tadashi Shibata, Hiroshi Ishii, and Tadahiro Ohmi: "An excellent weight-updating-linearity EEPROM synapse memory cell for self-learning neuron-MOS neural networks" IEEE Trans.Electron Devices. Vol.42、No.1. 135-143 (1995)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] Hideo Kosaka, Tadashi Shibata, Hiroshi Ishii, and Tadahiro Ohmi: "An excellent weight-updating-linearity synapse memory cell for self-learning neuron MOS neural networks" Technical Digest, International electron Devices Meeting (IDEM) 1993, Washington D.C., December. 623-626 (1993)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] Hiroshi Ishii, Tadashi Shibata, and Tadahiro Ohmi: "Hardware self-learning algorithm directly implemented on silicon using-MOS technology" IEEE J.Solid State Circuits. (submitted).

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] H.Ishii, T.Shibata, and T.Ohmi: "Hardware-oriented learning algorithm implemented on silicon using neuron MOS technology" Extended Abstact, 1994 International Conference on Solid State Devices and Materials, Yokohama, August 23-26. (1994)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] Shuhei Kondo, Tadashi Shibata, and Tadahiro Ohmi: "Superior generalization capability of hardware-learning algorithm developed for self-learning neuron MOS neural networks" Jpn.J.Appl.Phys.Vol.34. 1066-1069

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] S.Kondo, T.Shibata, and T.Ohmi: "Extended Abstract, 1994 International Conference on Solid State Dcvices and Materials, Yokohama, August 23-26" 385-387 (1994)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] Tadashi Shibata, Koji Kotani, Takeo Yamashita, Hiroshi Ishii, Hideo Kosaka, and Tadahiro Ohmi: "Implement intelligence on sillicon using neuron-like functional MOS transistors" Advances in Neural Information Processing Systems 6 (The Proceedings of 7th Conf.Neural Information Processing Systems : Natural and Synthetic, 1993 (NIPS'93), Denver, November (1993) Eds.J.D.Cowan, G.Tesauro, and J.Alspector, (Morgan Kaufmann Publishers, San Francisco). 919-926 (1994)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] H.Ishii: "Hardware-learning neural netwark LSI using a highly functional transistor simulating neuron actions" Proc.International Joint Conference on Neural Networks'93,Nagoya. 907-910 (1993)

    • Related Report
      1994 Annual Research Report
  • [Publications] H.Kosaka: "An excellent weight-updating-linearity synapse memory eell for self-learning neuron MOS neural networks" International Electron Devices meeting(IEDM)Technical Digest. 623-626 (1993)

    • Related Report
      1994 Annual Research Report
  • [Publications] T.Shibata: "Implementing Intelligence on Silicon using Neuron-like functional MOS transistors" Proc.7th Conference on Neural Information Processing Systemo:Natural and Synthetic,(NIPS'93). 919-926 (1994)

    • Related Report
      1994 Annual Research Report
  • [Publications] H.Ishii: "An experimontal neuron MOS neural network chip featuring onchip self-learning circuitry and low-power synapse cells" Proc.International conference on Advanced Microelectronic Deviees and Processing. 641-646 (1994)

    • Related Report
      1994 Annual Research Report
  • [Publications] T.Shibata: "Hardware Implementation of Intelligence on silicon using four-terminal devices" Proc.International conference on Advanced Microelectronic Deviees and Processing. 743-750 (1994)

    • Related Report
      1994 Annual Research Report
  • [Publications] T.Ohmi: "The concept of four-terminal-device and its significance in the implementation of intelligent electronic circuits" IEICE Transactions in Electronics. 1032-1041 (1994)

    • Related Report
      1994 Annual Research Report
  • [Publications] T.Shibata: "A Neuron MOS Neural Network Using Low-Power Self-Learning Compatible Synapse Cells" Ext.Abstracts,1994 Int.Conf.Solid State Devices and materials Yokohama. 346-348 (1994)

    • Related Report
      1994 Annual Research Report
  • [Publications] H.Ishii: "Hardware-Oriented Learning Algorithm Implemonted on Silicon Using Neuron MOS Technology" Ext.Abstracts,1994 Int.Conf.Solid State Devices and materials Yokohama. 382-384 (1994)

    • Related Report
      1994 Annual Research Report
  • [Publications] S.Kondo: "Superior Generalization Characteristics of Neuron-Mos Neural Networks in Mirror-Symmetry Problem Learning" Ext.Abstraets,1994 Int.Conf.Solid State Devices and materials,Yokohama. 385-387 (1994)

    • Related Report
      1994 Annual Research Report
  • [Publications] H.Kosaka: "An Excellent Weight-updating-Linearity EEPROM Synapse Memory cell for Self-Learning Neuron-MOS Neural Networks" IEEE Trans.Electron Devices. 42. 135-143 (1995)

    • Related Report
      1994 Annual Research Report
  • [Publications] T,shibata: "A Neuron-MOS Neural Network using self-learning compatible Synapse Circuits" IEEE Journal of Solid state Circuits. (印刷中).

    • Related Report
      1994 Annual Research Report
  • [Publications] H.Ishii: "Hardware-learning neural network LSI using a highly functional transistor simulating neuron actions" Proc.International Joint Conference on Neural Networks '93,Nagoya. 907-910 (1993)

    • Related Report
      1993 Annual Research Report
  • [Publications] H.Kosaka: "An excellent weight-updating-linearity synapse memory cell for self-learning neuron MOS neural networks" International Electron Devices meeting(IEDM)Technical Digest. 623-626 (1993)

    • Related Report
      1993 Annual Research Report
  • [Publications] T.Shibata: "Implementing Intelligence on Silicon using Neuron-like functional MOS transistors" Proc.7th Conference on Neural Information Processing Systems:Natural and Synthetic,(NIPS'93). (1994)

    • Related Report
      1993 Annual Research Report
  • [Publications] H.Ishii: "An experimental neuron MOS neural network chip featuring on-chip self-learning circuitry and low-power synapse cells" Proc.International Conference on Advanced Microelectronic Devices and Processing. 641-646 (1994)

    • Related Report
      1993 Annual Research Report
  • [Publications] T.Shibata: "Hardware Implementation of Intelligence on silicon using four-terminal devices" Proc.International Conference on Advanced Microelectronic Devices and Processing. 743-750 (1994)

    • Related Report
      1993 Annual Research Report
  • [Publications] T.Ohmi: "The concept of four-terminal-device and its significance in the implementation of intelligent electronic circuits" IEICE Transactions in Electronics. (印刷中). (1994)

    • Related Report
      1993 Annual Research Report

URL: 

Published: 1993-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi