• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to project page

1993 Fiscal Year Final Research Report Summary

Research on Visual Pattern Recognition with Hierarchical Neural Networks

Research Project

Project/Area Number 02402035
Research Category

Grant-in-Aid for General Scientific Research (A)

Allocation TypeSingle-year Grants
Research Field 情報工学
Research InstitutionOsaka University

Principal Investigator

FUKUSHIMA Kunihiko  Osaka University, Faculty of Engineering Science, Professor, 基礎工学部, 教授 (90218909)

Co-Investigator(Kenkyū-buntansha) OKADA Masato  Osaka University, Faculty of Engineering Science, Research Associate, 基礎工学部, 助手 (90233345)
KURATA Koji  Osaka University, Faculty of Engineering Science, Lecturer, 基礎工学部, 講師 (40170071)
Project Period (FY) 1990 – 1993
Keywordsvisual pattern / neural network model / pattern recognition / visual pattern / handwritten character recognition / alphanumeric character recognition / recognition of cursive handwriting / Kanji recognition
Research Abstract

Aiming to develop new design principles for visual pattern recognition systems of the next generation, we have performed various researches in parallel and have improved the necognitron and the selective attention model, which were proposed previously by the author.
1. Neocognitron We have succeeded in increasing robustness of the neocognitron in pattern recognition by the introduction of new network architectures and the development of improved learning methods. Performance of the improved neocognitrons has been tested for handwritten alphanumeric character recognition.
(1) Thickness invariant line extraction has been realized by a new line-extraction method that uses edge information.
(2) The introduction of bend-extracting cells has greatly improved the learning and recognizing ability.
(3) Non-uniform blurring within a receptive field has been realized by dualization of C-cell layrs of the neocognitron, and the ability to recognize deformed patterns has been increase.
(4) The shapes of receptive fields can be adaptively adjusted by creating non-uniform sensitivity within a receptive field. The ability to discriminate similar patterns can also be increased.
(5) A new method of learning by error correction has been developed. The same high robustness in pattern recognition can be obtained with much smaller effort than the conventional supervised learning.
(6) Large ability of generalization can be obtained by unsupervised learning with winner-take-all process, if different threshold values are used for feature-extraction in the learning and the recognition phases.
2. Selective Attention A cursive English word recognition system has been developed. The system consists of the selective attention model, to which search controller and automatic attention switching mechanisms have been added. The principles of the selective attention model has been shown to be useful also for handwritten Kanji recognition and face recognition.

  • Research Products

    (50 results)

All Other

All Publications (50 results)

  • [Publications] 倉田耕治: "神経回路網の理論的研究における最近の動向" 電子情報通信学会論文誌D-II. J73-D-II. 1103-1110 (1990)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Amari,S.: "Differential Geometry of Boltzmann Machines" Technical Reports of Dept.Math.Eng.Info.Phys.Faculty of Eng.Univ.Tokyo. METR90-19. 1-30 (1990)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Fukushima,K.: "Neural networks for visual pattern recognition" Trans.IEICE Japan(電子情報通信学会英文論文誌). E74. 179-190 (1991)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Fukushima,K.: "Handwritten Alphanumeric Character Recognition by the Neocognitron" IEEE Transactions on Neural Networks. 2. 355-365 (1991)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] 今川太郎: "選択的注意機構のモデルによる英字筆記体連結文字列認識" 電子情報通信学会論文誌D-II. J74-D-II. 1768-1775 (1991)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] 倉田耕治: "トポグラフィック・マッピング形成の数理" 生物物理. 31. 252-256 (1991)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Fukushima,K.: "Character Recognition with Neural Networks" Neurocomputing. 4. 221-233 (1992)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] 和家伸明: "ネオコグニトロンの新しい学習法" 電子情報通信学会論文誌D-II. J75-D-II. 1892-1899 (1992)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] 福島邦彦: "人工神経回路" テレビジョン学会誌. 46. 1393-1402 (1992)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Amari,S.: "Information Geometry of Boltzmann Machines" IEEE Transactions on Neural Networks. 3. 260-271 (1992)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Fukushima,K.: "Recognition and segmentation of connected characters with selective attention" Neural Networks. 6. 33-41 (1993)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] 谷川昌司: "ネオコグニトロンにおける特徴抽出細胞のしきい値設定法" 電子情報通信学会論文誌D-II. J76-D-II. 2215-2222 (1993)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] 山内康一郎: "時系列パターン認識のためのネオコグニトロン型学習法の改善" 電子情報通信学会論文誌D-II. J76-D-II. 2223-2232 (1993)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] 大野通広: "ネオコグニトロンの誤差逆伝播法による学習" 電子情報通信学会論文誌D-II. J77-D-II. 413-421 (1994)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] 庄野逸: "折れ点処理回路を用いた選択的注意機構による英字筆記体連結文字列認識(採録決定)" 電子情報通信学会論文誌D-II. J77-D-II. (1994)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Eckmiller,R.(editor): "Parallel Processing in Neural Systems and Computers" Elsevier, 626 (1990)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Eckmiller,R.(editor): "Advanced Neural Computers" Elsevier, 453 (1990)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] 日本工業技術振興協会 ニューロコンピュータ研究部会(編): "ニューロコンピューティングの基礎理論" 海文堂, 270 (1990)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Kohonen,T.(editor): "Artificial Neural Networks,Volume 1" North-Holland, 978 (1991)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Mammone,R.(editor): "Neural Networks--Theory and Applications" Academic Press, 355 (1991)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Aleksander,I.(editor): "Artificial Neural Networks,2,Volume 1" North-Holland, 837 (1992)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Kimura,H.(editor): "Recent Advances is Mathematical Theory of Systems,Control,Networks and Signal Processing,II" Mita Press, 638 (1992)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Baum,E.B.(editor): "Computational Learning and Cognition" SIAM(Society for Industrial and Applied Mathematics), 276 (1993)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Gielen,S.(editor): "ICANN'93" Springer-Verlag, 1095 (1993)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] 甘利俊一(編): "ニューラルネットの新展開-研究の最前線を探る-" サイエンス社, 225 (1993)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Kurata, K.: "Recent approaches to neural network" Trans. IEICE Japan. J73-D-II. 1103-1110 (1990)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Amari, S.: "Differential Geometry of Boltzmann Machines" Technical Reprts of Dept.Math.Eng.Info.Phys., Faculty of Eng., Univ.Tokyo. METR90-19. 1-30 (1990)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Fukushima, K.: "Neural Networks for visual pattern recognition" Trans. IEICE Japan. E74. 179-190 (1991)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Fukushima, K.: "Handwritten Alphanumeric Character Recognition by the Neocognitron" IEEE Trans. on Neural Networks. 2. 355-365 (1991)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Imagawa, T.: "Character recognition in cursive handwriting with the Mechanism of Selective Attention" Trans. IEICE D-II. J74-D-II. 1768-1775 (1991)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Kurata, K.: "On some instabilities in self-organizing models of topographic mapping" Biophysics. 31. 252-256 (1991)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Fukushima, K.: "Character Recognition with Neural Networks" Neurocomputing. 4. 221-233 (1992)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Wake, N.: "An Improved Learning Method for the Neocognitron" Trans. IEICE D-II. J75-D-II. 1892-1899 (1992)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Fukushima, K.: "Artificial neural networks" J.Inst. Television Engineers Japan. 46. 1393-1402 (1992)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Amari, S.: "Information Geometry of Boltzmann Machines" IEEE Trans. on Neural Networks. 3. 260-271 (1992)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Fukushima, K.: "Recognition and segmentation of connected characters with selective attention" Neural Networks. 6. 33-41 (1993)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Tanigawa, M.: "How to adjust the thresholds of feature-extracting cells in the neocognitron" Trans. IEICE D-II. J76-D-II. 2215-2222 (1993)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Yamauchi, K.: "New learning method for temporal-pattern recognition in the neocognitron" Trans. IEICE D-II. J76-D-II. 2223-2232 (1993)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Ohno, M.: "Neocognitron learned by backpropagation" Trans. IEICE D-II. J77-D-II. 413-421 (1994)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Shouno, H.: "Connected character recognition in cursive handwriting using selective attention model with bend processing" Trans. IEICE D-II. J77-D-II, (to appear).

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Eckmiller, R.(editor): Parallel Processing in Neural Systems and Computers. Elsevier, 626 (1990)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Eckmiller, R.(editor): Advanced Neural Computers. Elsevier, 453 (1990)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] JTTAS Neurocomputer Research Group (editor): Basic Theories of Neuro-Computing. Kaibundo, 270 (1990)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Kohonen, T.(editor): Artificial Neural Networks, Volume 1. North-Holland, 978 (1991)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Nammone, R.(editor): Neural Networks -- Theory and Applications. Academic Press, 355 (1991)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Aleksander, I.(editor): Artifical Neural Networks, 2. Volume 1. North-Holland, 837 (1992)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Kimura, H.(editor): Recent Advances is Mathematical Theory of Systems Control, Networks and Signal Processing, II. Mita Press, 638 (1992)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Baum, E.B.(editor): Computational Learning and Cognition. SIAM, 276 (1993)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Gielen, S.(editor): ICANN'93. Springer-Verlag, 1095 (1993)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Amari, S.(editor): New Development of Neural Nets -- The Latest Frontiers of the Reseach --. Saiensu-Sha, 225 (1993)

    • Description
      「研究成果報告書概要(欧文)」より

URL: 

Published: 1995-03-27  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi