• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Research on Visual Pattern Recognition with Hierarchical Neural Networks

Research Project

Project/Area Number 02402035
Research Category

Grant-in-Aid for General Scientific Research (A)

Allocation TypeSingle-year Grants
Research Field 情報工学
Research InstitutionOsaka University

Principal Investigator

FUKUSHIMA Kunihiko  Osaka University, Faculty of Engineering Science, Professor, 基礎工学部, 教授 (90218909)

Co-Investigator(Kenkyū-buntansha) OKADA Masato  Osaka University, Faculty of Engineering Science, Research Associate, 基礎工学部, 助手 (90233345)
KURATA Koji  Osaka University, Faculty of Engineering Science, Lecturer, 基礎工学部, 講師 (40170071)
Project Period (FY) 1990 – 1993
Project Status Completed (Fiscal Year 1993)
Budget Amount *help
¥33,000,000 (Direct Cost: ¥33,000,000)
Fiscal Year 1993: ¥2,100,000 (Direct Cost: ¥2,100,000)
Fiscal Year 1992: ¥3,400,000 (Direct Cost: ¥3,400,000)
Fiscal Year 1991: ¥7,200,000 (Direct Cost: ¥7,200,000)
Fiscal Year 1990: ¥20,300,000 (Direct Cost: ¥20,300,000)
Keywordsvisual pattern / neural network model / pattern recognition / handwritten character recognition / alphanumeric character recognition / recognition of cursive handwriting / Kanji recognition / 漢字認識 / ニュ-ラルネットワ-ク / パタ-ン認識 / 視覚パタ-ン / 文字認識
Research Abstract

Aiming to develop new design principles for visual pattern recognition systems of the next generation, we have performed various researches in parallel and have improved the necognitron and the selective attention model, which were proposed previously by the author.
1. Neocognitron We have succeeded in increasing robustness of the neocognitron in pattern recognition by the introduction of new network architectures and the development of improved learning methods. Performance of the improved neocognitrons has been tested for handwritten alphanumeric character recognition.
(1) Thickness invariant line extraction has been realized by a new line-extraction method that uses edge information.
(2) The introduction of bend-extracting cells has greatly improved the learning and recognizing ability.
(3) Non-uniform blurring within a receptive field has been realized by dualization of C-cell layrs of the neocognitron, and the ability to recognize deformed patterns has been increase.
(4) The shapes of receptive fields can be adaptively adjusted by creating non-uniform sensitivity within a receptive field. The ability to discriminate similar patterns can also be increased.
(5) A new method of learning by error correction has been developed. The same high robustness in pattern recognition can be obtained with much smaller effort than the conventional supervised learning.
(6) Large ability of generalization can be obtained by unsupervised learning with winner-take-all process, if different threshold values are used for feature-extraction in the learning and the recognition phases.
2. Selective Attention A cursive English word recognition system has been developed. The system consists of the selective attention model, to which search controller and automatic attention switching mechanisms have been added. The principles of the selective attention model has been shown to be useful also for handwritten Kanji recognition and face recognition.

Report

(5 results)
  • 1993 Annual Research Report   Final Research Report Summary
  • 1992 Annual Research Report
  • 1991 Annual Research Report
  • 1990 Annual Research Report
  • Research Products

    (77 results)

All Other

All Publications (77 results)

  • [Publications] 倉田耕治: "神経回路網の理論的研究における最近の動向" 電子情報通信学会論文誌D-II. J73-D-II. 1103-1110 (1990)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] Amari,S.: "Differential Geometry of Boltzmann Machines" Technical Reports of Dept.Math.Eng.Info.Phys.Faculty of Eng.Univ.Tokyo. METR90-19. 1-30 (1990)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] Fukushima,K.: "Neural networks for visual pattern recognition" Trans.IEICE Japan(電子情報通信学会英文論文誌). E74. 179-190 (1991)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] Fukushima,K.: "Handwritten Alphanumeric Character Recognition by the Neocognitron" IEEE Transactions on Neural Networks. 2. 355-365 (1991)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] 今川太郎: "選択的注意機構のモデルによる英字筆記体連結文字列認識" 電子情報通信学会論文誌D-II. J74-D-II. 1768-1775 (1991)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] 倉田耕治: "トポグラフィック・マッピング形成の数理" 生物物理. 31. 252-256 (1991)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] Fukushima,K.: "Character Recognition with Neural Networks" Neurocomputing. 4. 221-233 (1992)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] 和家伸明: "ネオコグニトロンの新しい学習法" 電子情報通信学会論文誌D-II. J75-D-II. 1892-1899 (1992)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] 福島邦彦: "人工神経回路" テレビジョン学会誌. 46. 1393-1402 (1992)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] Amari,S.: "Information Geometry of Boltzmann Machines" IEEE Transactions on Neural Networks. 3. 260-271 (1992)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] Fukushima,K.: "Recognition and segmentation of connected characters with selective attention" Neural Networks. 6. 33-41 (1993)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] 谷川昌司: "ネオコグニトロンにおける特徴抽出細胞のしきい値設定法" 電子情報通信学会論文誌D-II. J76-D-II. 2215-2222 (1993)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] 山内康一郎: "時系列パターン認識のためのネオコグニトロン型学習法の改善" 電子情報通信学会論文誌D-II. J76-D-II. 2223-2232 (1993)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] 大野通広: "ネオコグニトロンの誤差逆伝播法による学習" 電子情報通信学会論文誌D-II. J77-D-II. 413-421 (1994)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] 庄野逸: "折れ点処理回路を用いた選択的注意機構による英字筆記体連結文字列認識(採録決定)" 電子情報通信学会論文誌D-II. J77-D-II. (1994)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] Eckmiller,R.(editor): "Parallel Processing in Neural Systems and Computers" Elsevier, 626 (1990)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] Eckmiller,R.(editor): "Advanced Neural Computers" Elsevier, 453 (1990)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] 日本工業技術振興協会 ニューロコンピュータ研究部会(編): "ニューロコンピューティングの基礎理論" 海文堂, 270 (1990)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] Kohonen,T.(editor): "Artificial Neural Networks,Volume 1" North-Holland, 978 (1991)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] Mammone,R.(editor): "Neural Networks--Theory and Applications" Academic Press, 355 (1991)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] Aleksander,I.(editor): "Artificial Neural Networks,2,Volume 1" North-Holland, 837 (1992)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] Kimura,H.(editor): "Recent Advances is Mathematical Theory of Systems,Control,Networks and Signal Processing,II" Mita Press, 638 (1992)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] Baum,E.B.(editor): "Computational Learning and Cognition" SIAM(Society for Industrial and Applied Mathematics), 276 (1993)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] Gielen,S.(editor): "ICANN'93" Springer-Verlag, 1095 (1993)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] 甘利俊一(編): "ニューラルネットの新展開-研究の最前線を探る-" サイエンス社, 225 (1993)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] Kurata, K.: "Recent approaches to neural network" Trans. IEICE Japan. J73-D-II. 1103-1110 (1990)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] Amari, S.: "Differential Geometry of Boltzmann Machines" Technical Reprts of Dept.Math.Eng.Info.Phys., Faculty of Eng., Univ.Tokyo. METR90-19. 1-30 (1990)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] Fukushima, K.: "Neural Networks for visual pattern recognition" Trans. IEICE Japan. E74. 179-190 (1991)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] Fukushima, K.: "Handwritten Alphanumeric Character Recognition by the Neocognitron" IEEE Trans. on Neural Networks. 2. 355-365 (1991)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] Imagawa, T.: "Character recognition in cursive handwriting with the Mechanism of Selective Attention" Trans. IEICE D-II. J74-D-II. 1768-1775 (1991)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] Kurata, K.: "On some instabilities in self-organizing models of topographic mapping" Biophysics. 31. 252-256 (1991)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] Fukushima, K.: "Character Recognition with Neural Networks" Neurocomputing. 4. 221-233 (1992)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] Wake, N.: "An Improved Learning Method for the Neocognitron" Trans. IEICE D-II. J75-D-II. 1892-1899 (1992)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] Fukushima, K.: "Artificial neural networks" J.Inst. Television Engineers Japan. 46. 1393-1402 (1992)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] Amari, S.: "Information Geometry of Boltzmann Machines" IEEE Trans. on Neural Networks. 3. 260-271 (1992)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] Fukushima, K.: "Recognition and segmentation of connected characters with selective attention" Neural Networks. 6. 33-41 (1993)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] Tanigawa, M.: "How to adjust the thresholds of feature-extracting cells in the neocognitron" Trans. IEICE D-II. J76-D-II. 2215-2222 (1993)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] Yamauchi, K.: "New learning method for temporal-pattern recognition in the neocognitron" Trans. IEICE D-II. J76-D-II. 2223-2232 (1993)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] Ohno, M.: "Neocognitron learned by backpropagation" Trans. IEICE D-II. J77-D-II. 413-421 (1994)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] Shouno, H.: "Connected character recognition in cursive handwriting using selective attention model with bend processing" Trans. IEICE D-II. J77-D-II, (to appear).

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] Eckmiller, R.(editor): Parallel Processing in Neural Systems and Computers. Elsevier, 626 (1990)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] Eckmiller, R.(editor): Advanced Neural Computers. Elsevier, 453 (1990)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] JTTAS Neurocomputer Research Group (editor): Basic Theories of Neuro-Computing. Kaibundo, 270 (1990)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] Kohonen, T.(editor): Artificial Neural Networks, Volume 1. North-Holland, 978 (1991)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] Nammone, R.(editor): Neural Networks -- Theory and Applications. Academic Press, 355 (1991)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] Aleksander, I.(editor): Artifical Neural Networks, 2. Volume 1. North-Holland, 837 (1992)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] Kimura, H.(editor): Recent Advances is Mathematical Theory of Systems Control, Networks and Signal Processing, II. Mita Press, 638 (1992)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] Baum, E.B.(editor): Computational Learning and Cognition. SIAM, 276 (1993)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] Gielen, S.(editor): ICANN'93. Springer-Verlag, 1095 (1993)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] Amari, S.(editor): New Development of Neural Nets -- The Latest Frontiers of the Reseach --. Saiensu-Sha, 225 (1993)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1993 Final Research Report Summary
  • [Publications] 谷川昌司: "ネオコグニトロンにおける特徴抽出細胞のしきい値設定法" 電子情報通信学会論文誌D-II. J76-D-II. 2215-2222 (1993)

    • Related Report
      1993 Annual Research Report
  • [Publications] 山内康一郎: "時系列パターン認識のためのネオコグニトロン型学習法の改善" 電子情報通信学会論文誌D-II. J76-D-II. 2223-2232 (1993)

    • Related Report
      1993 Annual Research Report
  • [Publications] 大野通広: "ネオコグニトロンの誤差逆伝播法による学習" 電子情報通信学会論文誌D-II. J77-D-II. 413-421 (1994)

    • Related Report
      1993 Annual Research Report
  • [Publications] 庄野逸: "折れ点処理回路を用いた選択的注意機構による英字筆記体連結文字列認識" 電子情報通信学会論文誌D-II. J77-D-II(採録決定). (1994)

    • Related Report
      1993 Annual Research Report
  • [Publications] Baum,E.B.(editor): "Computational Learning and Cognition" SIAM(Society for Industrial and Applied Mathematics), 276 (1993)

    • Related Report
      1993 Annual Research Report
  • [Publications] Gielen,S.(editor): "ICANN'93" Springer-Verlag, 1095 (1993)

    • Related Report
      1993 Annual Research Report
  • [Publications] Fukushima,K.: "Recognition and segmentation of connected characters with selective attention" Neural Networks. 6. 33-41 (1993)

    • Related Report
      1992 Annual Research Report
  • [Publications] Fukushima,K.: "Character Recognition with Neural Networks" Neurocomputing. 4. 221-233 (1992)

    • Related Report
      1992 Annual Research Report
  • [Publications] 和家 伸明: "ネオコグニトロンの新しい学習法" 電子情報通信学会論文誌D-II. J75-D-II. 1892-1899 (1992)

    • Related Report
      1992 Annual Research Report
  • [Publications] 福島 邦彦: "人工神経回路" テレビジョン学会誌. 46. 1393-1402 (1992)

    • Related Report
      1992 Annual Research Report
  • [Publications] Aleksander,I.(editors): "Artificial Neural Networks,2,Volume 1" North-Holland, 837 (1992)

    • Related Report
      1992 Annual Research Report
  • [Publications] Kimura,H.(editors): "Recent Advances is Mathematical Theory of Systems,Control,Networks and Signal Processing,II" Mita Press, 638 (1992)

    • Related Report
      1992 Annual Research Report
  • [Publications] Fukushima,K.: "Handwritten Alphanumeric Character Recognition by the Neocognitron" IEEE Transactions on Neural Networks. 2. 355-365 (1991)

    • Related Report
      1991 Annual Research Report
  • [Publications] 今川 太郎: "選択的注意機構のモデルによる英字筆記体連結文字列認識" 電子情報通信学会論文誌DーII. J74ーDーII. 1768-1775 (1991)

    • Related Report
      1991 Annual Research Report
  • [Publications] Amari,S.: "Information Geometry of Boltzmann Machines" IEEE Transactions on Neural Networks.

    • Related Report
      1991 Annual Research Report
  • [Publications] 倉田耕治: "トポグラフィック・マッピング形成の数理" 生物物理. 31. 252-256 (1991)

    • Related Report
      1991 Annual Research Report
  • [Publications] 倉田 耕治: "トポグラフィックマッピング形成の数理" 数理解析研講究録. No.762. 89-100 (1991)

    • Related Report
      1991 Annual Research Report
  • [Publications] Kohonen,T.(editors): "Artificial Neural Networks,Volume 1" Elsevier Science Publishers B.V.(NorthーHolland), 978 (1991)

    • Related Report
      1991 Annual Research Report
  • [Publications] Mammone.R.(editors): "Neural NetworksーーTheory and Applications" Academic Press, 355 (1991)

    • Related Report
      1991 Annual Research Report
  • [Publications] Fukushima,K.: "Neural networks for visual pattern recognition" Trans.IEICE Japan(電子情報通信学会英文論文誌). E74. 179-190 (1991)

    • Related Report
      1990 Annual Research Report
  • [Publications] Fukushima,K.: "Handwritten alphanumeric character recognition by the neocognitron" IEEE Transactions on Neural Networks.

    • Related Report
      1990 Annual Research Report
  • [Publications] 今川 太郎: "選択的注意機構のモデルによる英字筆記体連結文字列認識" 電子情報通信学会論文誌DーII.

    • Related Report
      1990 Annual Research Report
  • [Publications] 倉田 耕治: "神経回路網の理論的研究における最近の動向" 電子情報通信学会論文誌DーII. J73ーDーII. 1103-1110 (1990)

    • Related Report
      1990 Annual Research Report
  • [Publications] 倉田 耕治: "トポグラフィックマッピング形成の数理" 数理解析研講究録.

    • Related Report
      1990 Annual Research Report
  • [Publications] Amari,S.: "Differential Geometry of Boltzmann Machines" Technical Reprts of Dept.Math.Eng.Info.Phys.Faculty of Eng.Univ.Tokyo. METR90ー19. 1-30

    • Related Report
      1990 Annual Research Report
  • [Publications] Eckmiller,R.(editors): "Parallel Processing in Neural Systems and Computers" Elsevier, 626 (1990)

    • Related Report
      1990 Annual Research Report
  • [Publications] Eckmiller,R.(editor): "Advanced Neural Computers" Elsevier, 453 (1990)

    • Related Report
      1990 Annual Research Report

URL: 

Published: 1990-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi