• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Research on Visual Pattern Recognition with Hierarchical Neural Networks

Research Project

Project/Area Number 07408005
Research Category

Grant-in-Aid for Scientific Research (A)

Allocation TypeSingle-year Grants
Section一般
Research Field Intelligent informatics
Research InstitutionOsaka University

Principal Investigator

FUKUSHIMA Kunihiko  Osaka University, Faculty of Engineering Science, Professor, 基礎工学部, 教授 (90218909)

Co-Investigator(Kenkyū-buntansha) OKADA Masato  Computational Neurobiology Group Kawato Dynamic Brain Project Japan Science and, 川人学習動態脳プロジェクト・計算神経生理グループ, 研究員 (90233345)
SHOUNO Hayaru  Osaka University, Faculty of Engineering Science, Research Associate, 基礎工学部, 助手 (50263231)
Project Period (FY) 1995 – 1996
Project Status Completed (Fiscal Year 1996)
Budget Amount *help
¥11,200,000 (Direct Cost: ¥11,200,000)
Fiscal Year 1996: ¥3,200,000 (Direct Cost: ¥3,200,000)
Fiscal Year 1995: ¥8,000,000 (Direct Cost: ¥8,000,000)
KeywordsActive pattern recognition / Visual pattern recognition / Neural network model / Selective attention / Binding problem / Parallel processing of shape and motion / Spatial memory / Neocognitron / 想起の連鎖 / 広域地図の連続的想起 / 競合学習 / 特徴抽出のしきい値 / 視覚神経系 / フィードバック信号
Research Abstract

Aiming to develop new design principles for visual information processing systems of the next generation, we have concentrated our research on the active processes in the visual system of the biological brain. We used modeling approach to solve the mechanism of the brain, and proposed neural network models explaining various functions related to active vision. We also tried to design visual pattern recongnition systems using the results of the modeling research. We have performed various researches in parallel and have obtained the following results.
(1) Neural network model that has two separate channels processing form and motion information. The model can solve the binding problem by the function of selective attention.
(2) Neural network model of binocular cells. The model includes far-cells, near-cells, and fine-tuned cells. We also proposed a theory that can estimate the depth of an object occluded from one eye, and have shown that the results obtained from our theory coincide with the psychological experiments.
(3) Eye movement model with non-uniform receptive fields.
(4) Neural network model of spatial memory. The model memorizes the fragmentary maps of external world, and can recall a map of a wide area by a chain process of recalling.
(5) Training neocognitron to recognize handwritten characters in the real world. The neocognitron, which we have developed previously, is a pattern recognition system whose architecture has been suggested from the mammalian visual system. We trained the neocognitron using a large-scale data base of handwritten digits (ETL-1), and obtained a recognition rate higher than 98%.
(6) Theoretical analysis of the correlation matrix memory.

Report

(3 results)
  • 1996 Annual Research Report   Final Research Report Summary
  • 1995 Annual Research Report
  • Research Products

    (50 results)

All Other

All Publications (50 results)

  • [Publications] Kouichirou Yamauchi: "Speed invariant speech recognition using variable velocity delay lines" Neural Networks. 8[2]. 167-177 (1995)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] Masato Okada: "A hierarchy model of macrodynamical equations for associative memory" Neural Networks. 8[6]. 833-835 (1995)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] 三村和史: "量子化された結合荷重をもつ自己相関型連想記憶回路の容量" 電子情報通信学会論文誌D-II. J78-D-II[6]. 946-953 (1995)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] 青西亨: "網膜と皮質の不均一性を考慮した注視点移動モデル" 電子情報通信学会論文誌D-II. J78-D-II[9]. 1363-1371 (1995)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] 渡部修: "Near cell, far cellの神経回路モデル" 電子情報通信学会論文誌D-II. J78-D-II[9]. 1404-1413 (1995)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] 木本智幸: "動く輪郭の速度知覚について" 電子情報通信学会論文誌D-II. J78-D-II[9]. 1428-1431 (1995)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] 三村和史: "連想記憶モデルのS/N解析---符号反転記憶法とベアリング記憶法---" 日本神経回路学会誌. 2[2]. 38-42 (1995)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] Kunihiko Fukushima: "Use of different thresholds in learning and recognition" Neurocomputing. 11[1]. 1-17 (1996)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] 福島邦彦: "能動的視覚情報処理:神経回路モデル" Vision (日本視覚学会誌). 8[3]. 149-154 (1996)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] Masayuki Kikuchi: "Neural network model of the visual system binding form and motion" Neural Networks. 9[8]. 1417-1427 (1996)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] Masato Okada: "Notions of Associative Memory and Sparse Coding" Neural Networks. 9[8]. 1429-1458 (1996)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] 重末卓: "スパースコーディングされた自己相関型連想記憶モデルの統計神経力学" 日本神経回路学会誌. 3[2]. 58-64 (1996)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] Kunihiko Fukushima: "Neural network model of the spatial memory : Associative recall of maps" Neural Networks. (to appear).

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] M. A. Arbib: "The Handbook of Brain Theory and Neural Networks" MIT Press, 1118 (1995)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] R. Moreno-Diaz: "Brain Processes, Theories and Models" MIT Press, 562 (1996)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] C. von der Malsburg: "Artificial Neural Networks" Springer-Verlag, 922 (1996)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] 大阪大学基礎工学部編: "自然のしくみと人間の知恵---明日をひらくエンジニアリングサイエンス---" 大阪大学出版会, 241 (1997)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] Yamauchi, K.: "Speed invariant speech recognition using variable velocity delay lines" Neural Networks. 8[2]. 167-177 (1995)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] Okada, M.: "A hierarchy model of macrodynamical equations for associative memory" Neural Networks. 8[6]. 833-835 (1995)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] Mimura, K.: "The capacity of autocorrelation associative memory with quabtized synaptic weight" Trans.IEICE D-II. J78-D-II[6]. 946-953 (1995)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] Aonishi, T.: "Eye movement model based on non-uniformity of the retina and the cortex" Trans.IEICE D-II. J78-D-II[9]. 1363-1371 (1995)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] Watanabe, O.: "A neural network model of near and far cells" Trans.IEICE D-II. J78-D-II[9]. 1404-1413 (1995)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] Kimoto, T.: "Velocity perception of moving contours" Trans.IEICE D-II. J78-D-II[9]. 1428-1431 (1995)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] Mimura, K.: "The S/N analysis of associative memory--sign alternating and pairing memorization method" The Brain & Neural Networks. 2[2]. 38-42 (1995)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] Fukushima, K.: "Use of different thresholds in learning and recognition" Neurocomputing. 11[1]. 1-17 (1996)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] Fukushima, K.: "Active vision : neural network , odels" Vision. 8[3]. 149-154 (1996)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] Kikuchi, M.: "Neural network model of the visual system binding form and motion" Neural Networks. 9[8]. 1417-1427 (1996)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] Okada.M.: "Notions of Associative Memory and Sparse Coding" Neural Networks. 9[8]. 1429-1458 (1996)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] Shigemitsu, T.: "Statistical neurodynamics of the sparsely encoded associative memory" The Brain & Neural Networks. 3[2]. 58-64 (1996)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] Fukushima, K.: "Neural network model of the spatial memory : associative recall of maps" Neural Networks. (to appear).

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] M.A.Arbib (Editor): The Handbook of Brain Theory and Neural Networks. MIT Press, 1118 (1995)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] R.Moreno-Diaz (Editor): Brain Processes, Theories and Models. MIT Press, 562 (1996)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] C.von der Malsburg (Editor): Artificial Neural Networks. Springer-Verlag, 922 (1996)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] Faculty of Engineering Science, Osaka University (Editor): Mechanism of the Nature and the Wisdom of the Human Beings. Osaka University Press, 241 (1997)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] Kunihiko Fukushima: "Use of different thresholds in learning and recognition" Neurocomputing. 11[1]. 1-17 (1996)

    • Related Report
      1996 Annual Research Report
  • [Publications] Masayuki Kikuchi: "Neural network model of the visual system binding from and motion" Neural Networks. 9[8]. 1417-1427 (1996)

    • Related Report
      1996 Annual Research Report
  • [Publications] 福島邦彦: "能動的視覚情報処理:神経回路モデル" Vision(日本視覚学会誌). 8[3]. 149-154 (1996)

    • Related Report
      1996 Annual Research Report
  • [Publications] Masato Okada: "Notions of Associative Memory and Sparse Coding" Neural Networks. 9[8]. 1429-1458 (1996)

    • Related Report
      1996 Annual Research Report
  • [Publications] Kunihiko Fukushima: "Neural network model of the spacial memory:Associative recall of maps" Neural Networks. (to appear).

    • Related Report
      1996 Annual Research Report
  • [Publications] Kunihiko Fukushima: "Training neocognitron to recogniza handwritten digits in the real world" Proceedings of WCNN′96. 21-24 (1996)

    • Related Report
      1996 Annual Research Report
  • [Publications] R.Moreno-Diaz: "Brain Processes,Theories and Models" MIT Press, 562 (1996)

    • Related Report
      1996 Annual Research Report
  • [Publications] C.von der Malsburg: "Artificial Neural Networks" Springer-Verlag, 922 (1996)

    • Related Report
      1996 Annual Research Report
  • [Publications] K.Yamauchi: "Speed invariant speech recognition using variable velocity delay lines" Neural Networks. 8. 167-177 (1995)

    • Related Report
      1995 Annual Research Report
  • [Publications] M.Okada: "A hierarchy model of macrodynamical equations for associative memory" Neural Networks. 8. 833-835 (1995)

    • Related Report
      1995 Annual Research Report
  • [Publications] 青西亨: "網膜と皮質の不均一性を考慮した注視点移動モデル" 電子情報通信学会論文誌D-II. J78-D-II. 1363-1371 (1995)

    • Related Report
      1995 Annual Research Report
  • [Publications] 渡部修: "Near cell, far cellの神経回路モデル" 電子情報通信学会論文誌D-II. J78-D-II. 1404-1413 (1995)

    • Related Report
      1995 Annual Research Report
  • [Publications] 木本智幸: "動く輪郭の速度知覚について" 電子情報通信学会論文誌D-II. J78-D-II. 1428-1431 (1995)

    • Related Report
      1995 Annual Research Report
  • [Publications] K.Fukushima: "Use of different thresholds in learning and recognition" Neurocomputing. (to appear). (1996)

    • Related Report
      1995 Annual Research Report
  • [Publications] M.A.Arbib: "The Handbook of Brain Theory and Neural Networks" MIT Press, 1118 (1995)

    • Related Report
      1995 Annual Research Report
  • [Publications] R.Moreno-Diaz: "Brain Processes, Theories and Models" MIT Press, 562 (1995)

    • Related Report
      1995 Annual Research Report

URL: 

Published: 1995-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi