• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

A study on optimal generalizing learning schema for neural networks based on theories of image processing filters

Research Project

Project/Area Number 02452155
Research Category

Grant-in-Aid for General Scientific Research (B)

Allocation TypeSingle-year Grants
Research Field 情報工学
Research InstitutionTokyo Institute of Technology

Principal Investigator

OGAWA Hidemitsu  Tokyo Institute of Technology, Faculty of Engineering Professor, 工学部, 教授 (50016630)

Co-Investigator(Kenkyū-buntansha) YAMASHITA Yukihiko  Tokyo Institute of Technology, Faculty of Engineering Associate, 工学部, 助手 (90220350)
KUMAZAWA Itsuo  Tokyo Institute of Technology, Faculty of Engineering Associate Professor, 工学部, 助教授 (70186469)
Project Period (FY) 1990 – 1991
Project Status Completed (Fiscal Year 1991)
Budget Amount *help
¥5,700,000 (Direct Cost: ¥5,700,000)
Fiscal Year 1991: ¥1,200,000 (Direct Cost: ¥1,200,000)
Fiscal Year 1990: ¥4,500,000 (Direct Cost: ¥4,500,000)
KeywordsImage restoration / Neural network / Learning / Generalization / Filtering / Nonlinear processing / Statics / Over-learning / フイルタ
Research Abstract

A theory for neural network learning which is very effective for analyzing the generalization ability and the overlearning problem is developed. This theory is based on the image restoration theories proposed by the head investigator of this project. Although the problems of generalization and image restoration seem to have nothing in common, we have shown that both problems can be dealt with under the same methodology if we formalize them as a kind of inverse problem. This novel approach provides an analytical and quantitative method for the problems of generalization and over-learning which have been so far treated qualitatively. Followings are the major results obtained in this project.
・A new framework of generalization which can extract general structures among training samples is developed based on the image restoration theories.
・We analyze the generalization ability of the back-propagation using the framework.
・We provide a way of choosing, training samples which does not cause the over-learning problem and gives an optimal generalizing ability.
・Above theoretical results are examined by some computer simulations.

Report

(3 results)
  • 1991 Annual Research Report   Final Research Report Summary
  • 1990 Annual Research Report
  • Research Products

    (34 results)

All Other

All Publications (34 results)

  • [Publications] 小川 英光: "逆問題としてのニュ-ラルネット理論" 電子情報通信学会誌. 73,No.7. 690-695 (1990)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] 小川 英光: "パタ-ン集合を最良に近似する部分空間" 電子情報通信学会技術報告. PRU90ー67. 67-72 (1990)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] 山下 幸彦,小川 英光: "平均射影フィルタによる画像復元" 電子情報通信学会論文誌(DーII). J73ーDーII No.2. 150-157 (1991)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] 山下 幸彦,小川 英光: "平均射影フィルタの諸性質" 電子情報通信学会論文誌(DーII). J73ーDーII No.2. 142-149 (1991)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] 山下 幸彦,小川 英光: "画像空間の位相と最適画像復元フィルタ" 電子情報通信学会論文誌(DーII). J75ーDーII No.2. (1992)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] 山下 幸彦,小川 英光: "最適画像復元フィルタと一般逆" 電子情報通信学会論文誌(DーII). J75ーDーII No.5. (1992)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] 山下 幸彦,小川 英光: "各種最適画像復元フィルタの相互関係" 電子情報通信学会論文誌(DーII). J75ーDーII No.5. (1992)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] Erkki Oja,Hidemitsu Ogawa and Jaroonsakdi Wangviwattana: "Principal component analysis by homogeneous neural networks,Part I:The weighte subspace criterion" IEICE Trans.on Information and Systems. E75-D No.3. (1992)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] Erkki Oja,Hidemitsu Ogawa and Jaroonsakdi Wangviwattana: "Principal component analysis by homogeneous neural networks,Part II:Analysis and extensions of the learning algorithms" IEICE Trans.on Information and Systems,. E75-D No.3. (1992)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] Erkki Oja,Hidemitsu Ogawa and Jaroonsakdi Wangviwattana T.Kohonen,K.Makisara,: "O.Simula and J.Kangased,eds.:Artificial Neural Networks,(分担)Learning in Nonlinear Constrained Hebbian Networks" Elsevier Science Pub.(NorthーHolland), 16 (1991)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] Hidemitsu Ogawa and Itsuo Kumazawa: "G.T.Herman,A.K.Louis and F.Natterer,eds.:Mathematical Methods in Tomography,Lecture Notes in Mathematics,Vol.1497,(分担)Radon Transform and Analog Coding" SpringerーVerlag, 13 (1991)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] Y. Yamashita and H. Ogawa: "Image restoration by averaged projection filter" IEICE Trans. D-II, J74-D-II. 2. 150-157 (1991)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] Y. Yamashita and H. Ogawa: "Properties of averaged projection filter for image restoration" IEICE Trans. D-II, J74-D-II. 2. 142-149 (1991)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] Y. Yamashita and H. Ogawa: "Optimum image restoration and topological invariance" IEICE Trans. D-II, J75-D-II. 2. (1992)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] Y. Yamashita and H. Ogawa: "Optimum image restoration filters and generalized inverse of operators" IEICE Trans. D-II, J75-D-II. 5. (1992)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] Y. Yamashita and H. Ogawa: "Mutual relations among optimum image restoration filters" IEICE Trans. D-II, J75-D-II. 5. (1992)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] Erkki Oja, Hidemitsu Ogawa and Jaroonsakdi Wangviwattana: "Principal component analysis by homogeneous neural networks, Part I : The weight subspace criterion" IEICE Trans. on Information and Systems. E75-D, No. 3. (1992)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] Erkki Oja, Hidemitsu Ogawa and Jaroonsakdi Wangviwattana: "Principal component analysis by homogeneous neural networks, Part II : Analysis and extensions of the learning algorithms" IEICE Trans. on Information and Systems. E75-D, No. 3. (1992)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] Erkki Oja, Hidemitsu Ogawa and Jaroonsakdi Wangviwattana: "Artificial Neural Networks, Learning in Nonlinear" Constrained Hebbian Networks. Elsevier Science Pub. 16 (1991)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] Hidemitsu Ogawa and Itsuo Kumazawa: "Mathematical Methods in Tomography" Lecture Notes in Mathematics, Vol. 1497, Radon Transform and Analog Coding. Springer-Verlag. 13 (1991)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] 山下 幸彦,小川 英光: "平均射影フィルタによる画像復元" 電子情報通信学会論文誌(DーII). Vol.J73ーD. 150-157 (1991)

    • Related Report
      1991 Annual Research Report
  • [Publications] 山下 幸彦,小川 英光: "平均射影フイルタの諸性質" 電子情報通信学会論文誌(DーII). Vol.J73ーD. 142-149 (1991)

    • Related Report
      1991 Annual Research Report
  • [Publications] 山下 幸彦,小川 英光: "画像空間の位相と最適画像復元フイルタ" 電子情報通信学会論文誌(DーII). Vol.J75ーD. (1992)

    • Related Report
      1991 Annual Research Report
  • [Publications] 山下 幸彦,小川 英光: "最適画像復元フイルタと一般逆" 電子情報通信学会論文誌(DーII). Vol.J75ーD. (1992)

    • Related Report
      1991 Annual Research Report
  • [Publications] 山下 幸彦,小川 英光: "各種最適画像復元フイルタの相互関係" 電子情報通信学会論文誌(DーII). Vol.J75ーD. (1992)

    • Related Report
      1991 Annual Research Report
  • [Publications] Erkki Oja,Hidemitsu Ogawa and Jaroonsakdi Wangviwattana: "Principal component analysis homogeneous neural networks,Part I:The weighte subspace criterion" IEICE Trans.on Information and Systems. Vol.E75ーD. (1992)

    • Related Report
      1991 Annual Research Report
  • [Publications] Erkki Oja,Hidemitsu Ogawa and Jaroonsakdi Wangviwattana: "IEICE Trans.on Information and Systems" Principal component analysis by homogeneous neural networks,Part II:Analysis and extensions of the learning algorithms. Vol.E75ーD.

    • Related Report
      1991 Annual Research Report
  • [Publications] Erkki Oja,Hidemitsu Ogawa and Jaroonsakdi Wangviwattana: "T.Kohonen,K.Makisara,O.Simula and J.Kangased,eds.:Artificial Neural Networks,(分担)Learning in Nonlinear Constrained Hebbian Networks" Elsevier Science Pub.(NorthーHolland), 16 (1991)

    • Related Report
      1991 Annual Research Report
  • [Publications] Hidemitsu Ogawa and Itsuo Kumazawa: "G.T.Herman,A.K.Louis and F.Natterer,eds.:Mathematical Methods in Tomography,Lecture Notes in Mathematics,Vol.1497,(分担)Radon Transform and Analog Coding" SpringerーVerlag, 13 (1991)

    • Related Report
      1991 Annual Research Report
  • [Publications] 小川 英光: "逆問題としてのニュ-ラルネット理論" 電子情報通信学会誌. 73. 690-695 (1990)

    • Related Report
      1990 Annual Research Report
  • [Publications] 小川 英光: "パタ-ン集合を最良に近似する部分空間" 電子情報通信学会技術報告. PRU90ー67. 67-72 (1990)

    • Related Report
      1990 Annual Research Report
  • [Publications] 山下 幸彦,小川 英光: "画像空間の位相と最適画像復元フィルタ" 電子情報通信学会技術報告. PRU90ー85. 31-38 (1990)

    • Related Report
      1990 Annual Research Report
  • [Publications] 山下 幸彦,小川 英光: "平均射影フィルタによる画像復元" 電子情報通信学会論文誌. J74ーDII. (1991)

    • Related Report
      1990 Annual Research Report
  • [Publications] 山下 幸彦,小川 英光: "平均射影フィルタの諸性質" 電子情報通信学会論文誌. J74ーDII. (1991)

    • Related Report
      1990 Annual Research Report

URL: 

Published: 1990-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi