• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Trans-contextual inference system based only on distributed representations

Research Project

Project/Area Number 15300068
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Sensitivity informatics/Soft computing
Research InstitutionUniversity of Tsukuba

Principal Investigator

MORITA Masahiko  University of Tsukuba, Graduate School of Systems and Information Engineering, Associate Professor, 大学院システム情報工学研究科, 助教授 (00222349)

Co-Investigator(Kenkyū-buntansha) SUEMITSU Atsuo  Shimane University, Interdisciplinary Faculty of Science and Engineering, Research Associate, 総合理工学部, 教務職員 (20422199)
Project Period (FY) 2003 – 2006
Project Status Completed (Fiscal Year 2006)
Budget Amount *help
¥13,100,000 (Direct Cost: ¥13,100,000)
Fiscal Year 2006: ¥2,700,000 (Direct Cost: ¥2,700,000)
Fiscal Year 2005: ¥3,200,000 (Direct Cost: ¥3,200,000)
Fiscal Year 2004: ¥4,400,000 (Direct Cost: ¥4,400,000)
Fiscal Year 2003: ¥2,800,000 (Direct Cost: ¥2,800,000)
Keywordstrajectory attractor / selective desensitization / nonmonotone neural network / neurodynamical system / pattern-based inference / common sense reasoning / information integration / neural network model / ニューラルネット / 非単調推論 / 分散表現 / 文脈修飾
Research Abstract

It is considered that keys to overcome the limitations of classical artificial intelligence are to represent and process distributed information as patterns without symbolizing it, and to apply knowledge learned in a particular context to new situations in various contexts. The present study aimed to develop a pattern-based reasoning system that has high ability of analogical reasoning and common principles to that used in the brain, and obtained the following results.
1. Multilayer neural networks, which are typical pattern-based information processing systems, have difficulty in learning input-output relation that depends strongly on context. To overcome this difficulty, we developed the selective desensitization method, with which part of neural elements are desensitized depending on the context. We show by numerical experiments that this model has much higher learning capacity and generalization performance than the conventional ones. This is because two kinds of distributed representations are integrated without using local representations, which greatly expands the potential of neural networks.
2. By applying the above method to a kind of neural network called a trajectory attractor model, we built a reasoning system using distributed representations alone. This system deduces a conclusion by state transitions along a trajectory attractor formed in a large-scale dynamical system, and has powerful ability of analogical reasoning. We also showed that this system has many advantages over existing reasoning systems, for example, it can make nonmonotonic reasoning in a simple manner.
3. To examine biological plausibility of the principles of our reasoning system, we constructed models of inferotemporal cortex and hippocampus and compare them with neurophysiological data. The results, together with other physiological and psychological grounds, strongly suggested that the selective desensitization method is actually used in the brain.

Report

(5 results)
  • 2006 Annual Research Report   Final Research Report Summary
  • 2005 Annual Research Report
  • 2004 Annual Research Report
  • 2003 Annual Research Report
  • Research Products

    (32 results)

All 2007 2006 2005 2004 2003 Other

All Journal Article (26 results) Publications (6 results)

  • [Journal Article] 軌道アトラクタを用いたパターンベース推論2007

    • Author(s)
      山根健
    • Journal Title

      電子情報通信学会論文誌(D) J90-D

      Pages: 933-944

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] 選択的不感化理論に基づく海馬ニューロン活動のモデル化2007

    • Author(s)
      宮澤泰弘
    • Journal Title

      日本神経回路学会誌 14

      Pages: 3-12

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Pattern-based reasoning using trajectory attractors (in Japanese)2007

    • Author(s)
      K.Yamane
    • Journal Title

      The IEICE Transactions on Information and Systems (Japanese Edition) J90-D

      Pages: 933-944

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Modeling the activity of the hippocampal neurons based on the theory of selective desensitization (in Japanese)2007

    • Author(s)
      Y.Miyazawa
    • Journal Title

      The Brain & Neural Networks 14

      Pages: 3-12

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] 選択的不感化理論に基づく海馬ニューロン活動のモデル化2007

    • Author(s)
      宮澤泰弘, 末光厚夫, 森田昌彦
    • Journal Title

      日本神経回路学会誌 14

      Pages: 3-12

    • NAID

      110006250622

    • Related Report
      2006 Annual Research Report
  • [Journal Article] 軌道アトラクタを用いたパターンベース推論2007

    • Author(s)
      山根健, 蓮見高志, 末光厚夫, 森田昌彦
    • Journal Title

      電子情報通信学会論文誌(D) J90-D

      Pages: 933-944

    • NAID

      110007385894

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Neural network model of context-dependent neuronal activity in inferotemporal cortex2006

    • Author(s)
      A.Suemitsu
    • Journal Title

      Proceedings of the 2006 International Joint Conference on Neural Networks 1

      Pages: 685-690

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] 神経力学系間の相互作用に基づく文脈依存的時空間パターン処理2006

    • Author(s)
      蓮尾高志
    • Journal Title

      情報科学技術レターズ 5

      Pages: 139-142

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Context-dependent processing of spatiotemporal patterns based on interaction between neurodynamical systems (in Japanese)2006

    • Author(s)
      T.Hasuo
    • Journal Title

      Information Technology Letters 5

      Pages: 139-142

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Neural network model of context-dependent neuronal activity in inferotemporal cortex2006

    • Author(s)
      Suemitsu, A, Morita, M.
    • Journal Title

      Proceedings of the 2006 International Joint Conference on Neural Networks, Vancouver

      Pages: 685-690

    • Related Report
      2006 Annual Research Report
  • [Journal Article] 神経力学系間の相互作用に基づく文脈依存的時空間パターン処理2006

    • Author(s)
      蓮尾高志, 山根健, 森田昌彦
    • Journal Title

      情報科学技術レターズ 5

      Pages: 139-142

    • Related Report
      2006 Annual Research Report
  • [Journal Article] 軌道アトラクタモデルによる分散表現に基づく推論2005

    • Author(s)
      山根 健
    • Journal Title

      電子情報通信学会技術報告(NC2005) 105・131

      Pages: 23-28

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 非単調ニューラルネットによるパターンベース推論2005

    • Author(s)
      山根 健
    • Journal Title

      第15回インテリジェント・システム・シンポジウム講演論文集

      Pages: 311-316

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 下側頭葉における文脈依存的連想の計算論的モデル2004

    • Author(s)
      末光厚夫
    • Journal Title

      電子情報通信学会論文誌(D-II) J87-D-II

      Pages: 1665-1677

    • NAID

      110003171156

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Two-attribute hypothesis in human visual feature integration2004

    • Author(s)
      S.Morokami
    • Journal Title

      Proceedings of the Second International Workshop on ManMachine Symbiotic Systems 1

      Pages: 173-180

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] 選択的不感化法を適用した層状ニューラルネットの情報統合能力2004

    • Author(s)
      森田昌彦
    • Journal Title

      電子情報通信学会論文誌(D-II) J87-D-II

      Pages: 2242-2252

    • NAID

      110003203174

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Computational model of context-dependent association in inferior temporal cortex (in Japanese)2004

    • Author(s)
      A.Suemitsu
    • Journal Title

      The IEICE Transactions on Information and Systems (Japanese Edition) J87-D-II

      Pages: 1665-1677

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Information integration ability of layered neural networks with the selective desensitization method (in Japanese)2004

    • Author(s)
      M.Morita
    • Journal Title

      The IEICE Transactions on Information and Systems (Japanese Edition) J87-D-II

      Pages: 2242-2252

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] 側頭葉における文脈依存的連想の計算論的モデル2004

    • Author(s)
      末光厚夫, 諸上茂光, 森田昌彦
    • Journal Title

      電子情報通信学会論文誌(D-II) Vol.J87-D-II, No.8

      Pages: 1665-1677

    • Related Report
      2004 Annual Research Report
  • [Journal Article] 選択的不感化法を適用した層状ニューラルネットの情報統合能力2004

    • Author(s)
      森田昌彦, 村田和彦, 諸上茂光, 末光厚夫
    • Journal Title

      電子情報通信学会論文誌(D-II) Vol.J87-D-II, No.12

      Pages: 2242-2252

    • NAID

      110003203174

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Two-attribute hypothesis in human visual feature integration2004

    • Author(s)
      Shigemitsu Morokami, Masahiko Morita
    • Journal Title

      Proc.of the Second International Workshop on Man-Machine Symbiotic Systems

      Pages: 173-180

    • Related Report
      2004 Annual Research Report
  • [Journal Article] 選択的不感化原理に基づく文脈依存的ニューロン活動のモデル化2003

    • Author(s)
      末光厚夫
    • Journal Title

      情報科学技術レターズ 2

      Pages: 149-152

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] 嗅周皮質の可塑性に基づく受動的連合形成のモデル2003

    • Author(s)
      諸上茂光
    • Journal Title

      日本神経回路学会誌 10

      Pages: 123-129

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Context-dependent sequential recall by a trajectory attractor network with selective desensitization2003

    • Author(s)
      M.Morita
    • Journal Title

      Proceedings of the Third International Conference on Neural Networks and Artificial Intelligence 1

      Pages: 235-238

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Modeling context-dependent Neuronal Activity based on Selective Desensitization Principle (in Japanese)2003

    • Author(s)
      A.Suemitsu
    • Journal Title

      Information Technology Letters 2

      Pages: 149-152

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] A model of implicit association learning based on plasticity in the perirhinal cortex (in Japanese)2003

    • Author(s)
      S.Morokami
    • Journal Title

      The Brain & Neural Networks 10

      Pages: 123-129

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Publications] 末光 厚夫: "選択的不感化に基づく文脈依存的ニューロン活動のモデル化"情報技術レターズ. 2. 149-152 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 諸上 茂光: "嗅周皮質の可塑性に基づく受動的連合形成のモデル"日本神経回路学会誌. 10・3. 123-129 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] Morita, M.: "Context-dependent sequential recall by a trajectory attractor network with selective desensitization"Proceedings of the Third International Conference on Neural Networks and Artificial Intelligence. 235-238 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 村田 和彦: "選択的不感化を用いた二層ニューラルネットとその汎化能力"情報科学技術フォーラム2003. 459-460 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 古徳 雅史: "複数の属性を持つ視覚作業記憶の情報表現に関する研究"Technical Report on Attention and Cognition. 21(Web出版). (2004)

    • Related Report
      2003 Annual Research Report
  • [Publications] 森田 昌彦: "多層パーセプトロンの限界とその解消"電子情報通信学会技術報告(NC2003). 103-733. 103-108 (2004)

    • Related Report
      2003 Annual Research Report

URL: 

Published: 2003-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi