• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Information-theoretic self-organizing maps and its application

Research Project

Project/Area Number 24500283
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Research Field Sensitivity informatics/Soft computing
Research InstitutionTokai University

Principal Investigator

KAMIMURA Ryotaro  東海大学, 情報教育センター, 教授 (80176643)

Co-Investigator(Kenkyū-buntansha) TAKEUCHI Haruhiko  独立行政法人, 産業技術総合研究所, 主任研究員 (00357401)
Project Period (FY) 2012-04-01 – 2015-03-31
Project Status Completed (Fiscal Year 2014)
Budget Amount *help
¥5,200,000 (Direct Cost: ¥4,000,000、Indirect Cost: ¥1,200,000)
Fiscal Year 2014: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Fiscal Year 2013: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Fiscal Year 2012: ¥2,080,000 (Direct Cost: ¥1,600,000、Indirect Cost: ¥480,000)
Keywordsニューラルネットワーク / 自己組織化マップ / 情報論的方法 / 能動学習 / 多層ニューラルネットワーク / 相互情報量 / 競合学習 / 深層学習 / 内部表現 / 段階的情報最大 / 変数選択 / 機械学習 / 情報理論 / 教師付学習 / 自由エネルギー / 重要性分析 / クラス構造
Outline of Final Research Achievements

The models in neural networks have aimed to create representations faithful to input patterns as much as possible. However, it has turned out that the faithful representations are not necessarily effective in actual situations. Thus, the present study attempted to create multiple representations, depending on different situations. However, in the course of this pursuit to the open representations, it has turned out that it is necessary to build up more powerful network models for realizing open representations. For this, new multi-layered neural networks model was developed based on the information-theoretic self-organizing maps. In addition, the definition of information content should be changed to take into account the possibility of the information more exactly. Finally, the information theoretic methods should be simplified to be applicable to large data sets.

Report

(4 results)
  • 2014 Annual Research Report   Final Research Report ( PDF )
  • 2013 Research-status Report
  • 2012 Research-status Report
  • Research Products

    (24 results)

All 2014 2013 2012

All Journal Article (24 results) (of which Peer Reviewed: 24 results,  Open Access: 8 results)

  • [Journal Article] Double Competition for Information-Theoretic SOM2014

    • Author(s)
      上村龍太郎
    • Journal Title

      International Journal of Advanced Research in Artificial Intelligence

      Volume: 3 Issue: 11 Pages: 21-30

    • DOI

      10.14569/ijarai.2014.031104

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Cooperation-Controlled Learning for Explicit Class Structure in Self-Organizing Maps2014

    • Author(s)
      上村龍太郎
    • Journal Title

      The Scientific World Journal

      Volume: 2014 Pages: 1-24

    • DOI

      10.1155/2014/397927

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Improving visualisation and prediction performance of supervised self-organising map by modified contradiction resolution2014

    • Author(s)
      上村龍太郎
    • Journal Title

      Connection Science

      Volume: 27 Issue: 1 Pages: 40-67

    • DOI

      10.1080/09540091.2014.956288

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Input information maximization for improving self-organizing maps2014

    • Author(s)
      上村龍太郎
    • Journal Title

      Applied Intelligence

      Volume: 41 Issue: 2 Pages: 421-438

    • DOI

      10.1007/s10489-014-0525-1

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Information acquisition performance by supervised information-theoretic self-organizing maps2014

    • Author(s)
      上村龍太郎
    • Journal Title

      Sixth World Congress on Nature and Biologically Inspired Computing (NaBIC)

      Volume: 2014 Pages: 151-157

    • DOI

      10.1109/nabic.2014.6921870

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Information-theoretic multi-layered supervised self-organizing maps for improved prediction performance and explicit internal representation2014

    • Author(s)
      上村龍太郎
    • Journal Title

      Proceedings ofIEEE International Conference on Systems, Man and Cybernetics (SMC)

      Volume: 2014 Pages: 78-73

    • DOI

      10.1109/smc.2014.6974035

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Explicit knowledge extraction in information-theoretic supervised multi-layered SOM2014

    • Author(s)
      上村龍太郎
    • Journal Title

      Proceedings of IEEE Symposium on Foundations of Computational Intelligence

      Volume: 2014 Pages: 78-83

    • DOI

      10.1109/foci.2014.7007810

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Simplified Information Maximization for Improving Multi-layered Neural Networks2014

    • Author(s)
      上村龍太郎
    • Journal Title

      Proceedings of the IASTED International Conference on Computational Intelligence

      Volume: 2015 Pages: 262-268

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Controlling Relations between the Individuality and Collectivity of Neurons and its Application to Self-Organizing Maps2013

    • Author(s)
      Ryotaro Kamimura
    • Journal Title

      Neural Processing Letters

      Volume: 38 Issue: 2 Pages: 177-203

    • DOI

      10.1007/s11063-012-9256-7

    • Related Report
      2013 Research-status Report
    • Peer Reviewed
  • [Journal Article] Repeated comprehensibility maximization in competitive learning2013

    • Author(s)
      Ryotaro Kamimura
    • Journal Title

      Neural Computing and Applications

      Volume: 22 Pages: 911-932

    • Related Report
      2013 Research-status Report
    • Peer Reviewed
  • [Journal Article] Contradiction Resolution between Self and Outer Evaluation for Supervised Multi-Layered Neural Networks2013

    • Author(s)
      Ryotaro Kamimura
    • Journal Title

      International Journal of Advanced Research in Artificial Intelligence

      Volume: 2 Issue: 7 Pages: 29-38

    • DOI

      10.14569/ijarai.2013.020706

    • Related Report
      2013 Research-status Report
    • Peer Reviewed
  • [Journal Article] Contradiction Resolution of Competitive and Input Neurons to Improve Prediction and Visualization Performance2013

    • Author(s)
      Ryotaro Kamimura
    • Journal Title

      International Journal of Advanced Research in Artificial Intelligence

      Volume: 2 Issue: 12 Pages: 42-51

    • DOI

      10.14569/ijarai.2013.021206

    • Related Report
      2013 Research-status Report
    • Peer Reviewed
  • [Journal Article] Contradiction resolution with explicit and limited evaluation and its application to SOM2013

    • Author(s)
      Ryotaro Kamimura
    • Journal Title

      Proceedings of international conference on neural networks

      Volume: - Pages: 1-8

    • DOI

      10.1109/ijcnn.2013.6706999

    • Related Report
      2013 Research-status Report
    • Peer Reviewed
  • [Journal Article] Contradiction Resolution with Dependent Input Neuron Selection for Self-Organizing Maps2013

    • Author(s)
      Ryotaro Kamimura
    • Journal Title

      Proceedings of international conference on systems, man and cybernetics

      Volume: - Pages: 1353-1360

    • DOI

      10.1109/smc.2013.234

    • Related Report
      2013 Research-status Report
    • Peer Reviewed
  • [Journal Article] Dependent input neuron selection in contradiction resolution,2013

    • Author(s)
      Ryotaro Kamimura
    • Journal Title

      Computational Intelligence & Applications

      Volume: - Pages: 45-50

    • DOI

      10.1109/iwcia.2013.6624781

    • Related Report
      2013 Research-status Report
    • Peer Reviewed
  • [Journal Article] Interacting Individually and Collectively Treated Neurons for Improved Visualization2013

    • Author(s)
      Ryotaro Kamimura
    • Journal Title

      Studies in Computational Intelligence

      Volume: 465 Pages: 277-290

    • DOI

      10.1007/978-3-642-35638-4_18

    • ISBN
      9783642356377, 9783642356384
    • Related Report
      2013 Research-status Report 2012 Research-status Report
    • Peer Reviewed
  • [Journal Article] GRADUAL INFORMATION MAXIMIZATION IN INFORMATION ENHANCEMENT TO EXTRACT IMPORTANT INPUT NEURONS2013

    • Author(s)
      Ryotaro Kamimura and Ryozo Kitajima
    • Journal Title

      Proceedings of the IASTED International Conference Artificial Intelligence and Applications

      Volume: -

    • DOI

      10.2316/p.2014.816-008

    • Related Report
      2013 Research-status Report
    • Peer Reviewed
  • [Journal Article] Relative information maximization and its application to the extraction of explicit class structure in SOM2012

    • Author(s)
      上村龍太郎
    • Journal Title

      Neurocomputing

      Volume: 82 Pages: 37-61

    • DOI

      10.1016/j.neucom.2011.09.031

    • Related Report
      2012 Research-status Report
    • Peer Reviewed
  • [Journal Article] Double enhancement learning for explicit internal representations: unifying self-enhancement and information enhancement to incorporate information on input variables2012

    • Author(s)
      上村龍太郎
    • Journal Title

      Applied Intelligence

      Volume: 36 Issue: 4 Pages: 834-856

    • DOI

      10.1007/s10489-011-0300-5

    • Related Report
      2012 Research-status Report
    • Peer Reviewed
  • [Journal Article] Similarity interaction in information-theoretic self-organizing maps2012

    • Author(s)
      上村龍太郎
    • Journal Title

      International Journal of General Systems

      Volume: 42 Issue: 3 Pages: 1-29

    • DOI

      10.1080/03081079.2012.723209

    • Related Report
      2012 Research-status Report
    • Peer Reviewed
  • [Journal Article] Contradiction resolution and its application to self-organizing maps2012

    • Author(s)
      上村龍太郎
    • Journal Title

      Proceedings of IEEE conference on Systems, Man, and Cybernetics

      Volume: - Pages: 1966-1971

    • DOI

      10.1109/icsmc.2012.6378026

    • Related Report
      2012 Research-status Report
    • Peer Reviewed
  • [Journal Article] Separation and unification of individuality and collectivity and its application to explicit class structure in self-organizing maps2012

    • Author(s)
      上村龍太郎
    • Journal Title

      Artificial Neural Networks and Machine Learning--ICANN 2012

      Volume: 7553 Pages: 387-394

    • DOI

      10.1007/978-3-642-33266-1_48

    • ISBN
      9783642332654, 9783642332661
    • Related Report
      2012 Research-status Report
    • Peer Reviewed
  • [Journal Article] Interaction of individually and collectively treated neurons for explicit class structure in self-organizing maps2012

    • Author(s)
      上村龍太郎
    • Journal Title

      Proceedings of International Joint Conference on Neural Networks (IJCNN)

      Volume: - Pages: 1-8

    • DOI

      10.1109/ijcnn.2012.6252415

    • Related Report
      2012 Research-status Report
    • Peer Reviewed
  • [Journal Article] Social Interaction and Self-Organizing Maps2012

    • Author(s)
      上村龍太郎
    • Journal Title

      Application of self-organizing maps

      Volume: - Pages: 27-42

    • DOI

      10.5772/51705

    • ISBN
      9789535108627
    • Related Report
      2012 Research-status Report
    • Peer Reviewed

URL: 

Published: 2013-05-31   Modified: 2019-07-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi