| Co-Investigator(Kenkyū-buntansha) |
UCHIDA Osamu Tokai University, Department of Information Technology and Electronics, Assistant Professor, 電子情報学部, 講師 (50329306)
KAMIMURA Taeko Senshu University, Department of Letters, Professor, 文学部, 教授 (30205926)
NAKNISHI Shohachiro Tokai University, Department of Information Technology and Electronics, Professor, 電子情報学部, 教授 (30056254)
|
|---|
| Research Abstract |
We propose a new information-theoretic approach to neural computing. In principle, we postulate that living systems manage to control information in a strategic way to keep their existence in extremely uncertain outer conditions. For example, living systems must maximize information content on outer environment to maintain their existence from destructive forces from outer environment. Applying this principle to neural networks, we have proposed a new information-theoretic competitive learning method that is completely different from conventional methods in that competition processes are realized by maximizing mutual information. Based upon this information-theoretic competitive learning, we have developed the following five different approaches to neural computing.
(1) Cost-sensitive information maximization : in maximizing information, the associated cost must be minimized. This method can produce internal representations more faithful to input patterns.
(2) Supervised information-theoretic competitive learning : unsupervised information-theoretic competitive learning is extended to supervised learning. In this method, we use multi-layered networks in which the output layer is added to the first competitive layer.
(3) Teacher-directed learning: Teacher-directed learning is a new supervised learning method using information maximization in which no error back-propagation is used. Thus, the method is very efficient and biological sound method. In the previous method, we used the sigmoid activation functions with some problems in increasing information. To remedy this, we use the Gaiussian activation functions.
(5) Unification of information maximization and minimization : We try to unify information maximization and minimization, because the shortcomings of both methods can be resolved in this framework. In this special session, we offer the present state of research of strategic information control.
|
