Statistical mechanical analysis of on-line learning with spacio-temporal characteristics

2008 Fiscal Year Final Research Report

• Project/Area Number: 18500183
• Research Category: Grant-in-Aid for Scientific Research (C)
• Allocation Type: Single-year Grants
• Section: 一般
• Research Field: Sensitivity informatics/Soft computing
• Research Institution: Kansai University (2008); Kobe City College of Technology (2006-2007)
• Principal Investigator: MIYOSHI Seiji Kansai University, システム理工学部, 准教授 (10270307)
• Project Period (FY): 2006 – 2008
• Keywords: 機械学習 / 統計的学習理論 / オンライン学習 / 汎化誤差 / 統計力学 / アンサンブル学習

Research Abstract

教師機械が時間的に動くモデル、生徒機械を時間方向に組み合わせる集団学習のモデル、教師機械が複数存在するモデルなど、時間的あるいは空間的な観点で興味深く、また統計的学習の基礎理論と応用の両面への波及効果が大きいと思われるいくつかのモデルについて、学習機械の汎化能力をオンライン学習の枠組みで統計力学的手法を用いて理論的に解析した。その結果、多くの興味深い結果が明らかになった。

Research Products

• [Journal Article] Analysis of Ising spin neural network with time-dependent Mexican-hat-type interaction (2009)
  • Author(s): Hara, K., Miyoshi, S., Uezu, T., and Okada, M.
  • Journal Title: Lecture note in Computer Science(Springer) (in press)
  • Peer Reviewed
• [Journal Article] Statistical mechanical analysis of simultaneous perturbation learning, IEICE transactions on Fundamentals of Electronics (2009)
  • Author(s): Miyoshi, S., Hikawa, H., and Maeda, Y.
  • Journal Title: Communications and Computer Sciences Vol.E92-A, No.7(in press)
  • Peer Reviewed
• [Journal Article] Effect of slow switching of ensemble teachers in on-line learning (2009)
  • Author(s): Miyoshi, S. and Okada, M.
  • Journal Title: Journal of the Physical Society of Japan Vol.78, No.5(in press)
  • Peer Reviewed
• [Journal Article] A theoretical analysis of on-line learning using correlated examples (2008)
  • Author(s): Seki, C., Sakurai, S., Matsuno, M. and Miyoshi, S.
  • Journal Title: IEICE transactions on Fundamentals of Electronics, Communications and Computer Sciences Vol.E91-A, No.9 Pages: 2663-2670
  • Peer Reviewed
• [Journal Article] Theory of time domain ensemble on-line learning of perceptron under the existence of external noise (2007)
  • Author(s): Uezu, T., Miyoshi, S., Izuo ,M. and Okada, M.
  • Journal Title: Journal of the Physical Society of Japan Vol.76, No.11 Pages: 114006 (8 pages)
  • Peer Reviewed
• [Journal Article] Statistical mechanics of nonlinear on-line learning for ensemble teachers (2007)
  • Author(s): Utsumi, H., Miyoshi, S. and Okada, M.
  • Journal Title: Journal of the Physical Society of Japan Vol.76, No.11 Pages: 114001 (6 pages)
  • Peer Reviewed
• [Journal Article] [解説]オンライン学習の統計力学的解析 (2007)
  • Author(s): 三好誠司
  • Journal Title: システム/制御/情報(システム制御情報学会誌) Vol.51, No.5 Pages: 216-223
  • Peer Reviewed
• [Journal Article] Statistical mechanics of on-line learning when a moving teacher goes around an unlearnable true teacher (2007)
  • Author(s): Urakami, M., Miyoshi, S. and Okada, M.
  • Journal Title: Journal of the Physical Society of Japan Vol.76, No.4 Pages: 044003 (5 pages)
  • Peer Reviewed
• [Journal Article] Statistical mechanics of linear and nonlinear time-domain ensemble learning (2006)
  • Author(s): Miyoshi, S. and Okada, M.
  • Journal Title: Journal of the Physical Society of Japan Vol.75, No.12 Pages: 124002 (6 pages)
  • Peer Reviewed
• [Journal Article] Statistical mechanics of time-domain ensemble learning (2006)
  • Author(s): Miyoshi, S., Uezu, T. and Okada, M.
  • Journal Title: Journal of the Physical Society of Japan Vol.75, No.8 Pages: 084007 (6 pages)
  • Peer Reviewed
• [Journal Article] Statistical mechanics of online learning for ensemble teachers (2006)
  • Author(s): Miyoshi, S. and Okada, M.
  • Journal Title: ournal of the Physical Society of Japan Vol.75, No.4 Pages: 044002 (6 pages)
  • Peer Reviewed
• [Presentation] Hand sign recognition system based on hybrid network classifier (2009)
  • Author(s): Yuuki Taki, Hiroomi Hikawa, Seiji Miyoshi and Yutaka Maeda
  • Organizer: Proc. 2009 International Conference on Neural Networks (IJCNN2009)
  • Place of Presentation: Atlanta, USA(accepted)
  • Year and Date: 2009-06-16
• [Presentation] On automatic generation of VHDL code for self-organizing maps (2009)
  • Author(s): Akira Onoo, Hiroomi Hikawa, Seiji Miyoshi and Yutaka Maeda
  • Organizer: Proc. 2009 International Conference on Neural Networks (IJCNN2009)
  • Place of Presentation: Atlanta, USA(accepted)
  • Year and Date: 2009-06-15
• [Presentation] On simultaneous perturbation particle swarm optimization (2009)
  • Author(s): Yutaka Maeda, Naoto Matsushita, Seiji Miyoshi and Hiroomi Hikawa
  • Organizer: Proc. 2009 IEEE Congress on Evolutionary Computation (IEEE CEC 2009)
  • URL: (accepted)
  • Place of Presentation: Trondheim, Norway
  • Year and Date: 2009-05-21
• [Presentation] ベイズ統計に基づく画像処理 (2009)
  • Author(s): 三好誠司
  • Organizer: 東京大学大学院 新領域創成科学研究科 第1回学融合ビジュアライゼーションシンポジウム
  • Place of Presentation: 東京大学柏キャンパス(招待講演)
  • Year and Date: 2009-05-15
• [Presentation] Analysis of Ising spin neural network with time-dependent Mexican-hat-type interaction (2008)
  • Author(s): Hara, K., Miyoshi, S., Uezu, T., and Okada, M.
  • Organizer: Proc. 15th International Conference on Neural Information Processing (ICONIP2008)
  • Place of Presentation: Auckland, New Zealand
  • Year and Date: 2008-11-26
• [Presentation] A statistical mechanical analysis of on-line learning : Many teachers or few teachers ? (2006)
  • Author(s): Miyoshi, S.
  • Organizer: 7th Int. Symp. of Global Renaissance by Green Energy Revolution, 21st Century COE Program
  • Place of Presentation: Nagaoka, Japan(Invited talk)
  • Year and Date: 2006-09-29
• [Presentation] Statistical mechanics of online learning for ensemble teachers (2006)
  • Author(s): Miyoshi, S. and Okada, M.
  • Organizer: Proc. Int. Joint Conf. on Neural Networks (IJCNN2006)
  • Place of Presentation: Vancouver, Canada
  • Year and Date: 2006-07-17
• [Remarks] ホームページ
  • URL: http://www2.ipcku.kansai-u.ac.jp/~miyoshi/