Statistical mechanical analysis of on-line learning with spacio-temporal characteristics

• Project/Area Number: 18500183
• Research Category: Grant-in-Aid for Scientific Research (C)
• Allocation Type: Single-year Grants
• Section: 一般
• Research Field: Sensitivity informatics/Soft computing
• Research Institution: Kansai University (2008); Kobe City College of Technology (2006-2007)
• Principal Investigator: MIYOSHI Seiji Kansai University, システム理工学部, 准教授 (10270307)
• Project Period (FY): 2006 – 2008
• Project Status: Completed (Fiscal Year 2008)
• Budget Amount: ¥3,270,000 (Direct Cost: ¥2,700,000、Indirect Cost: ¥570,000); Fiscal Year 2008: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000); Fiscal Year 2007: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000); Fiscal Year 2006: ¥800,000 (Direct Cost: ¥800,000)
• Keywords: 機械学習 / 統計的学習理論 / オンライン学習 / 汎化誤差 / 統計力学 / アンサンブル学習 / 情報統計力学 / 汎化能力 / ブロック直交射影学習 / 時間方向アンサンブル学習

Research Abstract

教師機械が時間的に動くモデル、生徒機械を時間方向に組み合わせる集団学習のモデル、教師機械が複数存在するモデルなど、時間的あるいは空間的な観点で興味深く、また統計的学習の基礎理論と応用の両面への波及効果が大きいと思われるいくつかのモデルについて、学習機械の汎化能力をオンライン学習の枠組みで統計力学的手法を用いて理論的に解析した。その結果、多くの興味深い結果が明らかになった。

Research Products

• [Journal Article] Analysis of Ising spin neural network with time-dependent Mexican-hat-type interaction (2009)
  • Author(s): Hara, K., Miyoshi, S., Uezu, T., and Okada, M.
  • Journal Title: Lecture note in Computer Science(Springer) (in press)
  • Peer Reviewed
• [Journal Article] Statistical mechanical analysis of simultaneous perturbation learning, IEICE transactions on Fundamentals of Electronics (2009)
  • Author(s): Miyoshi, S., Hikawa, H., and Maeda, Y.
  • Journal Title: Communications and Computer Sciences Vol.E92-A, No.7(in press)
  • Peer Reviewed
• [Journal Article] Effect of slow switching of ensemble teachers in on-line learning (2009)
  • Author(s): Miyoshi, S. and Okada, M.
  • Journal Title: Journal of the Physical Society of Japan Vol.78, No.5(in press)
  • NAID: 10025960015
  • Peer Reviewed
• [Journal Article] Effect of slow switching of ensemble teachers in on-line learning (2009)
  • Author(s): Miyoshi, S., Okada, M.
  • Journal Title: Journal of the Physical Society of Japan 78(印刷中)
  • NAID: 10025960015
  • Peer Reviewed
• [Journal Article] Statistical mechanical analysis of simultaneous perturbation leamine (2009)
  • Author(s): Miyoshi, S., Hikawa, H., Maeda, Y.
  • Journal Title: IEICE transactions on Fundamentals of Electronics, Communications and Computer Sciences E92-A(印刷中)
  • Peer Reviewed
• [Journal Article] A theoretical analysis of on-line learning using correlated examples (2008)
  • Author(s): Seki, C., Sakurai, S., Matsuno, M. and Miyoshi, S.
  • Journal Title: IEICE transactions on Fundamentals of Electronics, Communications and Computer Sciences Vol.E91-A, No.9 Pages: 2663-2670
  • NAID: 10026852143
  • Peer Reviewed
• [Journal Article] A theoretical analysis of on-line learning using correlated examples (2008)
  • Author(s): Seki, C, Sakurai, S., Matsuno, M., Miyoshi, S.
  • Journal Title: IEICE transactions on Fundamentals of Electronics, Communications and Computer Sciences E91-A Pages: 2663-2670
  • NAID: 10026852143
  • Peer Reviewed
• [Journal Article] 二段の動的過程を用いた誤り訂正 -レプリカ法による理論解析- (2008)
  • Author(s): 三好誠司
  • Journal Title: 神戸高専研究紀要 46 Pages: 69-73
  • NAID: 110006978024
  • Peer Reviewed
• [Journal Article] Theory of time domain ensemble on-line learning of perceptron under the existence of external noise (2007)
  • Author(s): Uezu, T., Miyoshi, S., Izuo ,M. and Okada, M.
  • Journal Title: Journal of the Physical Society of Japan Vol.76, No.11
  • NAID: 110006530735
  • Peer Reviewed
• [Journal Article] Statistical mechanics of nonlinear on-line learning for ensemble teachers (2007)
  • Author(s): Utsumi, H., Miyoshi, S. and Okada, M.
  • Journal Title: Journal of the Physical Society of Japan Vol.76, No.11
  • NAID: 110006530730
  • Peer Reviewed
• [Journal Article] [解説]オンライン学習の統計力学的解析 (2007)
  • Author(s): 三好誠司
  • Journal Title: システム/制御/情報(システム制御情報学会誌) Vol.51, No.5 Pages: 216-223
  • Peer Reviewed
• [Journal Article] Statistical mechanics of on-line learning when a moving teacher goes around an unlearnable true teacher (2007)
  • Author(s): Urakami, M., Miyoshi, S. and Okada, M.
  • Journal Title: Journal of the Physical Society of Japan Vol.76, No.4
  • NAID: 110006278043
  • Peer Reviewed
• [Journal Article] Theory of time domain ensemble on-line learning of perceptron under the existence of external noise (2007)
  • Author(s): Uezu, T., Miyoshi, S., Izuo, M. and Okada, M.
  • Journal Title: Journal of the Physical Society of Japan 76 Pages: 114006-114006
  • NAID: 110006530735
  • Peer Reviewed
• [Journal Article] Statistical mechanics of nonlinear on-line learning for ensemble teachers (2007)
  • Author(s): Utsumi, H., Miyoshi, S. and Okada, M.
  • Journal Title: Journal of the Physical Society of Japan 76 Pages: 114001-114001
  • NAID: 110006530730
  • Peer Reviewed
• [Journal Article] Statistical mechanics of on-line learning when a moving teacher goes around an unlearnable true teacher (2007)
  • Author(s): Urakami, M., Miyoshi, S. and Okada, M.
  • Journal Title: Journal of the Physical Society of Japan 76
  • NAID: 110006278043
  • Peer Reviewed
• [Journal Article] [解説]オンライン学習の統計力学的解析 (2007)
  • Author(s): 三好誠司
  • Journal Title: システム/制御/情報 (システム制御情報学会誌) 51 Pages: 216-223
  • Peer Reviewed
• [Journal Article] 相関入力を用いた機械学習に関する統計力学的解析II (2007)
  • Author(s): 積千洋, 松野雅文, 三好誠司
  • Journal Title: 神戸高専研究紀要 46 Pages: 75-80
  • Peer Reviewed
• [Journal Article] [解説]オンライン学習の統計力学的解析 (2007)
  • Author(s): 三好誠司
  • Journal Title: システム/制御/情報(システム制御情報学会誌) 51・5(印刷中)
• [Journal Article] Statistical mechanics of on-line learning when a moving teacher goes around an unlearnable true teacher (2007)
  • Author(s): Urakami, M., Miyoshi, S., Okada, M.
  • Journal Title: Journal of the Physical Society of Japan 76・4 Pages: 44003-44003
  • NAID: 110006278043
• [Journal Article] 相関入力を用いた機械学習に関する統計力学的解析 (2007)
  • Author(s): 積千洋, 櫻井信吾, 松野雅文, 三好誠司
  • Journal Title: 神戸高専研究紀要 45 Pages: 61-66
  • NAID: 110006391715
• [Journal Article] Statistical mechanics of linear and nonlinear time-domain ensemble learning (2006)
  • Author(s): Miyoshi, S. and Okada, M.
  • Journal Title: Journal of the Physical Society of Japan Vol.75, No.12
  • NAID: 110005716678
  • Peer Reviewed
• [Journal Article] Statistical mechanics of time-domain ensemble learning (2006)
  • Author(s): Miyoshi, S., Uezu, T. and Okada, M.
  • Journal Title: Journal of the Physical Society of Japan Vol.75, No.8
  • NAID: 110004799205
  • Peer Reviewed
• [Journal Article] Statistical mechanics of online learning for ensemble teachers (2006)
  • Author(s): Miyoshi, S. and Okada, M.
  • Journal Title: ournal of the Physical Society of Japan Vol.75, No.4
  • NAID: 110004729258
  • Peer Reviewed
• [Journal Article] Statistical mechanics of linear and nonlinear time-domain ensemble learning (2006)
  • Author(s): Miyoshi, S., Okada, M.
  • Journal Title: Journal of the Physical Society of Japan 75・12 Pages: 124002-124002
  • NAID: 110005716678
• [Journal Article] Statistical Mechanics of time-domain ensemble learning (2006)
  • Author(s): Miyoshi, S., Uezu, T., Okada, M.
  • Journal Title: Journal of the Physical Society of Japan 75・8 Pages: 84007-84007
  • NAID: 110004799205
• [Journal Article] Statistical mechanics of online learning for ensemble teachers (2006)
  • Author(s): Miyoshi, S., Okada, M.
  • Journal Title: Journal of the Physical Society of Japan 75・4 Pages: 44002-44002
  • NAID: 110004729258
• [Presentation] Hand sign recognition system based on hybrid network classifier (2009)
  • Author(s): Yuuki Taki, Hiroomi Hikawa, Seiji Miyoshi and Yutaka Maeda
  • Organizer: Proc. 2009 International Conference on Neural Networks (IJCNN2009)
  • Place of Presentation: Atlanta, USA(accepted)
  • Year and Date: 2009-06-16
• [Presentation] On automatic generation of VHDL code for self-organizing maps (2009)
  • Author(s): Akira Onoo, Hiroomi Hikawa, Seiji Miyoshi and Yutaka Maeda
  • Organizer: Proc. 2009 International Conference on Neural Networks (IJCNN2009)
  • Place of Presentation: Atlanta, USA(accepted)
  • Year and Date: 2009-06-15
• [Presentation] On simultaneous perturbation particle swarm optimization (2009)
  • Author(s): Yutaka Maeda, Naoto Matsushita, Seiji Miyoshi and Hiroomi Hikawa
  • Organizer: Proc. 2009 IEEE Congress on Evolutionary Computation (IEEE CEC 2009)
  • Place of Presentation: Trondheim, Norway
  • Year and Date: 2009-05-21
• [Presentation] ベイズ統計に基づく画像処理 (2009)
  • Author(s): 三好誠司
  • Organizer: 東京大学大学院 新領域創成科学研究科 第1回学融合ビジュアライゼーションシンポジウム
  • Place of Presentation: 東京大学柏キャンパス(招待講演)
  • Year and Date: 2009-05-15
• [Presentation] 準最適教師群を用いたパーセプトロン学習 (2009)
  • Author(s): 小野勝也, 原一之, 三好誠司, 岡田真人
  • Organizer: 電子情報通信学会東京支部学生会研究発表会
  • Place of Presentation: 東京電機大学神田キャンパス
  • Year and Date: 2009-03-07
• [Presentation] 複数の準最適教師を用いた線形パーセプトロン学習 (2009)
  • Author(s): 吉川恭平, 原一之, 三好誠司, 岡田真人
  • Organizer: 電子情報通信学会東京支部学生会研究発表会
  • Place of Presentation: 東京電機大学神田キャンパス
  • Year and Date: 2009-03-07
• [Presentation] Analysis of Ising spin neural network with time-dependent Mexican-hat-type interaction (2008)
  • Author(s): Hara, K., Miyoshi, S., Uezu, T., and Okada, M.
  • Organizer: Proc. 15th International Conference on Neural Information Processing (ICONIP2008)
  • Place of Presentation: Auckland, New Zealand
  • Year and Date: 2008-11-26
• [Presentation] Analysis of Ising spin neural network with time-dependent Mexican-hat-type interaction (2008)
  • Author(s): Hara, K., Miyoshi, S., Uezu, T., Okada, M.
  • Organizer: 15th International Conference on Neural Information Processing (ICONIP2008)
  • Place of Presentation: Auckland, New Zealand
  • Year and Date: 2008-11-26
• [Presentation] パーシャルアニーリングの統計力学 相互作用がメキシカンハット型ト型の場合 (2008)
  • Author(s): 原一之, 上江冽達也, 三好誠司, 岡田真人
  • Organizer: 電子情報通信学会ニューロコンピューティング研究会
  • Place of Presentation: 佐賀大学
  • Year and Date: 2008-11-08
• [Presentation] メキシカンハットト型相互作用が時間変化する系の統計力学 (2008)
  • Author(s): 原一之, 三好誠司, 上江冽達也, 岡田真人
  • Organizer: 日本神経回路学会第18回全国大会
  • Place of Presentation: 産業技術総合研究所
  • Year and Date: 2008-09-25
• [Presentation] パーシャルアニーリングによる連想記憶安定領域の拡大 (2008)
  • Author(s): 三好誠司, 上江冽達也, 阿部啓, 岡田真人
  • Organizer: 日本神経回路学会第18回全国大会
  • Place of Presentation: 産業技術総合研究所
  • Year and Date: 2008-09-25
• [Presentation] メキシカンハットト型相互作用が時間変化する系のレプリカ解II (2008)
  • Author(s): 原一之, 上江冽達也, 三好誠司, 岡田真人
  • Organizer: 日本物理学会年次大会
  • Place of Presentation: 岩手大学
  • Year and Date: 2008-09-22
• [Presentation] 側頭葉をモデル化したアトラクターネットワークの双安定性 -パーシャルアニーリングの場合- (2008)
  • Author(s): 木本智幸, 上江洌達也, 三好誠司, 岡田真人
  • Organizer: 日本物理学会年次大会
  • Place of Presentation: 近畿大学
  • Year and Date: 2008-03-26
• [Presentation] メキシカンハット型相互作用が時間変化する系のレプリカ解析 (2008)
  • Author(s): 原一之, 三好誠司, 上江洌達也, 岡田真人
  • Organizer: 日本物理学会年次大会
  • Place of Presentation: 近畿大学
  • Year and Date: 2008-03-26
• [Presentation] シナプス荷重が時間変化するニューラルネットワークモデルの定常状態の解析III (2008)
  • Author(s): 阿部啓, 上江洌達也, 三好誠司, 岡田真人
  • Organizer: 日本物理学会年次大会
  • Place of Presentation: 近畿大学
  • Year and Date: 2008-03-25
• [Presentation] ブロック直交射影学習の統計力学的解析 (2007)
  • Author(s): 積千洋, 櫻井信吾, 松野雅文, 三好誠司
  • Organizer: 電気関係学会関西支部連合大会
  • Place of Presentation: 神戸大学
  • Year and Date: 2007-11-18
• [Presentation] パーシャルアニーリングのレプリカ解析 -2体ソーラス符号の場合- (2007)
  • Author(s): 三好誠司, 上江洌達也, 岡田真人
  • Organizer: 情報論的学習理論ワークショップ(IBIS2007)
  • Place of Presentation: 東京工業大学
  • Year and Date: 2007-11-05
• [Presentation] ソーラス符号のパーシャルアニーリング (2007)
  • Author(s): 三好誠司, 上江洌達也, 岡田真人
  • Organizer: 日本物理学会年次大会
  • Place of Presentation: 北海道大学
  • Year and Date: 2007-09-21
• [Presentation] シナプス荷重が時間変化するニューラルネットワークモデルの定常状態の解析II (2007)
  • Author(s): 阿部啓, 上江洌達也, 三好誠司, 岡田真人
  • Organizer: 日本物理学会年次大会
  • Place of Presentation: 北海道大学
  • Year and Date: 2007-09-21
• [Presentation] A statistical mechanical analysis of on-line learning : Many teachers or few teachers ? (2006)
  • Author(s): Miyoshi, S.
  • Organizer: 7th Int. Symp. of Global Renaissance by Green Energy Revolution, 21st Century COE Program
  • Place of Presentation: Nagaoka, Japan(Invited talk)
  • Year and Date: 2006-09-29
• [Presentation] Statistical mechanics of online learning for ensemble teachers (2006)
  • Author(s): Miyoshi, S. and Okada, M.
  • Organizer: Proc. Int. Joint Conf. on Neural Networks (IJCNN2006)
  • Place of Presentation: Vancouver, Canada
  • Year and Date: 2006-07-17
• [Remarks] ホームページ
  • URL: http://www2.ipcku.kansai-u.ac.jp/~miyoshi/
• [Remarks]
  • URL: http://www2.ipcku.kansai-u.ac.jp/~miyoshi/cnt/gyoseki.html