• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Modifications of the Interactive Learning for Competitive Associative Nets and the Application of Piecewise Linear approximation ability to Nonlinear Problems

Research Project

Project/Area Number 16300070
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Sensitivity informatics/Soft computing
Research InstitutionKyushu Institute of Technology

Principal Investigator

KUROGI Shuichi  Kyushu Institute of Technology, Faculty of Engineering, Associate Professor, 工学部, 助教授 (40178124)

Co-Investigator(Kenkyū-buntansha) NISHIDA Takeshi  Kyushu Institute of Technology, Faculty of Engineering, Research Associate, 工学部, 助手 (30346861)
Project Period (FY) 2004 – 2006
Project Status Completed (Fiscal Year 2006)
Budget Amount *help
¥3,600,000 (Direct Cost: ¥3,600,000)
Fiscal Year 2006: ¥1,000,000 (Direct Cost: ¥1,000,000)
Fiscal Year 2005: ¥1,000,000 (Direct Cost: ¥1,000,000)
Fiscal Year 2004: ¥1,600,000 (Direct Cost: ¥1,600,000)
KeywordsCompetitive Associative Nets / Modification of Interactive Learning / Piecewise Linear Approximation / Application to Nonlinear Problems / Neural Networks / Control of Nonlinear Plants / Analysis of Speech Time Series
Research Abstract

The aim of this research was to modify the conventional interactive learning method for the competitive associative net (CAN2), and investigate the application of the piecewise linear approximation of the CAN2 to nonlinear problems. This research have achieved the following results.
(1) Modification and examination of the interactive learning method: At first, we have modified the interactive (online) learning method into a batch learning method because the latter scheme is effective in the case when available data are finite which often occurs in practical problems. Next, in order to minimize the generalization error stably, we have modified to ensemble learning methods which aggregate CAN2s with different number of units, and bagging learning methods which aggregate CAN2s which learn bootstrap resample datasets. The third modification was to use first-order difference of a time series for time series prediction. Through several challenges to international prediction competitions, we have achieved the third place at the time series prediction competition held at the IJCNN2004, the regression winner at Evaluating Predictive Uncertainty Challenge held at NIPS2004, and the second place at the time series prediction competition held at ESTSP2007.
(2) Application to the control of nonlinear time-varying plants: We have applied the above modified methods to the temperature control of RCA solutions which is for cleaning silicon wafers. We have achieved the improvement of the performance of the control, especially in the stability in learning process, as well as reducing the settling time and the overshoot.
(3) Application to the analysis and recognition of the speech time series: The above modified methods are applied to reproduction, recognition, and analysis of vowel signals, and we have obtained the improvement of the performance.

Report

(4 results)
  • 2006 Annual Research Report   Final Research Report Summary
  • 2005 Annual Research Report
  • 2004 Annual Research Report
  • Research Products

    (40 results)

All 2007 2006 2005 2004

All Journal Article (38 results) Book (2 results)

  • [Journal Article] Combining the predictions of a time series and the first-order difference using bagging of competitive associative nets2007

    • Author(s)
      S.Kurogi, S.Tanaka, R.Koyama
    • Journal Title

      Proceedings of the European Symposium on Time Series Prediction 2007

      Pages: 123-131

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Annual Research Report 2006 Final Research Report Summary
  • [Journal Article] Time series prediction of the CATS benchmark using Fourier bandpass filters and competitive associative nets2007

    • Author(s)
      S.Kurogi, M.Sawa, T.Ueno
    • Journal Title

      Neurocomputing (accepted)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] 競合連想ネットによる距離画像からの平面抽出2007

    • Author(s)
      黒木, 西田
    • Journal Title

      日本神経回路学会誌 (発表予定)

    • NAID

      10020018983

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Forecasting using first-order difference of time series and bagging of competitive associative nets(発表予表)2007

    • Author(s)
      S.Kurogi, R.Koyama, S.Tanaka, T.Sanuki
    • Journal Title

      20^<th> International Joint Conference on Neural Networks

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Range data approximation for mobile robot by using CAN2(発表予表)2007

    • Author(s)
      T.Nishida, S.Kurogi, Y.Takemura, H.Fukumoto, S.Okada
    • Journal Title

      20^<th> International Joint Conference on Neural Networks

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Reproduction and recognition of vowel signals using single and bagging competitive associative nets2007

    • Author(s)
      S.Kurogi, N.Nedachi, Y.Funatsu
    • Journal Title

      Proceedings of International Conference on Neural Information Processing(発表予定)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Plane extraction from range images using competitive associative nets2007

    • Author(s)
      S.Kurogi, T.Nishida
    • Journal Title

      Journal of Japanese Neural Network Society (submitted)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Forecasting using first-order difference of time series and bagging of competitive associative nets2007

    • Author(s)
      S.Kurogi, R.Koyama, S.Tanaka, T.Sanuki
    • Journal Title

      20th International Joint Conference on Neural Networks (accepted)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Range data approximation for mobile robot by using CAN22007

    • Author(s)
      T.Nishida, S.Kurogi, Y.Takemura, H.Fukumoto, S.Okada
    • Journal Title

      20^<th> International Joint Conference on Neural Networks (accepted)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Reproduction and recognition of vowel signals using single and bagging competitive associative nets2007

    • Author(s)
      S.Kurogi, N.Nedachi, Y.Funatsu
    • Journal Title

      Proceedings of International Conference on Neural Information Processing (submitted)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Ensemble of competitive associative nets and multiple K-fold cross-validation for estimating predictive uncertainty in environmental modeling2006

    • Author(s)
      S.Kurogi, D.Kuwahara, T.Nishida
    • Journal Title

      Proceedings of International Joint Conference on Neural Networks 2006 (CD-ROM)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Annual Research Report 2006 Final Research Report Summary
  • [Journal Article] バッチ学習型競合連想ネットとその性質2006

    • Author(s)
      黒木, 西田, 渕川
    • Journal Title

      計測自動制御学会論文集 42・8

      Pages: 916-925

    • NAID

      10019295679

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Ensemble of competitive associative nets and a method to select an effective number of units2006

    • Author(s)
      S.Kurogi, S.Tanaka, R.Koyama, T.Nishida
    • Journal Title

      LNCS 4234, 13^<th> International Conference on Neural Information Processing Proceedings

      Pages: 698-707

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Annual Research Report 2006 Final Research Report Summary
  • [Journal Article] Ensemble of competitive associative nets for stable learning performance in temperature control of RCA cleaning solutions2006

    • Author(s)
      S.Kurogi, D.Kuwahara, H.Tomisaki, T.Nishida, M.Mimata, K.Itoh
    • Journal Title

      LNCS 4234, 13^<th> International Conference on Neural Information Processing Proceedings

      Pages: 563-571

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Reproduction and recognition of vowels using competitive associative nets2006

    • Author(s)
      N.Nedachi, S.Kurogi
    • Journal Title

      SICE/ICASE International Joint Conference

      Pages: 1147-1151

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Batch learning competitive associative net and its properties2006

    • Author(s)
      S.Kurogi, T.Nishida, Y.Fuchikawa
    • Journal Title

      Transaction of the Society of Instrument and Control Engineers 42-8

      Pages: 916-925

    • NAID

      10019295679

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Competitive associative nets and cross-validation for estimating predictive uncertainty on regression problems2006

    • Author(s)
      S.Kurogi, M.Sawa, S.Tanaka
    • Journal Title

      Lecture Notes in Artificial Intelligence 3944 (LNAI 3944)

      Pages: 78-94

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Ensemble of competitive associative nets and a method to select an effective number of units2006

    • Author(s)
      S.Kurogi, S.Tanaka, R.Koyama, T.Nishida
    • Journal Title

      LNCS 4234, 13th International Conference on Neural Information Processing Proceedings

      Pages: 698-707

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Ensemble of competitive associative nets for stable learning performance in temperature control of RCA cleaning solutions2006

    • Author(s)
      S.Kurogi, D.Kuwahara, H.Tomisaki, T.Nishida, M.Mimata, K.Itoh
    • Journal Title

      LNCS 4234, 13th International Conference on Neural Information Processing Proceedings

      Pages: 563-571

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Reproduction and recognition of vowel5 using competitive associative nets2006

    • Author(s)
      N.Nedachi, S.Kurogi
    • Journal Title

      SICE/ICASE International Joint Conference

      Pages: 1147-1151

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] バッヂ学習型競合連想ネットとその性質2006

    • Author(s)
      黒木, 西田, 渕川
    • Journal Title

      計測自動制御学会論文集 42・8

      Pages: 916-925

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Ensemble of competitive nets for stable learning performance in temperature control of RCA cleaning solutions2006

    • Author(s)
      S.Kurogi, D.Kuwahara, H.Tomisaki, T.Nishida, M.Mimata, K.Itoh
    • Journal Title

      LNCS 4234, 13^<th> International Conference on Neural Information Processing Proceeding

      Pages: 563-571

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Reproduction and recognition of vowels using competitive associative nets2006

    • Author(s)
      N.Nedachi, S.Kurogi
    • Journal Title

      SICE ICASE International Joint Conference,

      Pages: 1147-1151

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Competitive associative nets and cross-validation for estimating predictive uncertainty on regression problems2006

    • Author(s)
      S.Kuroki.Saga's.Tanaka
    • Journal Title

      Lecture Notes in Artificial Intelligence 3944

      Pages: 78-94

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Time series prediction of the CATS benchmark using Fourier bandpass filters and competitive associative nets2006

    • Author(s)
      S.Kurogi, M.Sawa, T.Ueno
    • Journal Title

      Neurocomputing (accepted)

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Cross-validation of competitive associative nets for stable temperature control of RCA cleaning solutions2005

    • Author(s)
      H.Tomisaki, S.Kurogi, N.Araki, T.Nishida, Y.Fuchikawa, M.Mimata, K.Itoh
    • Journal Title

      12-th International Conference on Neural Information Processing Proceedings

      Pages: 166-170

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary 2005 Annual Research Report
  • [Journal Article] Piecewise linear approximation for range data using batch learning competitive associative net2005

    • Author(s)
      Y.Sakai, T.Nishida, S.Kurogi, A.Eguchi, Y.Fuchikawa
    • Journal Title

      12-th International Conference on Neural Information Processing Proceedings

      Pages: 202-207

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary 2005 Annual Research Report
  • [Journal Article] Cross-validation and bootstrap for optimizing the number of units of competitive associative nets2005

    • Author(s)
      S.Kurogi, T.Nishida, S.Tanaka, Y.Fuchikawa
    • Journal Title

      12-th International Conference on Neural Information Processing Proceedings

      Pages: 410-415

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary 2005 Annual Research Report
  • [Journal Article] Temperature Control of RCA cleaning solutions using batch learning competitive associative net2004

    • Author(s)
      S.Kurogi, N.Araki, H.Miyamoto, Y.Fuchikawa, T.Nishida, M.Mimata, K.Itoh
    • Journal Title

      Proceedings of the 8th World Multi-Conference on Systems, Cybernetics and Informatics (SCI2004) Vol. V

      Pages: 18-23

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] A batch learning method for competitive associative net and its application to function approximation2004

    • Author(s)
      S.Kurogi, M.Sawa, T.Ueno, Y.Fuchikawa
    • Journal Title

      Proceedings of the 8th World Multi-Conference on Systems, Cybernetics and Informatics (SCI2004) Vol. V

      Pages: 24-28

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Batch learning competitive associative net and its application to time series prediction2004

    • Author(s)
      S.Kurogi, T.Ueno, M.Sawa
    • Journal Title

      Proceedings of International Joint Conference on Neural Networks (IJCNN2004) (CD-ROM)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary 2004 Annual Research Report
  • [Journal Article] Strategies which we have used for NIPS04 regression problems2004

    • Author(s)
      S.Kurogi, M.Sawa, S.Tanaka
    • Journal Title

      Technical Report on Evaluating Predictive Uncertainty Challenge at NIPS2004 (http://predict,kyb.tuebingen.mpg.de/)

      Pages: 1-11

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Temperature Control of RCA cleaning solutions using batch learning competitive associative net2004

    • Author(s)
      S.Kurogi, N.Araki, H.Miyamoto, Y.Fuchikawa, T.Nishida, M.Mimata, K.Itoh
    • Journal Title

      Proceedings of the 8th World Multi-Conference on Systems, Cybernetics and Informatics (SCI2004)

      Pages: 18-23

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] A batch learning method for competitive associative net and its application to function approximation2004

    • Author(s)
      S.Kurogi, M.Sawa, T.Ueno, Y.Fuchikawa
    • Journal Title

      Proceedings of the 8th World Multi-Conference on Systems, Cybernetics and Informatics (SCI2004)

      Pages: 24-28

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Strategies which we have used for NIPSO4 regression problems2004

    • Author(s)
      S.Kurogi, M.Sawa, S.Tanaka
    • Journal Title

      Technical Report on Evaluating Predictive Uncertainty Challenge at NIPS2004 (http://predict. kyb. tuebingen. mpg. de/)

      Pages: 1-11

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Temperature Control of RCA cleaning solutions using batch learning competitive associative net2004

    • Author(s)
      S.Kurogi, N.Araki, H.Miyamoto, Y.Fuchikawa, T.Nishida, M.Mimata, K.Itoh
    • Journal Title

      Proceedings of the 8th World Multi-Conference on Systems, Cybernetics and Informatics (SCI2004) Vol.V

      Pages: 18-23

    • Related Report
      2004 Annual Research Report
  • [Journal Article] A batch learning method for competitive associative net and its application to function approximation2004

    • Author(s)
      S.Kurogi, M.Sawa, T.Ueno, Y.Fuchikawa
    • Journal Title

      Proceedings of the 8th World Multi-Conference on Systems, Cybernetics and Informatics (SCI2004) Vol.V

      Pages: 24-28

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Strategies which we have used for NIPS04 regression problems2004

    • Author(s)
      S.Kurogi, M.Sawa, S.Tanaka
    • Journal Title

      Technical Report on Evaluating Predictive Uncertainty Challenge at NIPS2004 (http://predict.kyb.tuebingen.mpg.de/)

      Pages: 1-11

    • Related Report
      2004 Annual Research Report
  • [Book] 書名 : Lecture Notes in Artificial Intelligence 3944 (LNAI 3944)分担章の題目 : Competitive associative nets and cross-validation for estimating predictive uncertainty on regression problems2006

    • Author(s)
      編者:J.Quinonero-Candela et al., 分担章の著者:Shuichi Kurogi, Miho Sawa, Shinya Tanaka
    • Publisher
      Springer-Verlag Berlin Heidelberg
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Book] 書名:Lecture Notes in Artificial Intelligence 3944 (LNAI 3944) 分担章の題目:Competitive associative nets and cross-validation for estimating predictive uncertainty on regression problems2006

    • Author(s)
      編者:J.Quinonero-Candela et al.分担章の著者:Shuichi Kurogi, Miho Sawa, Shinya Tanaka
    • Publisher
      Springer-Verlag Berlin Heidelberg
    • Related Report
      2005 Annual Research Report

URL: 

Published: 2004-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi