• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Research of Sequential Multitask Learning and ItsApplication to Patlern Recognition

Research Project

Project/Area Number 18500174
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field Sensitivity informatics/Soft computing
Research InstitutionKobe University

Principal Investigator

OZAWA Seiichi  Kobe University, Graduate School of Engneering, Associate Professor (70214129)

Project Period (FY) 2006 – 2007
Project Status Completed (Fiscal Year 2007)
Budget Amount *help
¥4,110,000 (Direct Cost: ¥3,600,000、Indirect Cost: ¥510,000)
Fiscal Year 2007: ¥2,210,000 (Direct Cost: ¥1,700,000、Indirect Cost: ¥510,000)
Fiscal Year 2006: ¥1,900,000 (Direct Cost: ¥1,900,000)
KeywordsMachine Learning / Multitask Learning / Neural Networks / Incremental Learning / Pattern Recognition / Principal Component Analysis / Features Extraction / Kernel Method
Research Abstract

This research project developed a new learning algorithm for the multi-task pattern recognition problem. This project considers learning multiple classification tasks online where no information is ever provided about the task category of a training example. The algorithm thus needs an automated task recognition capability to properly learn the different classification tasks. The learning mode is “online" where training examples for different tasks are mixed in a random fashion and given sequentially one after another. It is assumed that the classification tasks are related to each other and that their training examples appear in random sequences during “online training." Thus, the learning algorithm has to continually switch from learning one task to another whenever the training examples change to a different task. This also implies that the learning algorithm has to detect task changes automatically and fast and utilize knowledge of previous tasks to learn new tasks. Overall, automated task recognition falls in the category of unsupervised learning since no information about task categories of training examples is provided to the algorithm. The performance of the algorithm is evaluated using several artificially generated and three UCI datasets. The experiments in this project verify that the proposed algorithm can indeed acquire and accumulate task knowledge and that the transfer of knowledge from tasks already learned enhances the speed of knowledge acquisition on new tasks.

Report

(3 results)
  • 2007 Annual Research Report   Final Research Report Summary
  • 2006 Annual Research Report
  • Research Products

    (45 results)

All 2007 2006 Other

All Journal Article (18 results) (of which Peer Reviewed: 10 results) Presentation (27 results)

  • [Journal Article] A Learning Algorithm of Boosting Kernel Discriminant Analysis for Pattern Classification2007

    • Author(s)
      Shinji Kita
    • Journal Title

      IEICE Trans. on Information and Systems E90-D

      Pages: 1853-1863

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Annual Research Report 2007 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] An Efficient Incremental Kernel Principal Component Analysis for Online Feature Selection2007

    • Author(s)
      Yohei Takeuchi
    • Journal Title

      Proc. IEEE/INNS Int. Joint Conf. on Neural Networks (CD-ROM)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Annual Research Report 2007 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] Boosting Kernel Discriminant Analysis for Pattern Classification2007

    • Author(s)
      Shinji Kita
    • Journal Title

      Proc. of Int. Symposium on Intelligent Signal Processing and Communication Systems (CD-ROM)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Annual Research Report 2007 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] Learning Algorithm of Boosting Kernel Discriminant Analysis for Pattern Classification2007

    • Author(s)
      Shinji, Kita, Seiichi, Ozawa, Satoshi, Maekawa, Shigeo, Abe
    • Journal Title

      IEICE Trans. on Information and Systems Vol. E90-D, No. 11

      Pages: 1853-1863

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] Boosting Kernel Discriminant Analysis for Pattern Classification2007

    • Author(s)
      Shinji, Eta, Seiichi, Ozawa, Satoshi, Maekawa, Shigeo, Abe
    • Journal Title

      Proc. of Int. Symposium on Intelligent Signal Processing and Communication Systems

      Pages: 4-4

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] An Efficient Incremental Kernel Principal Component Analysis for Online Feature Selection2007

    • Author(s)
      Yohei, Takeuchi, Seiichi, Ozawa, Shigeo, Abe
    • Journal Title

      Proc. Int. Joint Conf. on Neural Networks

      Pages: 6-6

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] 分類情報に基づく教師あり独立成分分析による特徴抽出2006

    • Author(s)
      高畑 宏樹
    • Journal Title

      電気学会論文誌(C分冊) 第126巻4号

      Pages: 542-547

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary 2006 Annual Research Report
    • Peer Reviewed
  • [Journal Article] An Incremental Learning Algorithm of Ensemble Classifier Systems2006

    • Author(s)
      木寺 卓也
    • Journal Title

      Proc. of World Congress on Computational Intelligence

      Pages: 6453-6459

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary 2006 Annual Research Report
    • Peer Reviewed
  • [Journal Article] An Incremental Principal Component Analysis for Chunk Data2006

    • Author(s)
      小澤 誠一
    • Journal Title

      Proc. of World Congress on Computational Intelligence

      Pages: 10493-10500

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary 2006 Annual Research Report
    • Peer Reviewed
  • [Journal Article] An Incremental Learning Algorithm of Ensemble Classifier Systems2006

    • Author(s)
      Takuya, Kidera, Seiichi, Ozawa, Shigeo, Abe
    • Journal Title

      Proc. World Congress on Computational Intelligence

      Pages: 6453-6459

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] An Incremental Principal Component Analysis for Chunk Data2006

    • Author(s)
      Seiichi, Ozawa, Shaoning, Pang, Nikola, Kasabov
    • Journal Title

      Proc. World Congress on Computational Intelligence

      Pages: 10493-10500

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] Feature Extraction by Supervised Independent Component Analysis Based on Category Information2006

    • Author(s)
      Hiroki, Takabatake, Manabu, Kotani, Seiichi, Ozawal
    • Journal Title

      IEEJ Transactions on Electronics. Information and Systems Vol. 126, No. 4

      Pages: 542-547

    • NAID

      210000177422

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] Incremental Learning of Chunk Data for On-line Pattern Classification Systems

    • Author(s)
      Seiichi Ozawa
    • Journal Title

      IEEE Trans. on Neural Networks

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] Adaptive Face Recognition System Using Fast Incremental Principal Component Analysis

    • Author(s)
      Seiichi Ozawa
    • Journal Title

      Proc. of 14th Int. Conf. on Neural Information Processing

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] Incremental Learning of Chunk Data for On-line Pattern Classification Systems

    • Author(s)
      Seiichi, Ozawa, Shaoning, Pang, Nikola, Kasabov
    • Journal Title

      IEEE Trans. on Neural Networks (in press)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] Adaptive Face Recognition System Using Fast Incremental Principal Component Analysis

    • Author(s)
      Seiichi, Ozawa, Shaoning, Pang, Nikola, Kasabov
    • Journal Title

      Proc. of 14th Int. Conf. on Neural Information Processing (in press)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] Incremental Learning of Chunk Data for On-line Pattern Classification Systems

    • Author(s)
      Seiichi Ozawa
    • Journal Title

      IEEE Trans. on Neural Networks (印刷中)

    • Related Report
      2007 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Adaptive Face Recognition System Using Fast Incremental Principal Component Analysis

    • Author(s)
      Seiichi Ozawa
    • Journal Title

      Proc. of 14th Int. Conf. on Neural Information Processing (印刷中)

    • Related Report
      2007 Annual Research Report
    • Peer Reviewed
  • [Presentation] 特徴選択による追加学習型カーネル主成分分析の高速化とその性能評価2007

    • Author(s)
      竹内 洋平
    • Organizer
      平成19年電気関係学会関西支部連合大会
    • Place of Presentation
      神戸大学
    • Year and Date
      2007-11-17
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Annual Research Report 2007 Final Research Report Summary
  • [Presentation] マクロアクション生成機能を有する強化学習アルゴリズム2007

    • Author(s)
      恩田 宏
    • Organizer
      平成19年電気関係学会関西支部連合大会
    • Place of Presentation
      神戸大学
    • Year and Date
      2007-11-17
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Annual Research Report 2007 Final Research Report Summary
  • [Presentation] Speedup of Incremental Kernel Principal Component Analysis and Its Performance Evaluation2007

    • Author(s)
      Yohei, Takeuchi, Seiichi, Ozawa, Shigeo, Abe
    • Organizer
      KJCIEE2007
    • Place of Presentation
      Kobe University
    • Year and Date
      2007-11-17
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] Reinforcement Learning Algorithm with Function of Generating Macro-Actions2007

    • Author(s)
      Hiroshi, Onda, Seichi, Ozawa
    • Organizer
      KJCIEE2007
    • Place of Presentation
      Kobe University
    • Year and Date
      2007-11-17
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] An Online Face Recognition System with Incremental Learning Ability2007

    • Author(s)
      Seiichi Ozawa
    • Organizer
      SICE Annual Conf.2007
    • Place of Presentation
      香川大学
    • Year and Date
      2007-09-20
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] An online face recognition system with incremental learning ability2007

    • Author(s)
      Seiichi, Ozawa, Michiro, Hirai, Shigeo, Abe
    • Organizer
      SICE Annual Conf. 2007
    • Place of Presentation
      Kagawa University
    • Year and Date
      2007-09-20
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] An Online Face Recognition System with Incremental Learning Ability2007

    • Author(s)
      Seiichi Ozawa
    • Organizer
      SICE Annual Conf. 2007
    • Place of Presentation
      香川大学
    • Year and Date
      2007-09-20
    • Related Report
      2007 Annual Research Report
  • [Presentation] 逐次マルチタスク・パターン認識におけるタスク間関連度を用いた知識移転アルゴリズム2007

    • Author(s)
      西川 仁
    • Organizer
      平成19年電気学会電子・情報・システム部門大会
    • Place of Presentation
      大阪府立大学
    • Year and Date
      2007-09-04
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Annual Research Report 2007 Final Research Report Summary
  • [Presentation] 追加学習型カーネル主成分分析の開発とその性能評価2007

    • Author(s)
      竹内 洋平
    • Organizer
      平成19年電気学会電子・情報・システム部門大会
    • Place of Presentation
      大阪府立大学
    • Year and Date
      2007-09-04
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Annual Research Report 2007 Final Research Report Summary
  • [Presentation] マクロアクション生成機能を有する強化学習エージェントモデル2007

    • Author(s)
      恩田 宏
    • Organizer
      平成19年電気学会電子・情報・システム部門大会
    • Place of Presentation
      大阪府立大学
    • Year and Date
      2007-09-04
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Annual Research Report 2007 Final Research Report Summary
  • [Presentation] Knowledge Transfer Algorithm Using Task Relatedness for Sequential Multi-task Pattern Recognition2007

    • Author(s)
      Hitoshi, Nishikawa, Seiichi Ozawa
    • Organizer
      EISS2007
    • Place of Presentation
      Osaka Prefecture University
    • Year and Date
      2007-09-04
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] Development of Incremental Kernel Principal Component Analysis and Its Performance Evaluation2007

    • Author(s)
      Yohei, Takeuchi, Seiichi, Ozawa, Shigeo, Abe
    • Organizer
      EISS2007
    • Place of Presentation
      Osaka Prefecture University
    • Year and Date
      2007-09-04
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] Reinforcement Learning Agent Model with Function of Generating Macro-Actions2007

    • Author(s)
      Hiroshi, Onda, Seichi, Ozawa
    • Organizer
      EISS2007
    • Place of Presentation
      Osaka Prefecture University
    • Year and Date
      2007-09-04
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] 追加学習型カーネル主成分分析の開発2007

    • Author(s)
      竹内 洋平
    • Organizer
      第51回システム制御情報学会研究発表講演会
    • Place of Presentation
      京都テルサ
    • Year and Date
      2007-05-18
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Annual Research Report 2007 Final Research Report Summary
  • [Presentation] 逐次マルチタスク学習における選択的知識移転に関する基礎的研究2007

    • Author(s)
      西川 仁
    • Organizer
      第51回システム制御情報学会研究発表講演会
    • Place of Presentation
      京都テルサ
    • Year and Date
      2007-05-18
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Annual Research Report 2007 Final Research Report Summary
  • [Presentation] Development of Incremental Kernel Prinrinal Cmmnnnont Analvci2007

    • Author(s)
      Yohei, Takeuchi, Seiichi, Ozawa, Shigeo, Abe
    • Organizer
      SCP07
    • Place of Presentation
      Kyoto Terrsa
    • Year and Date
      2007-05-18
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] Basic Research on Selective Knowledge Transfer \\ for Sequential Multi-task Learning2007

    • Author(s)
      Hitoshi, Nishikawa, Seiichi, Ozawa
    • Organizer
      SCP07
    • Place of Presentation
      Kyoto Terrsa
    • Year and Date
      2007-05-18
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] オンライン型特徴選択とニューラルネットの追加学習2007

    • Author(s)
      小澤 誠一
    • Organizer
      第51回システム制御情報学会研究発表講演会
    • Place of Presentation
      京都テルサ
    • Year and Date
      2007-05-17
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Annual Research Report 2007 Final Research Report Summary
  • [Presentation] Online Feature Selection \\ and Incremental Learning of Neural Network2007

    • Author(s)
      Seiichi, Ozawa
    • Organizer
      SCP07
    • Place of Presentation
      Kyoto Terrsa
    • Year and Date
      2007-05-17
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] マクロアクション生成による強化学習の高速化2006

    • Author(s)
      恩田 宏
    • Organizer
      第49回自動制御連合講演会
    • Place of Presentation
      神戸大学
    • Year and Date
      2006-11-26
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] Speed-up of Reinforcement Learning by Generating Macro-actions2006

    • Author(s)
      Hiroshi, Onda, Makoto, Murata, Seiichi, Ozawa
    • Organizer
      Rengo2006
    • Place of Presentation
      Kobe University
    • Year and Date
      2006-11-26
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] A Multi-task Learning Algorithm for Pattern Recognition2006

    • Author(s)
      Keyu Zhang
    • Organizer
      第49回自動制御連合講演会
    • Place of Presentation
      神戸大学
    • Year and Date
      2006-11-25
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] 追加学習型カーネル主成分分析の評価2006

    • Author(s)
      竹内 洋平
    • Organizer
      平成18年電気関係学会関西支部連合大会
    • Place of Presentation
      大阪工業大学
    • Year and Date
      2006-11-25
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] A Multi-task Learning Algorithm for Pattern Recognition2006

    • Author(s)
      Keyu, Zhang, Seiichi, Ozawa
    • Organizer
      Rengo2006
    • Place of Presentation
      Kobe University
    • Year and Date
      2006-11-25
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] Evaluation of Incremental Kernel Prinrinal Component Analysis2006

    • Author(s)
      Shosuke, Kimura, Yohei, Takeuchi, Seiichi, Ozawa, Shigeo, Abe
    • Organizer
      KJCIEE2006
    • Place of Presentation
      Osaka Instututc Technology
    • Year and Date
      2006-11-25
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] ブースティング識別器の追加学習に関する研究2006

    • Author(s)
      木寺 卓也
    • Organizer
      第50回システム制御情報学会研究発表講演会
    • Place of Presentation
      京都テルサ
    • Year and Date
      2006-05-10
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] A study on hicremental Learning fur Boosting Classifier2006

    • Author(s)
      Takuya, Kidera, Seiichi, Ozawa, Shigeo, Abe
    • Organizer
      SCP06
    • Place of Presentation
      Kyoto Terrsa
    • Year and Date
      2006-05-10
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary

URL: 

Published: 2006-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi