• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

入力点に依存した汎化能力推定法に関する研究

Research Project

Project/Area Number 17700142
Research Category

Grant-in-Aid for Young Scientists (B)

Allocation TypeSingle-year Grants
Research Field Intelligent informatics
Research InstitutionTokyo Institute of Technology

Principal Investigator

杉山 将  Tokyo Institute of Technology, 大学院・情報通工学研究科, 准教授 (90334515)

Project Period (FY) 2005 – 2007
Project Status Completed (Fiscal Year 2007)
Budget Amount *help
¥3,500,000 (Direct Cost: ¥3,500,000)
Fiscal Year 2007: ¥1,000,000 (Direct Cost: ¥1,000,000)
Fiscal Year 2006: ¥1,000,000 (Direct Cost: ¥1,000,000)
Fiscal Year 2005: ¥1,500,000 (Direct Cost: ¥1,500,000)
Keywords機械学習 / 関数近似 / 教師付き学習 / 共変量シフト / 汎化誤差 / 交差確認法 / ベイズ推定 / ブレインコンピュータインターフェース / 汎化能力 / モデル選択 / 不偏性 / 入力点依存 / 準教師付き学習 / ラベル無しデータ
Research Abstract

本年度は,共変量シフトの場面での汎化能力推定に焦点を合せ,汎化誤差の理論解析,実用的な汎化誤差推定法の開発,およびその応用研究を行なった.汎化誤差の理論解析に関しては,ベイズ推定と呼ばれる学習法の汎化誤差を対象に,古典的な解析法では対応できなかった特異モデルをも含む一般的な設定での汎化誤差解析を行なった.実用的な汎化誤差の推定法に関しては,標準的な汎化誤差推定法である交差確認法を拡張し,共変量シフトに対応できるようにした.これにより,出力が実数値をとる回帰問題だけでなく,出力が離散的なカテゴリである分類問題に対しても,汎化誤差をうまく推定できるようになった.応用研究に関しては,開発した汎化誤差推定アルゴリズムをブレイン・コンピュータインターフェースに応用した.ブレイン・コンピュータインターフェースは脳波でコンピュータを動かす新しいマン・マシンインターフェースであり,近年盛んに研究されている.しかし,脳波の非定常性のため,従来の学習法ではうまく脳波の分類が行なえないという問題があった.今回開発した共変量シフト適応法を用いて,非定常性な脳波データをうまく分類する方法を確立し,その有効性を実証した.

Report

(3 results)
  • 2007 Annual Research Report
  • 2006 Annual Research Report
  • 2005 Annual Research Report
  • Research Products

    (21 results)

All 2007 2006 2005 Other

All Journal Article (15 results) (of which Peer Reviewed: 3 results) Presentation (4 results) Book (1 results) Remarks (1 results)

  • [Journal Article] Generalization error estimation for non-linear learning methods.2007

    • Author(s)
      Sugiyama, M.
    • Journal Title

      IEICE Transactions on Fundamentals of Electronics. Communications and Computer Sciences E90-A

      Pages: 1496-1499

    • NAID

      110007538081

    • Related Report
      2007 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Covariate shift adaptation by importance weighted cross validation.2007

    • Author(s)
      Sugiyama, M., Krauledat, M., & Moller, K.-R.
    • Journal Title

      Journal of Machine Learning Research 8

      Pages: 985-1005

    • Related Report
      2007 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Analytic optimization of adaptive ridge parameters based on regularized subspace information criterion.2007

    • Author(s)
      Gokita, S., Sugiyama, M., & Sakurai, K
    • Journal Title

      IEICE Transactions on Fundamentals of Electronic, Communications and Computer Sciences E90-A

      Pages: 2584-2592

    • NAID

      110007537996

    • Related Report
      2007 Annual Research Report
    • Peer Reviewed
  • [Journal Article] A new algorithm of non-Gaussian component analysis with radial kernel functions2007

    • Author(s)
      Kawanabe, M., Sugiyama, M., Blanchard, G., Muller, K.-R
    • Journal Title

      Annals of the Institute of Statistical Mathematics vol.59,no.1

      Pages: 57-75

    • Related Report
      2006 Annual Research Report
  • [Journal Article] 共変量シフト下での教師付き学習2006

    • Author(s)
      杉山 将
    • Journal Title

      日本神経回路学会誌 vol.13,no.3

      Pages: 111-118

    • NAID

      10018266940

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Local Fisher discriminant analysis for supervised dimensionality reduction2006

    • Author(s)
      Sugiyama, M.
    • Journal Title

      Proceedings of 23rd International Conference on Machine Learning, Pittsburgh, Pennsylvania, USA, 2006.6.25-29

      Pages: 905-912

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Obtaining the best linear unbiased estimator of noisy signals by non-Gaussian component analysis2006

    • Author(s)
      Sugiyama, M., Kawanabe, M., Blanchard, G., Spokoiny, V., Muller, K.-R
    • Journal Title

      Proceedings of 2006 IEEE International Conference on Acoustics, Speech, and Signal Processing, Toulouse, France, 2006.5.14-19. vol,3

      Pages: 608-611

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Importance-weighted cross-validation for covariate shift2006

    • Author(s)
      Sugiyama, M., Blankertz, B., Krauledat, M., Donehege, G., Muller, K.-R
    • Journal Title

      Pattern Recognition, Lecture Notes in Computer Science vol.4147

      Pages: 354-363

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Mixture regression for covariate shift2006

    • Author(s)
      Storkey, A., Sugiyama, M
    • Journal Title

      Advances in Neural Information Processing Systems 19

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Active learning in approximately linear regression based on conditional expectation generalization error.2006

    • Author(s)
      Sugiyama, M.
    • Journal Title

      Journal of Machine Learning Research 7.Jan

      Pages: 141-166

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Generalization error estimation under covariate shift.2005

    • Author(s)
      Sugiyama, M., Mueller, K.-R.
    • Journal Title

      第8回情報論的学習理論ワークショップ予稿集

      Pages: 21-26

    • Related Report
      2005 Annual Research Report
  • [Journal Article] An active learning algorithm for approximately correct models.2005

    • Author(s)
      Sugiyama, M.
    • Journal Title

      第8回情報論的学習理論ワークショップ予稿集

      Pages: 57-62

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Model selection under covariate shift.2005

    • Author(s)
      Sugiyama, M., Mueller, K.-R.
    • Journal Title

      Artificial Neural Networks : Formal Models and Their Applications 3697

      Pages: 235-240

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 正則化汎化誤差推定量を用いた解析的モデル最適化.2005

    • Author(s)
      櫻井啓介, 杉山 将
    • Journal Title

      画像の認識・理解シンポジウム2005(MIRU2005)論文集

      Pages: 1013-1020

    • Related Report
      2005 Annual Research Report
  • [Journal Article] A method of active learning with model selection.2005

    • Author(s)
      Hanhijarvi, S., Sugiayama, M.
    • Journal Title

      電子情報通信学会技術研究報告 NC2005-36

      Pages: 37-42

    • Related Report
      2005 Annual Research Report
  • [Presentation] Direct importance estimation with model selection and its application to covariate shift adaptation.2007

    • Author(s)
      Sugiyama, M., Nakajima, S., Kashim a, H., von Bunau, P. & Kawanabe, M.
    • Organizer
      Advances in Neural Information Processing Systems
    • Place of Presentation
      バンクーバー,カナダ
    • Related Report
      2007 Annual Research Report
  • [Presentation] Asymptotic Bayesian generalization error when training and test distributions are different.2007

    • Author(s)
      Yamazaki, K., Kawanabe, M., Watanabe, S. Sugiyama, M, & Muller, K.-R.
    • Organizer
      24th International Conference on Machine Learning
    • Place of Presentation
      オレゴン,アメリカ
    • Related Report
      2007 Annual Research Report
  • [Presentation] KuUback-Leibler importance estimation procedure for covariate shift adaptation.2007

    • Author(s)
      Sugiyama, M., Nakajima, S., Kashima, H., von Bunau, P.& Kawanabe, M
    • Organizer
      the International Workshop on Data-Mining and Statistical Sciences
    • Place of Presentation
      東京,日本
    • Related Report
      2007 Annual Research Report
  • [Presentation] Supervised learning under covariate shift.2007

    • Author(s)
      Sugiyama, M.
    • Organizer
      13th Symposium on Sensing via Image Information,
    • Place of Presentation
      横浜,日本
    • Related Report
      2007 Annual Research Report
  • [Book] パターン認識と機械学習:ペイズ理論による統計的予測,2007

    • Author(s)
      元田 浩, 栗田 多喜夫, 樋口 知之, 松本 裕治, 村田 昇, (編), 赤穂 昭太郎, 神嶌 敏弘, 杉山 将, 小野田 崇, 池田 和司, 鹿島 久嗣, 賀沢 秀人, 中島 伸一, 竹内 純一, 持橋 大地, 小山 聡, 井手 剛, 篠田 浩一, 山川 宏, (訳)
    • Total Pages
      350
    • Publisher
      シュプリンガー・ジャパン
    • Related Report
      2007 Annual Research Report
  • [Remarks]

    • URL

      http://sugiyama-www.cs.titech.ac.jp/~sugi/research-jp.html

    • Related Report
      2007 Annual Research Report

URL: 

Published: 2005-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi