• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Structure Learning Theory and Birational Geometry

Research Project

Project/Area Number 23500172
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Research Field Intelligent informatics
Research InstitutionTokyo Institute of Technology

Principal Investigator

WATANABE SUMIO  東京工業大学, 総合理工学研究科(研究院), 教授 (80273118)

Project Period (FY) 2011-04-28 – 2015-03-31
Project Status Completed (Fiscal Year 2014)
Budget Amount *help
¥3,380,000 (Direct Cost: ¥2,600,000、Indirect Cost: ¥780,000)
Fiscal Year 2014: ¥650,000 (Direct Cost: ¥500,000、Indirect Cost: ¥150,000)
Fiscal Year 2013: ¥650,000 (Direct Cost: ¥500,000、Indirect Cost: ¥150,000)
Fiscal Year 2012: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2011: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Keywords双有理幾何学 / 構造学習理論 / ベイズ自由エネルギー / WBIC / 双有理不変量 / 代数幾何 / 周辺尤度 / 汎化誤差 / 情報量規準 / 特異揺らぎ / 実対数閾値 / WAIC / 学習理論 / 漸近解析 / 逆温度
Outline of Final Research Achievements

In statistical machine learning, it is well known that the appropriate model and prior for a given set of training samples is chosen by minimization of the Bayesian free energy. However, there has been no method to estimate the Bayesian free energy if the posterior distribution can not be approximated by any normal distribution. In this research, we created a new concept, a widely applicable Bayesian information criterion (WBIC), and proved that WBIC has the same asymptotic behavior as the Bayesian free energy, based on the birational geometry. The obtained theorem enables us to choose the optimal model for a given set of training samples, even if the model has hierarchical structures.

Report

(5 results)
  • 2014 Annual Research Report   Final Research Report ( PDF )
  • 2013 Research-status Report
  • 2012 Research-status Report
  • 2011 Research-status Report
  • Research Products

    (21 results)

All 2015 2014 2013 2012 2011 Other

All Journal Article (4 results) (of which Peer Reviewed: 3 results) Presentation (12 results) (of which Invited: 5 results) Book (2 results) Remarks (3 results)

  • [Journal Article] A widely applicable Bayesian information criterion2013

    • Author(s)
      渡邊澄夫
    • Journal Title

      Journal of Machine Learning Research

      Volume: 14 Pages: 867-897

    • Related Report
      2012 Research-status Report
    • Peer Reviewed
  • [Journal Article] Statistical Learning Theory of Quasi-Regular Cases2012

    • Author(s)
      山田耕史 渡邊澄夫
    • Journal Title

      IEICE Transactions

      Volume: E95A Pages: 2479-2487

    • NAID

      10031161384

    • Related Report
      2012 Research-status Report
    • Peer Reviewed
  • [Journal Article] Two birational invariants in statistical learning theory2012

    • Author(s)
      渡邊澄夫
    • Journal Title

      IRMA Lectures in Mathematics and Theoretical Physics

      Volume: 20 Pages: 249-268

    • Related Report
      2012 Research-status Report
  • [Journal Article] Two Design Methods of Hyperparameters in Variational Bayes Learning for Bernoulli Mixtures2011

    • Author(s)
      Daisuke Kaji, Sumio Watanabe
    • Journal Title

      Neurocomputing

      Volume: 74 Pages: 20022007-20022007

    • Related Report
      2011 Research-status Report
    • Peer Reviewed
  • [Presentation] 情報量規準WAICによるLASSO学習の最適化と都市データ解析への応用2015

    • Author(s)
      宮崎大 渡辺澄夫
    • Organizer
      電子情報通信学会ニューロコンピューティング研究会
    • Place of Presentation
      玉川大学
    • Year and Date
      2015-03-17
    • Related Report
      2014 Annual Research Report
  • [Presentation] 尤度関数がガウス近似できないときの統計的学習の評価指標について2014

    • Author(s)
      渡邊澄夫
    • Organizer
      電子情報通信学会音声研究会
    • Place of Presentation
      花巻温泉ホテル, 花巻市
    • Year and Date
      2014-07-24 – 2014-07-26
    • Related Report
      2014 Annual Research Report
    • Invited
  • [Presentation] irational Invariants in Marginal Likelihood Computation2014

    • Author(s)
      渡邊澄夫
    • Organizer
      2014 NIMS Thematic Program on Algebraic Statistics
    • Place of Presentation
      National Institute of Mathematical Sciences, Daejeon, South Korea
    • Year and Date
      2014-07-14 – 2014-07-17
    • Related Report
      2014 Annual Research Report
    • Invited
  • [Presentation] Discovery Phenomenon and Information Criteria2014

    • Author(s)
      渡邊澄夫
    • Organizer
      The Seventh Workshop on Information Theoretic Methods in Science and Engineering
    • Place of Presentation
      Sheraton Waikiki Hotel, Honolulu, USA
    • Year and Date
      2014-07-05 – 2014-07-07
    • Related Report
      2014 Annual Research Report
    • Invited
  • [Presentation] Model Selection for Non-Regular Statistical Models2013

    • Author(s)
      Sumio Watanabe
    • Organizer
      Joint Statistical Meeting
    • Place of Presentation
      Canada, Motreal
    • Related Report
      2013 Research-status Report
    • Invited
  • [Presentation] WAIC and WBIC are Information Criteria for Singular Statistical Model Evaluation2013

    • Author(s)
      Sumio Watanabe
    • Organizer
      WITMSE 2013
    • Place of Presentation
      The University of Tokyo
    • Related Report
      2013 Research-status Report
    • Invited
  • [Presentation] 学習において一般漸近理論と正則漸近理論が成立するために十分なサンプル数の相違について2013

    • Author(s)
      渡辺澄夫
    • Organizer
      電子情報通信学会NC研究会
    • Place of Presentation
      岐阜大学
    • Related Report
      2013 Research-status Report
  • [Presentation] 最急降下法とMCMC法による情報量規準WBICに基づく階層型ニューラルネットワークのモデル選択2013

    • Author(s)
      玉井雄介 渡辺澄夫
    • Organizer
      電子情報通信学会IBISML研究会
    • Place of Presentation
      東京工業大学
    • Related Report
      2013 Research-status Report
  • [Presentation] Information Criterion for Variational Bayes Learning in Regular and Singular Cases2012

    • Author(s)
      山田耕史 渡邊澄夫
    • Organizer
      6th International Conference on Soft Computing and Intelligent Systems
    • Place of Presentation
      Kobe Convention Center
    • Related Report
      2012 Research-status Report
  • [Presentation] Algebraic geometry and model selection2011

    • Author(s)
      Sumio Watanabe
    • Organizer
      Workshop of American Institute of Mathematics(招待講演)
    • Place of Presentation
      アメリカ数学研究所
    • Related Report
      2011 Research-status Report
  • [Presentation] 観測の構造に現れる物理学と数学2011

    • Author(s)
      渡辺澄夫
    • Organizer
      物性若手夏の学校サブゼミ(招待講演)
    • Place of Presentation
      富士吉田市ホテルエバーグリーン富士
    • Related Report
      2011 Research-status Report
  • [Presentation] 実現可能でなく正則でない場合の学習理論2011

    • Author(s)
      渡辺澄夫
    • Organizer
      電子情報通信学会NC研究会
    • Place of Presentation
      神戸大学
    • Related Report
      2011 Research-status Report
  • [Book] ランダム行列の数理と科学2014

    • Author(s)
      渡邊澄夫, 永尾太郎, 樺島祥介, 田中利幸, 中島伸一
    • Total Pages
      170
    • Publisher
      森北出版
    • Related Report
      2014 Annual Research Report
  • [Book] ベイズ統計の理論と方法2012

    • Author(s)
      渡邊澄夫
    • Total Pages
      200
    • Publisher
      コロナ社
    • Related Report
      2012 Research-status Report
  • [Remarks] 渡辺澄夫

    • URL

      http://watanabe-www.math.dis.titech.ac.jp/users/swatanab/index-j.html

    • Related Report
      2014 Annual Research Report
  • [Remarks] 渡辺澄夫

    • URL

      http://watanabe-www.math.dis.titech.ac.jp/users/swatanab/index-j.html

    • Related Report
      2013 Research-status Report
  • [Remarks] 渡辺澄夫

    • URL

      http://watanabe-www.math.dis.titech.ac.jp/users/swatanab/index-j.html

    • Related Report
      2012 Research-status Report

URL: 

Published: 2011-08-05   Modified: 2019-07-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi