• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

A comprehensive study of learning, inference, and inverse problems based on the spin-glass theory

Research Project

Project/Area Number 26870185
Research Category

Grant-in-Aid for Young Scientists (B)

Allocation TypeMulti-year Fund
Research Field Theory of informatics
Mathematical physics/Fundamental condensed matter physics
Research InstitutionTokyo Institute of Technology

Principal Investigator

Obuchi Tomoyuki  東京工業大学, 情報理工学院, 助教 (40588448)

Project Period (FY) 2014-04-01 – 2017-03-31
Project Status Completed (Fiscal Year 2016)
Budget Amount *help
¥3,900,000 (Direct Cost: ¥3,000,000、Indirect Cost: ¥900,000)
Fiscal Year 2016: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Fiscal Year 2015: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2014: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Keywords逆問題・多自由度推定 / 統計的学習理論・機械学習 / 統計物理学 / 最大エントロピー法 / スパースモデリング / 逆問題 / 機械学習 / ニューラルネットワーク / ベイズ統計
Outline of Final Research Achievements

The purpose of this study is to clarify general and theoretical aspects of statistical learning theory and inverse problems by using the spin-glass theory from statistical physics. The objective of the discipline is to infer a correct probability distribution from a limited number of observations. Hence common important theoretical questions are as follows: Clarifying the achievable theoretic limit given the limited observations; designing algorithms to achieve the limit; applying the algorithms to real-world dataset.
Our actual research processes were roughly categorized into two processes: One is to clarify the theoretical limit by utilizing the spin-glass theory; the other is to invent algorithms and apply them to neurons' firing data and natural image processing.
Our study has clarified that two commonly used frameworks, the maximum entropy principle and sparse modelling, have their own theoretical limits and have contrasting pros and cons.

Report

(4 results)
  • 2016 Annual Research Report   Final Research Report ( PDF )
  • 2015 Research-status Report
  • 2014 Research-status Report
  • Research Products

    (35 results)

All 2017 2016 2015 2014 Other

All Int'l Joint Research (2 results) Journal Article (14 results) (of which Int'l Joint Research: 3 results,  Peer Reviewed: 14 results,  Open Access: 9 results,  Acknowledgement Compliant: 14 results) Presentation (18 results) (of which Int'l Joint Research: 10 results,  Invited: 2 results) Remarks (1 results)

  • [Int'l Joint Research] Ecole Normale Superieure/Institut de la Vision, INSERM and UMPC(フランス)

    • Related Report
      2016 Annual Research Report
  • [Int'l Joint Research] Ecole Normale Superieure(France)

    • Related Report
      2015 Research-status Report
  • [Journal Article] Random versus maximum entropy models of neural population activity2017

    • Author(s)
      Ulisse Ferrari, Tomoyuki Obuchi, Thierry Mora
    • Journal Title

      Phys. Rev. E

      Volume: 印刷中

    • NAID

      130007648028

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Int'l Joint Research / Acknowledgement Compliant
  • [Journal Article] Approximate cross-validation formula for Bayesian linear regression2017

    • Author(s)
      Yoshiyuki Kabashima, Tomoyuki Obuchi, Makoto Uemura
    • Journal Title

      Allerton2016 conference

      Volume: 印刷中

    • NAID

      130006710798

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] Sparse approximation based on a random overcomplete basis2016

    • Author(s)
      Yoshinori Nakanishi-Ohno, Tomoyuki Obuchi, Masato Okada, and Yoshiyuki Kabashima
    • Journal Title

      Journal of Statistical Mechanics: Theory and Experiment

      Volume: 2016 Issue: 6 Pages: 1-30

    • DOI

      10.1088/1742-5468/2016/06/063302

    • NAID

      120006582517

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] Cross validation in LASSO and its acceleration2016

    • Author(s)
      T. Obuchi and Y. Kabashima
    • Journal Title

      Journal of Statistical Mechanics: Theory and Experiment

      Volume: 2016 Issue: 5 Pages: 1-36

    • DOI

      10.1088/1742-5468/2016/05/053304

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] Multiple peaks of species abundance distributions induced by sparse interactions2016

    • Author(s)
      Tomoyuki Obuchi, Yoshiyuki Kabashima, Kei Tokita
    • Journal Title

      Physical Review E

      Volume: 94 Issue: 2 Pages: 1-36

    • DOI

      10.1103/physreve.94.022312

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Boltzmann-machine learning of prior distributions of binarized natural images2016

    • Author(s)
      Tomoyuki Obuchi, Hirokazu Koma, Muneki Yasuda
    • Journal Title

      Journal of the Physical Society of Japan

      Volume: 85 Issue: 11 Pages: 1-17

    • DOI

      10.7566/jpsj.85.114803

    • NAID

      40020994962

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Relative species abundance of replicator dynamics with sparse interactions2016

    • Author(s)
      Tomoyuki Obuchi, Yoshiyuki Kabashima, Kei Tokita
    • Journal Title

      Journal of Statistical Mechanics: Theory and Experiment

      Volume: 2016 Issue: 11 Pages: 1-28

    • DOI

      10.1088/1742-5468/2016/11/113502

    • NAID

      120005971259

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Sparse approximation problem: how rapid simulated annealing succeeds and fails,2016

    • Author(s)
      Tomoyuki Obuchi, Yoshiyuki Kabashima
    • Journal Title

      International Meeting on High-Dimensional Data-Driven Science (HD3-2015)Journal of Physics: Conference Series

      Volume: 699 Pages: 1-12

    • DOI

      10.1088/1742-6596/699/1/012017

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] Sampling approach to sparse approximation problem: determining degrees of freedom by simulated annealing2016

    • Author(s)
      Tomoyuki Obuchi, Yoshiyuki Kabashima.
    • Journal Title

      Proceedings of 2016 24th European Signal Processing Conference (EUSIPCO)

      Volume: なし Pages: 1-5

    • DOI

      10.1109/eusipco.2016.7760448

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] Sparse approximation based on a random overcomplete basis2016

    • Author(s)
      Yoshinori Nakanishi-Ohno, Tomoyuki Obuchi, Masato Okada, Yoshiyuki Kabashima
    • Journal Title

      Journal of Statistical Mechanics

      Volume: 印刷中

    • NAID

      120006582517

    • Related Report
      2015 Research-status Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] Sparse approximation problem: how rapid simulated annealing succeeds and fails2016

    • Author(s)
      Tomoyuki Obuchi, Yoshiyuki Kabashima
    • Journal Title

      Journal of Physics: Conference Series

      Volume: 印刷中

    • Related Report
      2015 Research-status Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] Cross validation in LASSO and its acceleration2016

    • Author(s)
      Tomoyuki Obuchi, Yoshiyuki Kabashima
    • Journal Title

      Journal of Statistical Mechanics

      Volume: 印刷中

    • Related Report
      2015 Research-status Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] Learning Probabilities From Random Observables in High Dimensions: The Maximum Entropy Distribution and Others2015

    • Author(s)
      Tomoyuki Obuchi, Simona Cocco, Remi Monasson
    • Journal Title

      Journal of Statistical Physics

      Volume: 161 Issue: 3 Pages: 598-632

    • DOI

      10.1007/s10955-015-1341-7

    • Related Report
      2015 Research-status Report
    • Peer Reviewed / Int'l Joint Research / Acknowledgement Compliant
  • [Journal Article] Learning probability distributions from smooth observables and the maximum entropy principle: some remarks2015

    • Author(s)
      Tomoyuki Obuchi, Remi Monasson
    • Journal Title

      Journal of Physics: Conference Series

      Volume: 631 Pages: 012018-012018

    • DOI

      10.1088/1742-6596/638/1/012018

    • Related Report
      2015 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research / Acknowledgement Compliant
  • [Presentation] トータルバリエーション正則化における近似的交差検証公式2017

    • Author(s)
      小渕 智之
    • Organizer
      日本物理学会2017年年次大会
    • Place of Presentation
      大阪大学
    • Year and Date
      2017-03-17
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Cross validation in sparse linear regression penalized by L_1 regularization variants2017

    • Author(s)
      Tomoyuki Obuchi
    • Organizer
      Workshop on Statistical physics, Learning, Inference and Networks
    • Place of Presentation
      L'Ecole de Physique des Houches, France,
    • Year and Date
      2017-02-26
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] モンテカルロ法によるスパース変数選択2016

    • Author(s)
      小渕 智之
    • Organizer
      日本物理学会2016年秋季大会
    • Place of Presentation
      金沢大学
    • Year and Date
      2016-09-13
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] モンテカルロ法に基づいたスパース変数選択における交差検定法2016

    • Author(s)
      小渕 智之
    • Organizer
      日本物理学会2016年秋季大会
    • Place of Presentation
      金沢大学
    • Year and Date
      2016-09-13
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] LASSOに基づく透過係数スペクトルのスパース線形回帰2016

    • Author(s)
      小渕 智之
    • Organizer
      日本物理学会2016年秋季大会
    • Place of Presentation
      金沢大学
    • Year and Date
      2016-09-13
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Dynamical singularity of fidelity in quantum quench: Towards its experimental observation2016

    • Author(s)
      Tomoyuki Obuchi
    • Organizer
      Entanglement and non-equilibrium physics of pure and disordered systems
    • Place of Presentation
      ICTP, Triestem Italy
    • Year and Date
      2016-07-25
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Statistical mechanics for variable selection in linear regression: Fast and reliable cross validation2016

    • Author(s)
      Tomoyuki Obuchi
    • Organizer
      Statphys26
    • Place of Presentation
      Centre de Conges de Lyon, Lyon, France
    • Year and Date
      2016-07-18
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Cross validation in LASSO and its acceralation2016

    • Author(s)
      Tomoyuki Obuchi
    • Organizer
      Statistical physics methods in biology and computer science
    • Place of Presentation
      Ecole Normale Superieure, Paris, France
    • Year and Date
      2016-07-11
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] LASSO推定に関する半解析的交差検証法2016

    • Author(s)
      Tomoyuki Obuchi and Yoshiyuki Kabashima
    • Organizer
      日本物理学会2016年年次大会
    • Place of Presentation
      東北学院大学, 仙台
    • Year and Date
      2016-03-22
    • Related Report
      2015 Research-status Report
  • [Presentation] スパースな相互作用を導入した群れモデルの統計力学的解析2016

    • Author(s)
      Syotaro Hikita, Tomoyuki Obuchi and Yoshiyuki Kabashima
    • Organizer
      日本物理学会2016年年次大会
    • Place of Presentation
      東北学院大学, 仙台
    • Year and Date
      2016-03-22
    • Related Report
      2015 Research-status Report
  • [Presentation] Learning probabilities from random observables in high dimensions: the maximum entropy distribution and others2016

    • Author(s)
      Tomoyuki Obuchi, Remi Monasson, and Simona Cocco
    • Organizer
      APS March meeting
    • Place of Presentation
      Baltimore Convention Center, Baltimore, USA
    • Year and Date
      2016-03-15
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] Theoretical performance analysis of sparse approximation problem2016

    • Author(s)
      Tomoyuki Obuchi and Yoshiyuki Kabashima
    • Organizer
      Physics Informed Machine Learning
    • Place of Presentation
      Inn at Loretto, Santa Fe, USA
    • Year and Date
      2016-01-19
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] 不定線形方程式におけるスパース解の分布について2015

    • Author(s)
      Tomoyuki Obuchi and Yoshiyuki Kabashima
    • Organizer
      日本物理学会2015年秋季大会
    • Place of Presentation
      関西大学, 大阪
    • Year and Date
      2015-09-19
    • Related Report
      2015 Research-status Report
  • [Presentation] 過完備基底による歪有圧縮のレート歪関係2015

    • Author(s)
      中西(大野)義典,小渕智之,岡田真人,樺島祥介2015
    • Organizer
      日本物理学会第70回年次大会
    • Place of Presentation
      早稲田大学
    • Year and Date
      2015-03-24
    • Related Report
      2014 Research-status Report
  • [Presentation] モーメントマッチング条件により拘束される確率分布の相空間構造と最大エントロピー法2015

    • Author(s)
      小渕 智之、Remi Monasson、Simona Cocco
    • Organizer
      第31回情報統計力学研究会
    • Place of Presentation
      北海道大学, 札幌
    • Year and Date
      2015-01-06
    • Related Report
      2014 Research-status Report
    • Invited
  • [Presentation] 過完備基底圧縮の統計力学的解析2014

    • Author(s)
      中西(大野)義典,小渕智之,岡田真人,樺島祥介
    • Organizer
      第37回情報理論とその応用シンポジウム
    • Place of Presentation
      宇奈月ニューオータニホテル
    • Year and Date
      2014-12-10
    • Related Report
      2014 Research-status Report
  • [Presentation] Properties of Probability Distributions Constrained by Observables: Implication to Maximum Entropy Modeling2014

    • Author(s)
      Tomoyuki Obuchi, Remi Monasson, and Simona Cocco
    • Organizer
      Statphys-Kolkata VIII
    • Place of Presentation
      S.N.Bose Laboratory, Kolkata
    • Year and Date
      2014-11-30 – 2014-12-06
    • Related Report
      2014 Research-status Report
    • Invited
  • [Presentation] Properties of Probability Distributions Constrained by Observables: Implication to Maximum Entropy Modeling2014

    • Author(s)
      Tomoyuki Obuchi, Remi Monasson, and Simona Cocco
    • Organizer
      Collective Dynamics in Information Systems
    • Place of Presentation
      KITPC, Beijing
    • Year and Date
      2014-10-08 – 2014-10-31
    • Related Report
      2014 Research-status Report
  • [Remarks]

    • URL

      http://www.sp.dis.titech.ac.jp/%7Eobuchi/publication.html

    • Related Report
      2016 Annual Research Report

URL: 

Published: 2014-04-04   Modified: 2018-03-22  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi