• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Statistical mechanics of relaxation process for Bayesian inference and its application

Research Project

Project/Area Number 14084212
Research Category

Grant-in-Aid for Scientific Research on Priority Areas

Allocation TypeSingle-year Grants
Review Section Science and Engineering
Research InstitutionUniversity of Tokyo (2004-2005)
The Institute of Physical and Chemical Research (2002-2003)

Principal Investigator

OKADA Masato  University of Tokyo, Graduate School of Frontier Sciences, Professor, 大学院新領域創成科学研究科, 教授 (90233345)

Project Period (FY) 2002 – 2005
Project Status Completed (Fiscal Year 2005)
Budget Amount *help
¥30,400,000 (Direct Cost: ¥30,400,000)
Fiscal Year 2005: ¥8,100,000 (Direct Cost: ¥8,100,000)
Fiscal Year 2004: ¥9,800,000 (Direct Cost: ¥9,800,000)
Fiscal Year 2003: ¥9,200,000 (Direct Cost: ¥9,200,000)
Fiscal Year 2002: ¥3,300,000 (Direct Cost: ¥3,300,000)
KeywordsBayesian inference / CDMA / Image reconstruction / Error Correcting code / Principal Component Analysis / Quantum annealing / Rate distortion / Relaxation process / 統計力学 / 確率的情報処理 / 量子断熱発展 / 主成分分 / デコード / 復調
Research Abstract

We investigated dynamics for CDMA multiuser detection. We applied the statistical neurodynamics, which is based on Gaussian approximation for input distribution, to a detection dynamics of a parallel interference canceller (PIC), and proposed a new detection algorithm based on this theoretical analysis. Recently, we have succeeded in obtaining an exact solution for the PIC detection dynamics without the Gaussian approximation using generating functional analysis (GFA). We applied a dynamical replica theory (DRT) to the CDMA detection dynamics. We also applied these theories to the image, restoration and the error-correcting code.
We proposed a numerical approach for a class of non-mean field models and finite-size models with sufficient accuracy, in which principal component analysis (PCA) is employed to analyze configurations sampled through Monte Carlo simulations. We showed that the PCA approach will be effective even with general non-MF finite-size models using examples of two-and three-body mean-field Sourlas codes.
The quantum annealing method exploits quantum fluctuations to search the ground state of classical disordered Hamiltonian, which corresponds to maximum a posteriori probability estimation. If the quantum fluctuation is reduced sufficiently slowly and linearly by the time, the residual energy after the quantum annealing falls as the inverse square of the annealing time. We show this feature of the residual energy by numerical calculations for small-sized systems and derive it on the basis of the quantum adiabatic theorem.
Additionally, we proposed a new framework for the lossy date compression using a sparsely connected random network, which was originally used on the error-correcting code.

Report

(5 results)
  • 2005 Annual Research Report   Final Research Report Summary
  • 2004 Annual Research Report
  • 2003 Annual Research Report
  • 2002 Annual Research Report
  • Research Products

    (36 results)

All 2005 2004 2003 Other

All Journal Article (30 results) Publications (6 results)

  • [Journal Article] Generating functional analysis of CDMA detection dynamics.2005

    • Author(s)
      Mimura, Okada
    • Journal Title

      Journal of Physics A : Mathematical and General 38・46

      Pages: 9917-9929

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Annual Research Report 2005 Final Research Report Summary
  • [Journal Article] Approximate belief propagation, density evolution and statistical neurodynamics for CDMA multiuser detection.2005

    • Author(s)
      Tanaka, Okada
    • Journal Title

      IEEE Transaction on information theory 51

      Pages: 700-706

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Residual energies after slow quantum annealing.2005

    • Author(s)
      Suzuki, Okada
    • Journal Title

      Journal of the Physical Society of Japan 74

      Pages: 1649-1652

    • NAID

      110001979587

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Annual Research Report 2005 Final Research Report Summary
  • [Journal Article] Ensemble learning of linear Perceptrons : on-line learning theory.2005

    • Author(s)
      Hara, Okada
    • Journal Title

      Journal of the Physical Society of Japan Vol.74

    • NAID

      110002325532

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Analysis of ensemble learning using simple perceptrons based on online learning theory.2005

    • Author(s)
      Miyoshi, Hara, Okada
    • Journal Title

      Physical Review E Vol. 71

      Pages: 36116-36116

    • NAID

      110001276022

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Generating functional analysis of CDMA detection Dynamics2005

    • Author(s)
      Mimura, Okada
    • Journal Title

      Journal of Physics A : Mathematical and General Vol. 38, No.46

      Pages: 9917-9929

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Approximate belief propagation, density evolution,and statistical neurodynamics for CDMA multiuser detection.2005

    • Author(s)
      Tanaka, Okada
    • Journal Title

      IEEE Transaction on information theory. Vol.51

      Pages: 700-706

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Residual energies after slow quantum annealing.2005

    • Author(s)
      Suzuki, Okada
    • Journal Title

      Journal of the Physical Society of Japan Vol.74

      Pages: 1649-1653

    • NAID

      110001979587

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Approximate belief propagation, density evolution, and statistical neurodynamics for CDMA multiuser detection.2005

    • Author(s)
      Tanaka, Okada
    • Journal Title

      IEEE Transaction on information theory 51

      Pages: 700-706

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Ensemble Learning of Linear Perceptrons.2005

    • Author(s)
      Hara, Okada
    • Journal Title

      Journal of the Physical Society of Japan 74

      Pages: 2966-2972

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Analysis of ensemble learning using simple perceptrons based on online learning theory.2005

    • Author(s)
      Miyoshi, Hara, Okada
    • Journal Title

      Physical Review E 71

      Pages: 36116-36116

    • NAID

      110001276022

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Evaluation of the adaptive natural gradient descent method for soft committee machines.2004

    • Author(s)
      Inoue, Park, Okada
    • Journal Title

      Physical Review E Vol.69

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] The path-integral analysis of an associative memory model storing an infinite number of finite limit cycles.2004

    • Author(s)
      Mimura, Kawamura, Okada
    • Journal Title

      Journal of Physics A : Mathematical and General. Vol. 37

      Pages: 6437-6454

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Accuracy of the Bethe approximation for hyperparameter estimation in probabilistic image processing.2004

    • Author(s)
      Tanaka, Shouno, Okada, Titterington.
    • Journal Title

      Journal of Physics A Vol. 37

      Pages: 8675-8696

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Self-organization of globally continuous and locally distributed information representation2004

    • Author(s)
      Wada, Kurata, Okada
    • Journal Title

      Neural Networks 17

      Pages: 1039-1049

    • NAID

      10014158037

    • Related Report
      2004 Annual Research Report
  • [Journal Article] One-step RSB scheme for the rate distortion functions.2003

    • Author(s)
      Murayama, Okada
    • Journal Title

      Journal of Physics A : Mathematical and General 36

      Pages: 11123-11130

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Low-dimensional chaos induced by frustration in a non-monotonic system2003

    • Author(s)
      Masaki, Tokunaga, Okada
    • Journal Title

      Europhysics Letters Vol. 62

      Pages: 657-663

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Dynamical properties of Markov Chain Monte Carlo method for image restoration.2003

    • Author(s)
      Ozeki, Okada
    • Journal Title

      Journal of Physics A : Mathematical and General. Vol. 36

      Pages: 11011-11021

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] One-step RSB scheme for the rate distortion functions.2003

    • Author(s)
      Murayama, Okada
    • Journal Title

      Journal of Physics A : Mathematical and General Vol. 36

      Pages: 11123-11130

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] On-line learning dynamics of multilayer perceptrons with unidentifiable parameters.2003

    • Author(s)
      Park, Inoue, Okada
    • Journal Title

      Journal of Physics A : Mathematical and General Vol. 36

      Pages: 11753-11764

    • NAID

      110003232347

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Dynamical replica theoretic analysis of CDMA detection dynamics

    • Author(s)
      Hatchett, Okada
    • Journal Title

      Journal of Physics A : Mathematical and General (印刷中)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] An analysis method combining Monte Carlo simulation and principal component analysis-application to Sourlas code

    • Author(s)
      Inoue, Hukushima, Okada
    • Journal Title

      Journal of the Physical Society of Japan (印刷中)

    • NAID

      110004799201

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Dynamical replica theoretic analysis of CDMA detection dynamics.

    • Author(s)
      Hatchett, Okada
    • Journal Title

      Journal of Physics A : Mathematical and General (in press)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] An analysis method combining Monte Carlo simulation and principal component analysis-application to Sourlas code

    • Author(s)
      Inoue, Hukushima, Okada
    • Journal Title

      Journal of the Physical Society of Japan (in press)

    • NAID

      110004799201

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Dynamical replica theoretic analysis of CDMA detection dynamics

    • Author(s)
      Hatchett, Okada
    • Journal Title

      Journal of Physics A : Mathematical and General (印刷中)

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Evaluation of the adaptive natural gradient descent method for soft committee machines

    • Author(s)
      Inoue, Park, Okada
    • Journal Title

      Physical Review E (発表予定)

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Retrieval properties of Hopfield and correlated attractors in an associative memory model

    • Author(s)
      Uezu, Hirano, Okada
    • Journal Title

      Journal of Physical Society of Japan (発表予定)

    • NAID

      110001974360

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Impact of deviation from precise balance of spike-timing-dependent plasticity

    • Author(s)
      Matsumoto, Okada
    • Journal Title

      Neural Networks (発表予定)

    • NAID

      10013747099

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Storage capacity diverges with synaptic efficiency in associative memory model with synaptic delay and pruning

    • Author(s)
      Miyoshi, Okada
    • Journal Title

      IEEE Transactions on Neural Networks (発表予定)

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Coexistence of memory patterns and mixed states in a sparsely encoded associative memory model storing ultrametric patterns

    • Author(s)
      Kimoto, Okada
    • Journal Title

      Biological Cybernetics (発表予定)

    • Related Report
      2004 Annual Research Report
  • [Publications] Kazuyuki Hara: "On-line learning through simple perceptron learning with a margin"Neural Networks. vol.17, No.2. 215-223 (2004)

    • Related Report
      2003 Annual Research Report
  • [Publications] Hyeyoung Park: "On-line learning dynamics of two-layer neural networks with unidentifiable parameters"Journal of Physics A : Mathematical and General. vol.36. 11011-11012 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] Tatsuto Murayama: "One-step RSB scheme for the rate distortion functions."Journal of Physics A : Mathematical and General. vol.36. 11123-11130 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] Masato Inoue: "On-line learning theory of soft committee machines with correlated hidden units.-- Steepest gradient descent and natural gradient descent --"Journal of Physical Society of Japan. vol.72, No.4. 805-810 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] Tomoko Ozeki: "Dynamical properties of Markov Chain Monte Carlo method for image restoration"Journal of Physics A : Mathematical and General. vol.36. 215-223 (2004)

    • Related Report
      2003 Annual Research Report
  • [Publications] M.Inoue, H.Park, M.Okada: "On-line learning theory of soft committee machines with correlated hidden units. --Steepest gradient descent and natural gradient descent--"Journal of Physical Society of Japan. (印刷中).

    • Related Report
      2002 Annual Research Report

URL: 

Published: 2002-04-01   Modified: 2018-03-28  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi