• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Establishment of statistical mechanical methods in information sciences

Research Project

Project/Area Number 14084206
Research Category

Grant-in-Aid for Scientific Research on Priority Areas

Allocation TypeSingle-year Grants
Review Section Science and Engineering
Research InstitutionTokyo Institute of Technology

Principal Investigator

KABASHIMA Yoshiyuki  Tokyo Institute Technology, Dept. of Compt Intel & Syst. Sci., Professor, 大学院総合理工学研究科, 教授 (80260652)

Co-Investigator(Kenkyū-buntansha) TAKAYASU Misako  Dept of Compt. Intel & Syst Sci, Associate Professor, 大学院総合理工学研究科, 助教授 (20296776)
AONISHI Toru  Dept. of Compt. Intell. & Syst Sci, Lecturer, 大学院総合理工学研究科, 講師 (00333352)
INOUE Masato  Waseda Univ. Dept of Elect Eng. & Bioscience, Lecturer, 理工学術院, 専任講師 (70376953)
Project Period (FY) 2002 – 2005
Project Status Completed (Fiscal Year 2005)
Budget Amount *help
¥21,900,000 (Direct Cost: ¥21,900,000)
Fiscal Year 2005: ¥6,800,000 (Direct Cost: ¥6,800,000)
Fiscal Year 2004: ¥6,800,000 (Direct Cost: ¥6,800,000)
Fiscal Year 2003: ¥6,400,000 (Direct Cost: ¥6,400,000)
Fiscal Year 2002: ¥1,900,000 (Direct Cost: ¥1,900,000)
KeywordsStatistical Mechanics / Information Theory / Replica Method / Replica Symmetry Breaking / Analytical Continuation / Belief Propagation / Codes / Spin Glass Models / 信念伝搬 / 確率推論 / 生命情報 / 要約伝搬 / レプリカ拡張 / 歪み有データ圧縮 / スピングラスモデル / 誤り指数 / CDMA通信方式 / 信念伝播 / マルチユーザー検出 / 誤り訂正符号 / 低密度パリティ検査符号 / 符号理論 / 信頼性関数
Research Abstract

We have developed a framework to evaluate performance of various coding methods such as error correcting and compression codes, and CDMA multiuser communication systems utilizing notions and techniques of statistical mechanics. The developed framework is composed mainly of the following three schemes :
1. Scheme for assessing typical performance of codes infinite length Regarding a given code as a kind of spin glass models, this scheme makes it possible to characterize the typical performance of the code as the length of the codes tends to infinity utilizing the concept of phase transition of disordered systems.
2. Scheme for characterizing atypical behavior of codes of finite length Combining evaluation methods of large deviation analysis and the replica method that has been developed in statistical mechanics, this scheme enables us to assess atypical behavior of an objective code utilizing a certain exponent.
3. Scheme for evaluating typical behavior of belief propagation Belief propagation is an inference algorithm that currently occupies a special status in research of codes as a standard decoding algmithm of modem error correcting codes. We have developed a scheme that makes it possible to characterize typical behavior of the algorithm utilizing macroscopic quantities, in particula4 for systems of dense connectivity. In addition, we have also obtained several results concerning nature of statistical mechanical methods :
4. We have discovered a model system of finite system size for which analytical continuation of the replica number can be exactly performed, which provides complete information about the origin of the replica symmetry breaking of a certain type.
5. We have gained a plausible conjecture that the condition of the de Almeida-Thouless instability known in static analysis of spin glass systems generally accords with the dynamical instability condition of the fixed point of the belief propagation algorithm in the case of mean field models..

Report

(5 results)
  • 2005 Annual Research Report   Final Research Report Summary
  • 2004 Annual Research Report
  • 2003 Annual Research Report
  • 2002 Annual Research Report
  • Research Products

    (43 results)

All 2006 2005 2004 2003 Other

All Journal Article (31 results) Book (1 results) Publications (11 results)

  • [Journal Article] Statistical Mechanical Approach to Lossy Data Compression Theory and Practice2006

    • Author(s)
      T.Hosaka, Y.Kabashima
    • Journal Title

      Physica A 365

      Pages: 113-119

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Statistical Mechanical Approach to Error Exponents of Lossy Data Compression2005

    • Author(s)
      T.Hosaka, Y.Kabashima
    • Journal Title

      Journal of the Physical Society of Japan 74

      Pages: 488-497

    • NAID

      110001979397

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Replicated Bethe Free Energy : A Variational Principle behind Survey Propagation2005

    • Author(s)
      Y.Kabashima
    • Journal Title

      Journal of the Physical Society of Japan 74

      Pages: 2133-2136

    • NAID

      110001979674

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Annual Research Report 2005 Final Research Report Summary
  • [Journal Article] Effect of dendritic backpropagation action potential on neural interaction2005

    • Author(s)
      T.Aonishi, H.Miyakawa, M.Inoue, M.Okada
    • Journal Title

      Neurocomputing 65

      Pages: 343-348

    • NAID

      110003232426

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] An Exact Analytic Continuation to Complex Replica Number in the Discrete Random Energy Model of Finite System Size2005

    • Author(s)
      K.Ogure, Y.Kabashima
    • Journal Title

      Prog. Theor. Phys. Suppl. 157

      Pages: 103-106

    • NAID

      110001275990

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Statistical Mechanics of Source Coding with a Fidelity Criterion2005

    • Author(s)
      Y.Kabashima, T.Hosaka
    • Journal Title

      Prog. Theor. Phys. Suppl. 157

      Pages: 197-204

    • NAID

      110001276009

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] A PCA approach to Sourlas code analysis2005

    • Author(s)
      M.Inoue, K.Hukushima, M.Okada
    • Journal Title

      Prog. Theor. Phys. Suppl. 157

      Pages: 246-249

    • NAID

      110001276016

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Security and Reliability of LDPC Based Public-Key Cryptosystems2005

    • Author(s)
      D.Saad, N.Skantzos, Y.Kabashima
    • Journal Title

      Prog. Theor. Phys. Suppl. 157

      Pages: 229-236

    • NAID

      110001276013

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Statistical Mechanincal Approach to Error Exponents of Lossy Data Compression2005

    • Author(s)
      T.Hosaka, Y.Kabashima
    • Journal Title

      J. Phys. Soc. Jpn. 74

      Pages: 488-497

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] A Variational Principle behind Survey Propagation2005

    • Author(s)
      Y.Kabashima, Replicated Bethe Free energy
    • Journal Title

      J. Phys. Soc. Jpn. 74

      Pages: 2133-2136

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Statistical Mechanical Development of a Sparse Bayesian Classifier2005

    • Author(s)
      S.Uda, Y.Kabashima
    • Journal Title

      J. Phys. Soc. Jpn. 74

      Pages: 2233-2242

    • NAID

      110001979698

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Statistical Mechanical Development of a Sparse Bayesian Classifier2005

    • Author(s)
      S.Uda, Y.Kabashima
    • Journal Title

      Journal of the Physical Society of Japan 74

      Pages: 2233-2242

    • NAID

      110001979698

    • Related Report
      2005 Annual Research Report
  • [Journal Article] An Exact Analytic Continuation to Complex Replica Number in the Discrete Random Energy Model of Finite System Size2005

    • Author(s)
      K.Ogure, Y.Kabashima
    • Journal Title

      Progress of Theoretical Physics Supplement 157

      Pages: 103-106

    • NAID

      110001275990

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Statistical Mechanics of Source Coding with a Fidelity Criterion2005

    • Author(s)
      Y.Kabashima, T.Hosaka
    • Journal Title

      Progress of Theoretical Physics Supplement 157

      Pages: 197-205

    • NAID

      110001276009

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Security and Reliability of LDPC Based Public-Key Cryptosystems,2005

    • Author(s)
      D.Saad, N.Skantzos, Y.Kabashima
    • Journal Title

      Progress of Theoretical Physics Supplement 157

      Pages: 229-236

    • NAID

      110001276013

    • Related Report
      2005 Annual Research Report
  • [Journal Article] An LDPCC decoding algorithm based on Bowman-Levin approximation -- Comparison with BP and CCCP --2005

    • Author(s)
      M Inoue, M Komiya, Y Kabashima
    • Journal Title

      Proceedings of 2005 IEEE International Symposium on Information Theory

      Pages: 444-448

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Statistical Mechanical Approach to Error Exponents of Lossy Data Compression2005

    • Author(s)
      T.Hosaka, Y.Kabashima
    • Journal Title

      Journal of Physical Society of Japan 74

      Pages: 488-497

    • NAID

      110001979397

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Exact Analytic Continuation with Respect to the Replica Number in the Discrete Random Energy Model of Finite System Size2004

    • Author(s)
      K.Ogure, Y.Kabashima
    • Journal Title

      Progress of Theoretical Physics 111

      Pages: 661-668

    • NAID

      110001196167

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary 2004 Annual Research Report
  • [Journal Article] Exact Analytic Continuation with Respect to the Replica Number in the Discrete Random Energy Model of Finite System Size2004

    • Author(s)
      K.Ogure, Y.Kabashima
    • Journal Title

      Prog. Theor. Phys. 111

      Pages: 661-688

    • NAID

      110001196167

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] TCP Optimization for Eliminating Duplicate Segments in Congested Networks2004

    • Author(s)
      Y.Tamura, M.Takayasu, H.Takayasu
    • Journal Title

      J. Inf. Proc. Soc. Jpn. 45

      Pages: 1672-1680

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] 符号とスピングラス理論2004

    • Author(s)
      樺島祥介
    • Journal Title

      数理科学 497

      Pages: 48-53

    • Related Report
      2004 Annual Research Report
  • [Journal Article] TCP Optimization for Eliminating Duplicate Segments in Congested Networks2004

    • Author(s)
      Y.Tamura, M.Takayasu, H.Takayasu
    • Journal Title

      Journal of Information Processing Society of Japan 45

      Pages: 1672-1680

    • Related Report
      2004 Annual Research Report
  • [Journal Article] A CDMA multiuser detection algorithm on the basis of belief propagation2003

    • Author(s)
      Y.Kabashima
    • Journal Title

      Journal of Physics A : Mathematical and General 36

      Pages: 11111-11122

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Statistical mechanics of low-density parity-check codes2003

    • Author(s)
      Y.Kabashima, D.Saad
    • Journal Title

      Journal of Physics A : Mathematical and General 36

    • NAID

      110003233526

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Propagating beliefs in spin-glass models2003

    • Author(s)
      Y.Kabashima
    • Journal Title

      Journal of the Physical Society of Japan 72

      Pages: 1645-1649

    • NAID

      110001954592

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] A CDMA multiuser detection algorithm on the basis of belief propagation2003

    • Author(s)
      Y.Kabashima
    • Journal Title

      J. Phys. A 36

      Pages: 11111-11122

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Average and reliability exponents in low-density parity-check codes2003

    • Author(s)
      N.Skantzos, J.van Mourik, D.Saad, Y.Kabashima
    • Journal Title

      J. Phys. A 36

      Pages: 11131-11142

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Statistical mechanics of low-density parity-check codes2003

    • Author(s)
      Y.Kabashima, D.Saad
    • Journal Title

      J. Phys. A 36

    • NAID

      110003233526

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Propagating beliefs in spin-glass models2003

    • Author(s)
      Y.Kabashima
    • Journal Title

      J. Phys. Soc. Jpn. 72

      Pages: 1645-1649

    • NAID

      110001954592

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Effect of dendritic backpropagating action potential on neural interaction

    • Author(s)
      T.Aonishi, H.Miyakawa, M.Inoue, M.Okada
    • Journal Title

      Neurocomputing (in press)

    • NAID

      110003232426

    • Related Report
      2004 Annual Research Report
  • [Journal Article] A PCA approach to Sourlas code analysis

    • Author(s)
      M.Inoue, K.Hukushima, M.Okada
    • Journal Title

      Progress of Theoretical Physics Supplement (in press)

    • NAID

      110001276016

    • Related Report
      2004 Annual Research Report
  • [Book] 統計科学のフロンティア 計算統計I2003

    • Author(s)
      汪金芳, 田栗正章, 手塚集, 樺島祥介, 上田修功
    • Total Pages
      196
    • Publisher
      岩波書店
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Publications] N.Skanzos, J.van Mourik, D.Saad, Y.Kabashima: "Average and reliability exponents in low-density parity-check codes"Journal of Physics A : Mathematical and General. 36. 11131-11142 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] Y.Kabashima: "A CDMA multiuser detection algorithm on the basis of belief propagation"Journal of Physics A : Mathematical and General. 36. 11111-11122 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] Y.Kabashima: "Propagating beliefs in spin-glass models"Journal of Physical Society of Japan. 72. 1645-1649 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] Y.Kabashima, D.Saad: "Statistical mechanics of low-density parity-check codes"Journal of Physics A : Mathematical and General. 37. R1-R43 (2004)

    • Related Report
      2003 Annual Research Report
  • [Publications] 樺島祥介: "コトの物理学"日本物理学会誌2003年4月号. 239-246 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 樺島祥介: "統計力学的手法による誤り訂正符号の性能評価"計測と制御. 42・8. 642-647 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 江金芳, 田栗正章, 手塚集, 樺島祥介, 上田修功: "統計科学のフロンティア 計算統計I"岩波書店. 196 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] Y.Kabashima, K.Nakamura, J.van Mourik: "Statistical mechanics of typical set decoding"Physical Review E. 66. 036125-1-036125-6 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] J.van Mourik, D.Saad, Y.Kabashima: "Critical noise level for low-density parity-check codes"Physical Review E. 66. 026705-1-026705-8 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] T.Hosaka, Y.Kabashima, H.Nishimori: "Statistical mechanics of lossy data compression using a non-monotonic perceptron"Physical Review E. 66. 066126-1-066126-8 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] K.Nakamura, Y.Kabashima, R.Morelos-Zaragoza, D.Saad: "Statistical mechanics of broadcast channels using low-density parity-check codes"Physical Review E. (accepted for publication).

    • Related Report
      2002 Annual Research Report

URL: 

Published: 2002-04-01   Modified: 2018-03-28  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi