• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Statistical-mechanical analysis of dynamical properties of algorithms for image restoration

Research Project

Project/Area Number 14084201
Research Category

Grant-in-Aid for Scientific Research on Priority Areas

Allocation TypeSingle-year Grants
Review Section Science and Engineering
Research InstitutionHokkaido University

Principal Investigator

INOUE Jun-ichi  Hokkaido University, Graduate School of Information Science and 'Technology, Associate Professor, 大学院情報科学研究科, 助教授 (30311658)

Project Period (FY) 2002 – 2005
Project Status Completed (Fiscal Year 2005)
Budget Amount *help
¥7,900,000 (Direct Cost: ¥7,900,000)
Fiscal Year 2005: ¥1,800,000 (Direct Cost: ¥1,800,000)
Fiscal Year 2004: ¥1,900,000 (Direct Cost: ¥1,900,000)
Fiscal Year 2003: ¥1,800,000 (Direct Cost: ¥1,800,000)
Fiscal Year 2002: ¥2,400,000 (Direct Cost: ¥2,400,000)
KeywordsProbabilistic image processing / Statistical mechanics of information / Bavesian Statistics / EM algorithm / Replica method / Non-extensive statistical mechanics / Quantum fluctuation / Evaluation of statistical performance / 統計力学 / 情報科学 / 画像修復 / ダイナミックス / マルコフ連鎖モンテカルロ法 / 確率的情報処理 / フラストレートした格子模型 / 量子スピングラス / 量子アニーリング / アルゴリズムの平均的性能評価 / ランダムスピン系 / 平均場理論 / ベーテ近似 / 非加法的エントロピー / ベイズ推定 / ダイナミックス解析 / 不完全データからの最尤推定
Research Abstract

In this research project, we investigated the dynamical properties of Bayesian image restoration for the blapk-while binary and gray-scaled images represented by the Ising and the Q-Ising models, respectively. We introduced the mean-field model to evaluate the accuracy or the speed of the convergence for EM algorithm and gradient descent method to obtain the maximum likelihood estimate for the hyper-parameters. We found that EM algorithm is superior to the gradient descent method in the speed of the convergence. Moreover, our analysis made it clear that the dynamical behavior of the hyper-parameters shows a kind of the "oscillating phenomena " before they converge to their true values if the time to wait until the system reaches to the equilibrium states is not enough.
We also proposed a new-type of the deterministic annealing EM algorithm which was extended by means of non-extensive statistical mechanics. The method was applied to the problem of Traveling salesman and the statistical performance was investigated extensively.
We also presented several applications of quantum spin glasses (random field Ising model, Shermgton-KJrkpatrick model, Ising spin glasses with p-body interaction in a transverse field) to probabilistic information processing, especially to the problems of image restoration and error-correcting codes. As a related optimization method, quantum annealing was also introduced to these research fields and its performance was investigated by using the quantum Markov chain Monte Carlo method. The Nishimori-Wong condition, on which the best possible performance of the quantum MPM estimation is achieved, was derived as a condition on the effective amplitude of the transverse field.

Report

(5 results)
  • 2005 Annual Research Report   Final Research Report Summary
  • 2004 Annual Research Report
  • 2003 Annual Research Report
  • 2002 Annual Research Report
  • Research Products

    (27 results)

All 2005 2003 2002 Other

All Journal Article (16 results) Publications (11 results)

  • [Journal Article] Quantum Spin Glasses, Quantum Annealing and Probabilistic Information Processing2005

    • Author(s)
      J.Inoue
    • Journal Title

      "Quantum Annealing and Related Optimization Methods" Series : Lecture Notes in Physics, Springer-Heidelberg 679

      Pages: 237-278

    • NAID

      120000963701

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Quantum Spin Glasses, Quantum Annealing and Probabilistic Information Processing2005

    • Author(s)
      J.Inoue
    • Journal Title

      "Quantum Annealing and Related Optimization Method", Series : Lecture Notes in Physics, Springer-Heidelberg Vol. 679

      Pages: 237-278

    • NAID

      120000963701

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Quantum Spin Glasses, Quantum Annealing and Probabilistic Information Processing2005

    • Author(s)
      J.Inoue
    • Journal Title

      "Quantum Annealing and Related Optimization Methods"Series : Lecture Notes in Physics, Springer-Heidelberg 679

      Pages: 237-278

    • NAID

      120000963701

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Associative memories by reaping redundant neurons2005

    • Author(s)
      J.Inoue
    • Journal Title

      Progress of Theoretical Physics Supplement No.157

      Pages: 262-265

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Competition between ferro-retrieval and antiferro orders in a Hopfield-like network model for plant intelligence2005

    • Author(s)
      J.Inoue, B.K.Chakrabarti
    • Journal Title

      Physica A : Statistical Mechanics and its Applications 346・1

      Pages: 58-67

    • Related Report
      2005 Annual Research Report 2004 Annual Research Report
  • [Journal Article] Associative memories by reaping redundant neurons2005

    • Author(s)
      J.Inoue
    • Journal Title

      Progress of Theoretical Physics, Supplement 157(印刷中)

    • Related Report
      2004 Annual Research Report
  • [Journal Article] A generalization of the deterministic annealing EM algorithm by means of non-extensive statistical mechanics2003

    • Author(s)
      J.Inoue, K.Tabushi
    • Journal Title

      International Journal of Modern Physics B 17

      Pages: 5525-5539

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Probabilistic image processing by means of Bethe approximation for Q-Ising model2003

    • Author(s)
      K.Tanaka, J.Inoue, D.M.Titterington
    • Journal Title

      Journal of Physics A : Mathematical and General 36

      Pages: 11023-11035

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Mean field theory of EM algorithm for Bayesian gray scale image restoration2003

    • Author(s)
      J.Inoue, K.Tanaka
    • Journal Title

      Journal of Physics A : Mathematical and General 36

      Pages: 10997-11010

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] A generalization of the deterministic annealing EM algorithm by means of non-extensive statistical mechanics2003

    • Author(s)
      J.Inoue, K.Tabushi
    • Journal Title

      International Journal of Modern Physics B Vol. 17.

      Pages: 5525-5539

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Probabilistic image processing by means of Bethe approximation for Q-Ising model2003

    • Author(s)
      K.Tanaka, J.Inoue, D.M.Titterington
    • Journal Title

      Journal of Physics A : Mathematical and General Vol. 36

      Pages: 11023-11035

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Mean field theory of EM algorithm for Bayesian gray scale image restoration2003

    • Author(s)
      J.Inoue, K.Tanaka
    • Journal Title

      Journal of Physics A : Mathematical and General Vol. 36

      Pages: 10997-11010

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Dynamics of the maximum marginal likelihood hyper-parameter estimation in image restoration : Gradient descent versus EM algorithm2002

    • Author(s)
      J.Inoue, K.Tanaka
    • Journal Title

      Physical Review E 65

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Maximum Likelihood Hyperparameter Estimation for Solvable Markov Random Field Model in Image Restoration2002

    • Author(s)
      K.Tanaka, J.Inoue
    • Journal Title

      IEICE Trans. on Information and Systems E85-D

      Pages: 546-557

    • NAID

      110003219941

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Dynamics of the maximum marginal likelihood hyper-parameter estimation in image restoration : Gradient descent versus EM algorithm2002

    • Author(s)
      J.Inoue, K.Tanaka
    • Journal Title

      Physical Review E vol. 65

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Maximum Likelihood Hyperparameter Estimation for Solvable Markov Random Field Model in Image Restoration2002

    • Author(s)
      K.Tanaka, J.Inoue
    • Journal Title

      IEICE Trans. on Information and Systems Vol. E85-V

      Pages: 546-557

    • NAID

      110003219941

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Publications] J.Inoue, K.Tabushi: "A generalization of the deterministic annealing EM algorithm by means of non-extensive statistical mechanics"International Journal of Modern Physics B. 17・29. 5525-5539 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] K.Tanaka, J.Inoue, D.M.Titterington: "Probabilistic image processing by means of Bethe approximation for Q-Ising model"Journal of Physics A : Mathematical and General. 36. 11023-11035 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] J.Inoue, K.Tanaka: "Mean field theory of EM algorithm for Bayesian gray scale image restoration"Journal of Physics A : Mathematical and General. 36. 10997-11010 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] J.Inoue: "Image Restoration and Ising Spin Glasses in A Transverse Field"Physica Scripta. T106. 70-76 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] K.Tanaka, J.Inoue, D.M.Titterington: "Loopy belief propagation and probabilistic image processing"Neural Networks for Signal Processing. XIII. 329-338 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] J.Inoue, K.Tanaka: "Dynamics of the maximum marginal likelihood hyper-parameter estimation in image restoration : gradient decent vs. EM algorithm"Physical Review E. 65. 016125-1-016125-11 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] T.Tadaki, J.Inoue: "Multistate image restoration by transmission of bit-decomposed data"Physical Review E. 65. 016101-1-016101-13 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] K.Tanaka, J.Inoue: "Maximum Likelihood Hyperparameter Estimation for Solvable Markov Random Field Model in Image Restoration"IEICE Trans. on Information and Systems. E85-D-3. 56-557 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] 井上純一, 田伏克巳: "非加法的統計力学により拡張された確定的アニーリングEMアルゴリズムのダイナミックス解析"電子情報通信学会技術研究報告書(ニューロコンピューティング). NC2002-126. 55-60 (2003)

    • Related Report
      2002 Annual Research Report
  • [Publications] 田伏克巳, 井上純一: "非加法的統計力学により拡張された確定的アニーリングEMアルゴリズムの巡回セールスマン問題への応用"電子情報通信学会技術研究報告書(ニューロコンピューティング). NC2002-127. 55-60 (2003)

    • Related Report
      2002 Annual Research Report
  • [Publications] J.Inoue: "A generalization of the deterministic annealing EM algorithm by means of non-extensive statistical mechanics (Invited paper)"Proc. of the international conference on Statistical Mechanics of Threshold Activated Systems. (発表予定). (2002)

    • Related Report
      2002 Annual Research Report

URL: 

Published: 2002-04-01   Modified: 2018-03-28  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi