• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

AlgorithmicAnalysis of Statistical Mechanical Heuristics

Research Project

Project/Area Number 14084207
Research Category

Grant-in-Aid for Scientific Research on Priority Areas

Allocation TypeSingle-year Grants
Review Section Science and Engineering
Research InstitutionTokyo Institute of Technology

Principal Investigator

WATANABE Osamu  Tokyo Institute of Technology, Graduate School of Information Science and Engineering, Professor, 大学院情報理工学研究科, 教授 (80158617)

Co-Investigator(Kenkyū-buntansha) 岩間 一雄  京都大学, 大学院・情報学研究科, 教授 (50131272)
Project Period (FY) 2002 – 2005
Project Status Completed (Fiscal Year 2005)
Budget Amount *help
¥25,100,000 (Direct Cost: ¥25,100,000)
Fiscal Year 2005: ¥7,200,000 (Direct Cost: ¥7,200,000)
Fiscal Year 2004: ¥6,900,000 (Direct Cost: ¥6,900,000)
Fiscal Year 2003: ¥6,000,000 (Direct Cost: ¥6,000,000)
Fiscal Year 2002: ¥5,000,000 (Direct Cost: ¥5,000,000)
KeywordsAverage-Case Analysis of Algorithms / Satisfiability Problem / Local Search Algorithms / Pseudo Expectation / Boosting / 確率アルゴリズム / 乱択計算 / 局所探索法 / マルコフ過程 / 近似解析 / サンプリング技法 / 片誤り性 / 確立アルゴリズム / ランダマイズド計算 / 制約解探索問題 / アルゴリズムの状態確率の変化
Research Abstract

We investigate various heuristics that have been proposed and studied in statistical physics and related areas. Our results are classified into the following three topics.
1. Average-case analysis of local search algorithms:
There are many local search heuristics for satisfiability problems, which have been shown to solve given problems efficiently by, mainly, computer experiments. We proposed an approach for investigating such heuristics as rigorously as possible. One key method of this approach is "pseudo expectation", a way to analyze the average state of relatively simple (but with a large state space) Markov processes.
2. Design method for efficient learning algorithms:
Boosting method has been studied as one of the important approach for designing learning algorithms. We studied the algorithmic aspects of boosting. We proposed "MadaBoost", a simple boosting algorithm that shows better performance for data with noise and outliers. We also proposed an adaptive sampling method as an implementations technique of boosting. On these methods and their statistical investigations have been summarized as a book (in Japanese), which will appear in 2006.
3. Design and analysis of message passing algorithms
Belief propagations have been studied in AI and statistical physics as a promising approach for solving hard combinatorial problems. Based on belief propagation, we derived similar message passing type algorithms for Graph Bisection problem and Max-2SAT problem, well-know NP-hard optimization problems. We also proved that they solve these problems with high probability under certain average-case models.

Report

(5 results)
  • 2005 Annual Research Report   Final Research Report Summary
  • 2004 Annual Research Report
  • 2003 Annual Research Report
  • 2002 Annual Research Report
  • Research Products

    (34 results)

All 2006 2005 2004 2003 2002 Other

All Journal Article (22 results) Book (1 results) Publications (11 results)

  • [Journal Article] Distributions in the Ehrenfest process2006

    • Author(s)
      S.Balaji, H.M.Mahmoud, O.Watanabe
    • Journal Title

      Statistics and Probability Letters Vol.76, No.7

      Pages: 666-674

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Average-case analysis for the MAX-2SAT problem2006

    • Author(s)
      O.Watanabe, M.Yamamoto
    • Journal Title

      Proc. Int'l Conf. on Theory and Applications of Satisfiability Testing LNCS 4142

      Pages: 277-282

    • NAID

      10018162837

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Distributions in the Ehrenfest process2006

    • Author(s)
      S.Balaji, H.M.Mahmoud, 0.Watanabe
    • Journal Title

      Statistics and Prob. Letters Vol.76, No.7

      Pages: 666-674

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Average-case analysis for the MAX-2SAT problem2006

    • Author(s)
      O.Watanabe, M.Yamamoto
    • Journal Title

      Proc. Int'l Conference on Theory and Applications of Satisfiability Testing LNCS 4142

      Pages: 277-282

    • NAID

      10018162837

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Boosting--Design Method for Learning Algorithms (in Japanese)2006

    • Author(s)
      O.Watanabe, T.Kanamori, K.Hatano
    • Journal Title

      Morikita Pub. Co. Ltd.

      Pages: 207-207

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] A message passing algorithm for MAX2SAT2006

    • Author(s)
      渡辺治, 山本真基
    • Journal Title

      電子情報通信学会全国大会 D-S

      Pages: 19-20

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Pseudo Expectation : A Tool for Analyzing Local Search Algorithm2005

    • Author(s)
      O.Watanabe
    • Journal Title

      Progress of Theoretical Physics Vol. 157

      Pages: 338-344

    • NAID

      110001276036

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Some heuristic analysis of local search algorithms for SAT problems2005

    • Author(s)
      O.Watanabe
    • Journal Title

      Proc. Int'l Sympos on Stochastic Algorithms LNCS 3777

      Pages: 14-24

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Some heuristic analysis of local search algorithms for SAT problems2005

    • Author(s)
      O.Watanabe
    • Journal Title

      Proc. Int'l Symposium on Stochastic Algorithms LNCS 3777

      Pages: 14-24

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Sequential sampling techniques for algorithmic learning theory2005

    • Author(s)
      O.Watanabe
    • Journal Title

      Theoretical Computer Science Vol. 348

      Pages: 3-14

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Some heuristic analysis of local search algorithms for SAT problems2005

    • Author(s)
      O.Watanabe
    • Journal Title

      3rd International Symposium on Stochastic Algorithms LNCS 3777

      Pages: 14-24

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Sequential sampling techniques for algorithmic learning theory2005

    • Author(s)
      O.Watanabe
    • Journal Title

      Theoretical Computer Science 348

      Pages: 3-14

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Learning of r-of-k functions by boosting2004

    • Author(s)
      K.Hatano, O.Watanabe
    • Journal Title

      Proc. Int'l Conference on Algorithmic Learning Theory LNCS 3244

      Pages: 114-126

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Relativized collapsing between BPP and PH under stringent oracle access2004

    • Author(s)
      J.Y.Cai, O.Watanabe
    • Journal Title

      Information Processing Letter 90

      Pages: 147-154

    • Related Report
      2004 Annual Research Report
  • [Journal Article] On proving circuit lower bounds against the polynomial-time hierarch2004

    • Author(s)
      J.Y.Cai, O.Watanabe
    • Journal Title

      SIAM J.Computing 33・4

      Pages: 984-1009

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Learning of r-of-k functions by boosting2004

    • Author(s)
      K.Hatano, O.Watanabe
    • Journal Title

      Proc.15^<th> Intl Conference on Algorithmic Learning Theory LNCS3244

      Pages: 114-126

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Analysis of a randomized local search algorithm for LDPCC decoding problem2003

    • Author(s)
      O.Watanabe, T.Sawai, H.Takayashi
    • Journal Title

      Proc. Int'l Sympos on Stochastic Algorithms LNCS 2827

      Pages: 50-60

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Analysis of a randomized local search algorithm for LDPCC decoding problem2003

    • Author(s)
      O.Watanabe, T.Sawai, H.Takayashi
    • Journal Title

      Proc. Int'l Symposium on Stochastic Algorithms LNCS 2827

      Pages: 50-60

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Adaptive sampling methods for scaling up knowledge discovery algorithm2002

    • Author(s)
      C.Domingo, R.Gavalda, O.Watanabe
    • Journal Title

      Data Mining and Knowledge Discovery Vol.6, No.2

      Pages: 131-152

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Adaptive sampling methods for scaling up knowledge discovery algorithms2002

    • Author(s)
      C.Domingo, R.Gavalda, 0.Watanabe
    • Journal Title

      Data Mining and Knowledge Discovery Vol. 6 No. 2

      Pages: 131-152

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Distributions in the Ehrenfest process

    • Author(s)
      S.Balaji, H.M.Mahmoud, O.Watanabe
    • Journal Title

      Statistics and Probability Letters 掲載予定

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Pseudo Expectation : A Tool for Analyzing Local Search Algorithm

    • Author(s)
      O.Watanabe
    • Journal Title

      Progress of Theoretical Physics (掲載予定)

    • NAID

      110001276036

    • Related Report
      2004 Annual Research Report
  • [Book] ブースティング(学習アルゴリズムの設計技法)2006

    • Author(s)
      渡辺治, 金森敬文, 畑埜晃平
    • Total Pages
      207
    • Publisher
      森北出版
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Publications] S.Aida, M.Crasmaru, K.Regan, O.Watanabe: "Games with a uniqueness property"Theory of Comput.Systems. 37. 29-47 (2004)

    • Related Report
      2003 Annual Research Report
  • [Publications] J.Y.Cai, O.Watanabe: "On proving circuit lower bounds against the polynomial-time hierarchy : positive and negative results"Proc.9th COCOON Conference, LNCS. 2697. 202-211 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] O.Watanabe, T.Sawai, H.Takayashi: "Analysis of a randomized local search algorithm for LDPCC decoding problem"Proc.2nd Int'l Sympos.on Stochastic Algorithms, LNCS. 2827. 50-60 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] J.Cai, O.Watanabe: "Stringent relativization"Proc.23rd FSTTCS Conference, LNCS. 2914. 408-419 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 新倉康明, Johannes Schneider, 渡辺 治: "単純な規則で表わされるマルコフ過程の近似解析手法"コンピュテーション研究会TGCOMP. No.3. (2004)

    • Related Report
      2003 Annual Research Report
  • [Publications] 澤井 健, 渡辺 治: "LDPC符号に対するランダム復号法の解析"アルゴリズム研究会SIGAL. NO.3. 25-32 (2003)

    • Related Report
      2002 Annual Research Report
  • [Publications] S.Aida, R.Schuler, T.Tsukiji, O.Watanabe: "The Difference between polynominal-time many-one and truth-table reducibilities on distributional problems"Theory of Comput.Systems. 35. 449-463 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] C.Domingo, R.Gavalda, O.Watanabe: "Adaptive sampling methods for scaling up knowledge discovery algorithms"Data Mining and Knowledge Discovery. 6(2). 131-152 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] Manlove, D., Irving, R., Iwama, K., Miyazaki, S., Morita, Y.: "Hard Variants of Stable Marriage"Theoretical Computer Science. 276. 261-279 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] Iwama, K., Yamashita, S.: "Transformation Rules for Designing CNOT-based Quantum Circuits"Proc.39^<th> ACM/IEEE DAC. 419-424 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] Iwama, K., Morizumi, H.: "An Explicit Lower Bound of $5n-o(n)$ for Boolean Circuits"Proc.MFCS2002. 353-364 (2002)

    • Related Report
      2002 Annual Research Report

URL: 

Published: 2002-04-01   Modified: 2018-03-28  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi