• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Analysis of Belief Propagation algorithms based on Information Geometry

Research Project

Project/Area Number 14084208
Research Category

Grant-in-Aid for Scientific Research on Priority Areas

Allocation TypeSingle-year Grants
Review Section Science and Engineering
Research InstitutionThe National Institute of Advanced Industrial Science and Technology (2003-2005)
Kyushu Institute of Technology (2002)

Principal Investigator

MOTOMURA Yoichi (2003-2005)  The National Institute of Advanced Industrial Science and Technology Digital Human Research Center, Senior research scientist, デジタルヒューマン研究センター, 主任研究員 (30358171)

池田 思朗 (2002)  九州工業大学, 大学院・生命体工学研究科, 助教授 (30336101)

Co-Investigator(Kenkyū-buntansha) IKEDA Shiro  Institute of Statistical Mathematics, Department of Mathematical Analysis and Statistical Inference, Associate Professor, 調査解析実験研究系, 助教授 (30336101)
本村 陽一  産業技術総合研究所, 情報処理研究部門, 主任研究員 (30358171)
Project Period (FY) 2002 – 2005
Project Status Completed (Fiscal Year 2005)
Budget Amount *help
¥6,600,000 (Direct Cost: ¥6,600,000)
Fiscal Year 2005: ¥1,400,000 (Direct Cost: ¥1,400,000)
Fiscal Year 2004: ¥1,700,000 (Direct Cost: ¥1,700,000)
Fiscal Year 2003: ¥2,300,000 (Direct Cost: ¥2,300,000)
Fiscal Year 2002: ¥1,200,000 (Direct Cost: ¥1,200,000)
KeywordsBelief Propagation / Bayesian network / Information geometry / Turbo coding / Low-density parity check code / Probabilistic reasoning / Statistical Learning / EM algorithm / 意図推定 / 意思決定支援 / ベイジアンネット / 確率モデル / 人工知能 / 近似計算 / 情報幾何学 / 情報通信学 / 人口知能 / 確率的情報処理 / アルゴリズム
Research Abstract

In the research of turbo codes, many studies have appeared. Although experimental results strongly support the efficacy of turbo codes, further theoretical analysis is necessary. We extend the geometrical framework initiated by Richardson to the information geometrical framework of dual affine connections, focusing on both of the turbo and LDPC decoding algorithms. The framework helps our intuitive 'understanding of the algorithms and opens a new prospect of further analysis. We reveal some properties of these codes in the proposed framework, including the stability and error analysis. Based on the error analysis, we finally propose a correction term for improving the approximation.
Belief propagation (BP) gives exact inference for stochastic models with tree interactions. Its performance has been analyzed separately in many fields, such as AI, statistical physics, information theory, and information geometry. We give a unified framework for understanding BP and related methods and summ … More arizes the results obtained in many fields. In particular, BP and its variants, including tree reparameterization and concave-convex procedure, are reformulated with information-geometrical terms, and their relations to the free energy function are elucidated from an information-geometrical viewpoint. Then a family of new algorithms are proposed The stabilities of the algorithms are analyzed, and methods to accelerate them are investigated.
Bayesian networks can be utilized for constructing a mathematical model of human cognitive and psychological functions, executable on a computer. We propose probabilistic modeling based on the Personal Construct Theory, a basic theory used in cognitive/evaluative structure models for individuals. After extracting a skeleton structure using the Evaluation Grid, Bayesian network model is constructed though statistical learning. By executing a probabilistic reasoning algorithm using belief propagation on the constructed model, our proposal is applied to user-adaptable information systems, information recommendation, car navigation systems, etc. Less

Report

(5 results)
  • 2005 Annual Research Report   Final Research Report Summary
  • 2004 Annual Research Report
  • 2003 Annual Research Report
  • 2002 Annual Research Report
  • Research Products

    (29 results)

All 2006 2005 2004 Other

All Journal Article (15 results) Book (4 results) Patent(Industrial Property Rights) (2 results) Publications (8 results)

  • [Journal Article] 確率伝搬法を用いたベイジアンネットのEMアルゴリズム2006

    • Author(s)
      本村陽一, 阪井尚樹
    • Journal Title

      電子情報通信学会技術研究報告 105・657

      Pages: 85-90

    • NAID

      110004680353

    • Related Report
      2005 Annual Research Report
  • [Journal Article] グラフ構造により事前知識を表す確率モデル2006

    • Author(s)
      本村陽一
    • Journal Title

      電子情報通信学会技術研究報告 105・673

      Pages: 149-154

    • NAID

      110004788337

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Probabilistic Human Modeling based on Personal Construct Theory2005

    • Author(s)
      Y.Motomura, T.Kanade
    • Journal Title

      Journal of Robotics and Mechatronics 17・6

      Pages: 689-696

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Annual Research Report 2005 Final Research Report Summary
  • [Journal Article] Probabilistic Human Modeling based on Personal Construct Theory2005

    • Author(s)
      Y.Motomura, T.Kanade
    • Journal Title

      Journal of Robotics and Mechatronics vol.17, no.6

      Pages: 689-696

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] 走行シーンにおける運転者の認知構造のモデル化2005

    • Author(s)
      本村陽一
    • Journal Title

      計測自動制御学会 システム・情報部門学術講演会2005講演論文集 1・1

      Pages: 137-140

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 子供の事故予防のための事故サーベイランスシステムへの取り組み〜確率的知識の抽出と活用〜2005

    • Author(s)
      本村陽一, 西田佳史, 山中龍宏, 北村光司, 金子彩, 柴田康徳, 溝口博
    • Journal Title

      電子情報通信学会技術研究報告 KBSE2005-23

      Pages: 13-18

    • NAID

      110004075393

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 日常環境における支援技術のための行動理解2005

    • Author(s)
      本村陽一, 西田佳史
    • Journal Title

      人工知能学会誌 20・5

      Pages: 587-594

    • Related Report
      2005 Annual Research Report
  • [Journal Article] ヒトの認知・評価構造の定量化モデリングと確率推論2005

    • Author(s)
      本村 陽一
    • Journal Title

      電子情報通信学会技術研究報告 104・585

      Pages: 25-30

    • NAID

      110003234105

    • Related Report
      2004 Annual Research Report
  • [Journal Article] 子供の事故予防のための確率モデル構築の試み2005

    • Author(s)
      本村 陽一
    • Journal Title

      電子情報通信学会技術研究報告 104・759

      Pages: 73-76

    • NAID

      110003234167

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Information geometry of turbo and low-density parity-check codes2004

    • Author(s)
      Shiro Ikeda
    • Journal Title

      IEEE transaction on Information Theory 50・6

      Pages: 1097-1114

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary 2004 Annual Research Report
  • [Journal Article] Stochastic reasoning, free energy, and information geometry2004

    • Author(s)
      Shiro Ikeda
    • Journal Title

      Neural Computation 16・9

      Pages: 1779-1810

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary 2004 Annual Research Report
  • [Journal Article] Information geometry of turbo and low-density parity-check codes2004

    • Author(s)
      Shiro Ikeda, Toshiyuki Tanaka, Shun-ichi Amari
    • Journal Title

      IEEE transaction on Information Theory vol.50, no.6

      Pages: 1097-1114

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Stochastic reasoning, free energy, and information geometry2004

    • Author(s)
      Shiro Ikeda, Toshiyuki Tanaka, Shun-ichi Amari
    • Journal Title

      Neural Computation vol.16, no.9

      Pages: 1779-1810

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] ベイジアンネットと確率推論-実際的応用のためのモデリングと推論アルゴリズムの解説-2004

    • Author(s)
      本村 陽一
    • Journal Title

      電子情報通信学会技術研究報告 104・348

      Pages: 29-34

    • NAID

      110003234048

    • Related Report
      2004 Annual Research Report
  • [Journal Article] ベイジアンネットによるヒーマンモデリングの実際2004

    • Author(s)
      本村 陽一
    • Journal Title

      電子情報通信学会技術研究報告 104・226

      Pages: 19-24

    • Related Report
      2004 Annual Research Report
  • [Book] ベイジアンネットワーク技術 : 顧客・ユーザのモデル化と不確実性推論2006

    • Author(s)
      本村陽一, 岩崎弘利
    • Total Pages
      230
    • Publisher
      東京電機大学出版
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Book] ベイジアンネットワーク概説2006

    • Author(s)
      繁桝算男, 植野真臣, 本村陽一
    • Total Pages
      130
    • Publisher
      培風館
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Book] 意思決定支援とネットビジネス2005

    • Author(s)
      藤本和則, 本村陽一, 松下光範, 庄司裕子
    • Total Pages
      190
    • Publisher
      オーム社
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Annual Research Report 2005 Final Research Report Summary
  • [Book] 学習システムの理論と実現2005

    • Author(s)
      渡辺澄夫, 萩原克幸, 赤穂昭太郎, 本村陽一, 福水健次, 岡田真人, 青柳美輝
    • Total Pages
      208
    • Publisher
      森北出版
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Patent(Industrial Property Rights)] 特許(出願)2004

    • Inventor(s)
      本村陽一
    • Industrial Property Rights Holder
      産総研
    • Industrial Property Number
      2004-198442
    • Filing Date
      2004-07-05
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Patent(Industrial Property Rights)] 特許(出願)2004

    • Inventor(s)
      本村 陽一
    • Industrial Property Rights Holder
      産業総合研究所
    • Industrial Property Number
      2004-198442
    • Filing Date
      2004-07-05
    • Related Report
      2004 Annual Research Report
  • [Publications] 本村 陽一: "ベイジアンネットによる確率的推論技術"計測と制御. 42・8. 649-654 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 本村 陽一: "ベイジアンネットソフトウェア BayoNet"計測と制御. 42・8. 693-694 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 本村 陽一: "ベイジアンネットワーク"電子情報通信学会技術研究報告NC. 103・228. 25-30 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 本村 陽一: "ベイジアンネットにおける確率推論アルゴリズムと実験評価"電子情報通信学会技術研究報告NC. 103・734. 157-162 (2004)

    • Related Report
      2003 Annual Research Report
  • [Publications] Yoichi Motomura: "Bayesian network : Probabilistic Reasoning, Statistical Learning, and Applications"Journal of Advanced Computational Intelligence and Intelligent Informatics. 8・2. 93-99 (2004)

    • Related Report
      2003 Annual Research Report
  • [Publications] 本村 陽一: "ベイジアンネットワーク:入門からヒューマンモデリングへの応用まで"「知識社会のための情報・統計科学」日本行動計量学会第七回セミナー講演論文集. 1・1. 22-37 (2004)

    • Related Report
      2003 Annual Research Report
  • [Publications] 渡辺澄夫, 他: "学習システムの理論と実現(第3章「ベイジアンネットワーク」)"森北出版. 210(30) (2004)

    • Related Report
      2003 Annual Research Report
  • [Publications] 池田思朗, 田中利幸, 甘利俊一: "Information geometry of turbo and low density-parity-check codes"RIKEN, BSIS Technical Report. 2003-2. (2003)

    • Related Report
      2002 Annual Research Report

URL: 

Published: 2002-04-01   Modified: 2018-03-28  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi