• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

The second order mean field approximation of graphical models and its application to Bayesian inference

Research Project

Project/Area Number 17500088
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field Intelligent informatics
Research InstitutionThe University of Electro-Communications

Principal Investigator

TAKAHASHI Haruhisa  The University of Electro-Communications, Information and Communication Engineering, Professor (90135418)

Co-Investigator(Kenkyū-buntansha) MURAMATSU Masakazu  The Unic. of Electro-Communications, Dept. of Computer Science, Professor (70266071)
堀田 一弘  電気通信大学, 電気通信学部, 助教 (40345426)
Project Period (FY) 2005 – 2007
Project Status Completed (Fiscal Year 2007)
Budget Amount *help
¥3,770,000 (Direct Cost: ¥3,500,000、Indirect Cost: ¥270,000)
Fiscal Year 2007: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2006: ¥1,000,000 (Direct Cost: ¥1,000,000)
Fiscal Year 2005: ¥1,600,000 (Direct Cost: ¥1,600,000)
KeywordsMarkov Random Field / Conditional Random Field / Mean Field Approximation / Phase Equation / Population Coding / 人工知能 / 脳・神経 / 確率論 / ソフトコンピューティング / 統計的学習 / マルコフランダムフィールド / 条件マルコフ場 / グラフィカルモデル / ニューラルネット
Research Abstract

Markov random field (MRF) and its discriminative version have been shown useful for both biological analysis and practical applications. In biological analysis, the debate on neuronal correlations is now continuing in which the analysis of the probability P( r| s) of the neuronal response r conditional on a stimulus s is required, which could be modeled with MRF. In this context the importance of a parametric model for analyzing correlations by modeling joint probability P(r, s) is shown using Gibbs distribution.
Several approximation techniques have been proposed for computing state probabilities of MRFs, CRFs, including belief propagation, which is not applicable for MRFs in a general situation. Mean field approximation (MRF) is known as only the generally applicable approximation technique at present.
To improve the accuracy of the mean-field approximation several advanced techniques have been proposed. Since the better accuracy we attain, the more intricate equations we get into, it … More becomes hard to know the efficient training procedure. In fact the training procedure is known only for the naive mean-field approximation (NMF), which is not so sufficient for the approximation accuracy.
The achievement of this research is to have refined the mean field approximation to alleviate both the testing and learning time, and to have shown the efficient learning scheme for object recognition with the variational phasor mean field model (VPMF). The striking result is that our learning scheme shows comparable testing performance with SVM, despite using much smaller size of training data, and in addition the detection time and the training time are much smaller than SVM based face detection.
Performance evaluation of VPMF is given for approximation accuracy, the local minima, and a face recognition problems. We have also attained the conclusion that the correlation of population coding in neural networks is more powerful than just using only the mean firing rate.
Performance evaluation of VPMF is given for approximation accuracy, the local minima, and a face recognition problems. Less

Report

(4 results)
  • 2007 Annual Research Report   Final Research Report Summary
  • 2006 Annual Research Report
  • 2005 Annual Research Report
  • Research Products

    (54 results)

All 2008 2007 2006 2005

All Journal Article (25 results) (of which Peer Reviewed: 6 results) Presentation (29 results)

  • [Journal Article] カーネル主成分分析を用いた学習機械のパラメータ自動決定法2008

    • Author(s)
      関口涼平, 高橋治久, 堀田一弘
    • Journal Title

      情報処理学会(TOM20) Vol.49,

      Pages: 79-87

    • NAID

      110006248710

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] The automatic parameter tuning in learning with kernel PCA2008

    • Author(s)
      R., Sekiguchi, H., Takahashi, K., Hotta
    • Journal Title

      Vol. 49, No. SIG4 TOM20)

      Pages: 79-87

    • NAID

      110006248710

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] カーネル主成分分析を用いた学習機械のパラメータ自動決定法2008

    • Author(s)
      関ロ涼平, 高橋治久, 堀田一弘
    • Journal Title

      情報処理学会 (TOM20) Vol.49,

      Pages: 79-87

    • NAID

      110006248710

    • Related Report
      2007 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Variational Phasor Mean Field Model for Markov Random Fields2007

    • Author(s)
      Haruhisa Takahashi
    • Journal Title

      2007Intarnational Symposium on Signal Processing and its Applications Soft Computing

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Phasor Mean Field Model for Image Processing2007

    • Author(s)
      Haruhisa Takahashi
    • Journal Title

      1~<st> International Conference on "Robot and Artificial Intelligence Robot Vision

    • Related Report
      2006 Annual Research Report
  • [Journal Article] カーネル主成分分析を用いた学習機会のパラメタ児童決定法2007

    • Author(s)
      関口涼平
    • Journal Title

      情報処理学会研究報告 MPS-63

      Pages: 9-12

    • Related Report
      2006 Annual Research Report
  • [Journal Article] View Independent Face Detection Based on Combination of Local and Global Kernels,2007

    • Author(s)
      K.Hotta
    • Journal Title

      International Conference on Computer Vision Systems Mar.21-24

    • Related Report
      2006 Annual Research Report
  • [Journal Article] An Object Detection Method Based on Independent Local Features2006

    • Author(s)
      R. Nakano, K. Hotta and H. Takahashi
    • Journal Title

      Journal of Robotics and Mechatronics Vol.18

      Pages: 1-7

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] A Robust Object Tracking Method under Pose Variation and Partial Occlusion2006

    • Author(s)
      K. Hotta
    • Journal Title

      IEICE Trans. on Information and Systems Vol.E89-D

      Pages: 2132-2141

    • NAID

      110007541101

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] A View Independent Video-Based Face Recognition Method Using Posterior Probability in Kernel Fisher Discriminant Space2006

    • Author(s)
      K. Hotta
    • Journal Title

      IEICE Trans. on Information and Systems Vol.E89-D

      Pages: 2150-2156

    • NAID

      110007541103

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] Journal of Robotics and Mechatronics2006

    • Author(s)
      R., Nakano, K., Hotta, H., Takahashi
    • Journal Title

      Vol. 18, No. 6

      Pages: 1-7

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] The worst-case time complexity for generating all maximal cliques and computational experiments2006

    • Author(s)
      E., Tomita, A., Tanaka, H., Takakashi
    • Journal Title

      Theoretical Computer Science 363

      Pages: 28-42

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] A Robust Object Tracking Method under Pose Variation and Partial Occlusion2006

    • Author(s)
      K., Hotta
    • Journal Title

      IEICE Trans. on Information and Systems Vol. E89-D, No. 7

      Pages: 2150-2156

    • NAID

      110007541101

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] SVM training : second-order cone programming versus quadratic programming2006

    • Author(s)
      Rameswar Debnath
    • Journal Title

      In Proceedings of the 2006 International Joint Conference on Neural Networks

      Pages: 2141-2147

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Support Vector Machine with Weighted Summation Kernel Obtained by Adaboost2006

    • Author(s)
      K.Hotta
    • Journal Title

      IEEE International Conference on Advanced Video and Signal based Surveillance Nov.22-24

    • Related Report
      2006 Annual Research Report
  • [Journal Article] The Variational Correlation Network for Object Detection2006

    • Author(s)
      Haruhisa Takahashi
    • Journal Title

      Proc.International Conferrence of CIMCA&IAWTIC2005 VolII

      Pages: 314-320

    • Related Report
      2005 Annual Research Report
  • [Journal Article] An Efficient support vector learning method with second-order cone programming for large-scale problems2005

    • Author(s)
      R. Debnath, Haruhisa Takahashi
    • Journal Title

      Applied Intelligence Vol 23

      Pages: 219-239

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] Maximal margin classifier based on geometric methods2005

    • Author(s)
      M., Manabu, H., Takahashi
    • Journal Title

      J of IEICE J88-D-II 4

      Pages: 687-694

    • NAID

      10016598586

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] Tuning Multiple Parameters for Support Vector Machines with Gaussian Kernel2005

    • Author(s)
      Rameswer, Debnath, Haruhisa, Takahashi
    • Journal Title

      Journal of Signal Processing Vol. 9, No. 6

      Pages: 447-456

    • NAID

      40007079762

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] An Efficient support vector learning method with second -order cone programming for large-scaleproblems2005

    • Author(s)
      Rameswer, Debnath, M., Muramatsu, Haruhisa, Takahashi
    • Journal Title

      Applied Intelligence Vol. 23

      Pages: 219-239

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] An Efficient Search Method Based on Dynamic Attention Map by Ising Model2005

    • Author(s)
      K., Hotta, M., Tanaka, T., Kurita, T., Mishima
    • Journal Title

      IEICE Trans. on Information and Systems Vol. E88-D, No. 10

      Pages: 2286-2295

    • NAID

      110003214158

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] Object Detection Using Independent Local Feature Extractor2005

    • Author(s)
      R.Nakano
    • Journal Title

      Proc.SPIE2005(SPIE International Symposium on Optomechatronic Technologies (ISOT2005)) Vol.6051

    • Related Report
      2005 Annual Research Report
  • [Journal Article] View Independent Face Recognition Based on Kernel Principal Component Analysis of Local Parts2005

    • Author(s)
      K.Hotta
    • Journal Title

      Proc.IEEE International Conference on Image Processing (ICIP2005) Vol.III

      Pages: 760-763

    • Related Report
      2005 Annual Research Report
  • [Journal Article] View Independent Video-Based Face Recognition Using Posterior Probability in Kernel Fisher Discriminant Space2005

    • Author(s)
      K.Hotta
    • Journal Title

      Lecture Notes in Computer Science (Proc.International Conference on Advanced in Pattern Recognition (ICAPR2005)) Vol.3687

      Pages: 103-111

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 部分的な隠れに頑健な顔検出法2005

    • Author(s)
      堀田 一弘
    • Journal Title

      電子情報通信学会論文誌D-II Vol.J88-D-II, No.8

      Pages: 1624-1633

    • Related Report
      2005 Annual Research Report
  • [Presentation] 色と形状のカーネルの和を用いた顕微鏡画像からのアスベスト検出2008

    • Author(s)
      野本敦夫, 堀田 一弘, 高橋治久
    • Organizer
      2008年電子情報通信学会 総合大会
    • Place of Presentation
      日本
    • Year and Date
      2008-03-20
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Annual Research Report 2007 Final Research Report Summary
  • [Presentation] One-class SVMを用いた顕微鏡画像からの粒子検出と計数2008

    • Author(s)
      久場日暖, 堀田 一弘, 高橋治久
    • Organizer
      2008年電子情報通信学会 総合大会
    • Place of Presentation
      日本
    • Year and Date
      2008-03-20
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Annual Research Report 2007 Final Research Report Summary
  • [Presentation] Variational Phasor Mean Field Model for Object Recognition2008

    • Author(s)
      Haruhisa Takahashi
    • Organizer
      International Symposium on Communications, control & Signal Processing
    • Place of Presentation
      Malta
    • Year and Date
      2008-03-13
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Annual Research Report 2007 Final Research Report Summary
  • [Presentation] Variational Phasor Mean Field Model for face Recognition2008

    • Author(s)
      Haruhisa Takahashi
    • Organizer
      2008 International Workshop on Nonlinear Circuits and Signal Processing(NCSP'08)
    • Place of Presentation
      Gold Coast, Australia
    • Year and Date
      2008-03-06
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] Variational Phasor Mean Field Model for face Recognition2008

    • Author(s)
      Haruhisa Takahashi
    • Organizer
      2008 International Workshop on Nonlinear Circuits and Signal Processing (NCSP'08)
    • Place of Presentation
      Gold Coast, Australia
    • Year and Date
      2008-03-06
    • Related Report
      2007 Annual Research Report
  • [Presentation] Object Categorization Based on Kernel Principal Component Analysis of Visual Words2008

    • Author(s)
      K. Hotta
    • Organizer
      IEEE Workshop on Applications of Computer Vision(WACV2008)
    • Place of Presentation
      Colorado, USA,
    • Year and Date
      2008-01-16
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] Object Categorization Based on Kernel Principal Component Analysis of Visual Words2008

    • Author(s)
      K. Hotta
    • Organizer
      IEEE Workshop on Applications of Computer Vision (WACV2008)
    • Place of Presentation
      Colorado, USA,
    • Year and Date
      2008-01-16
    • Related Report
      2007 Annual Research Report
  • [Presentation] Variational Phasor Mean Field Model for Object Recognition2008

    • Author(s)
      Haruhisa, Takahashi
    • Organizer
      International Symposium on Communications, control &Signal Processing, Malta
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] Variational Phasor Mean Field Model for face Recognition2008

    • Author(s)
      Haruhisa, Takahashi
    • Organizer
      Proceedings of the 2008 International Workshop on Nonlinear Circuits and Signal Processing (NCSP'08)
    • Place of Presentation
      Gold Coast, Australia
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] Phasor Mean Field Model for Image Processing2007

    • Author(s)
      Haruhisa Takahashi
    • Organizer
      1st International Conference on "Robot and Artificial Intelligence, Robot Vision
    • Place of Presentation
      China
    • Year and Date
      2007-11-15
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Annual Research Report 2007 Final Research Report Summary
  • [Presentation] Fast, Accurate and Robust Recognition Based On Summation of Local Normalized Linear Kernels2007

    • Author(s)
      K. Hotta
    • Organizer
      Digital Image Computing: Techniques and Applications(DICTA2007)
    • Place of Presentation
      Adelaide, Australia
    • Year and Date
      2007-11-04
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] Fast, Accurate and Robust Recognition Based On Summation of Local Normalized Linear Kernels2007

    • Author(s)
      K. Hotta
    • Organizer
      Digital Image Computing: Techniques and Applications (DICTA2007)
    • Place of Presentation
      Adelaide, Australia
    • Year and Date
      2007-11-04
    • Related Report
      2007 Annual Research Report
  • [Presentation] 局所特徴のカーネル主成分分析に基づくカテゴリ識別2007

    • Author(s)
      堀田 一弘
    • Organizer
      画像の認識・理解シンポジウム(MIRU2007)
    • Place of Presentation
      広島
    • Year and Date
      2007-07-30
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Annual Research Report 2007 Final Research Report Summary
  • [Presentation] カーネル主成分分析を用いた学習機械のパラメタ自動決定法2007

    • Author(s)
      関口涼平, 高橋治久, 堀田一弘
    • Organizer
      情報処理学会研究報告, MPS-63
    • Place of Presentation
      日本
    • Year and Date
      2007-06-15
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Annual Research Report 2007 Final Research Report Summary
  • [Presentation] View Independent Face Detection Based on Combination of Local and Global Kernels2007

    • Author(s)
      K. Hotta
    • Organizer
      International Conference on Computer Vision Systems(ICVS2007)
    • Place of Presentation
      Bielefield University, Germany
    • Year and Date
      2007-03-22
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] View Independent Face Detection Based on Combination of Local and Global Kernels2007

    • Author(s)
      K. Hotta
    • Organizer
      International Conference on Computer Vision Systems (ICVS2007)
    • Place of Presentation
      Bielefield University, Germany
    • Year and Date
      2007-03-22
    • Related Report
      2007 Annual Research Report
  • [Presentation] Variational Phasor Mean Field Model for Markov Random Fields2007

    • Author(s)
      Haruhisa Takahashi
    • Organizer
      2007International Symposium on Signal Processing and its Applications,
    • Place of Presentation
      UAE
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] Variational Phasor Mean Field Model for Markov Random Fields2007

    • Author(s)
      Haruhisa, Takahashi
    • Organizer
      2007International Symposium on Signal Processing and its Applications, Soft Computing
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] Phasor Mean Field Model for Image Processing2007

    • Author(s)
      Haruhsia, Takahashi
    • Organizer
      1st International Conference on Robot and Artificial Intelligence, Robot Vision
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] SVM training: second-order cone programming versus quadratic programming2006

    • Author(s)
      Rameswar Debnath and Haruhiha Takahashi
    • Organizer
      International Joint Conference on Neural Networks(IJCNN2006)
    • Place of Presentation
      Canada
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] View Independent Video-Based Face Recognition Using Posterior Probability in Kernel Fisher Discriminant Space2006

    • Author(s)
      Nakano, K. Hotta, H. Takahashi
    • Organizer
      International Conference on Advanced in Pattern Recognition(ICAPR2005),
    • Place of Presentation
      JPN
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] Adaptive Weighting of Local Classifiers by Particle Filter2006

    • Author(s)
      K. Hotta
    • Organizer
      International Conference on Pattern Reconition(ICPR2006)
    • Place of Presentation
      Hong Kong China
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] SVM training : second-order cone programming versus quadratic programming2006

    • Author(s)
      Rameswar, Debnath, Haruhiha, Takahashi
    • Organizer
      In Proceedings of the 2006 International Joint Conference on Neural Networks (IJCNN2006), Vancouver, BC
    • Place of Presentation
      Canada
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] Correlation Learning via Deterministic Networks2005

    • Author(s)
      Haruhisa Takahashi
    • Organizer
      Correlation Learning Workshop,
    • Place of Presentation
      Canada
    • Year and Date
      2005-05-08
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] The Variational Correlation Network for Object Detection2005

    • Author(s)
      Haruhisa Takahashi
    • Organizer
      Int. Conf. on Comp. Inteligence for Modelling", Control and Automation(CIMCA2005)
    • Place of Presentation
      Vienna, Austria
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] An Efficient Method for Large-Scale SVM Training2005

    • Author(s)
      Rameswar Debnath and Haruhiha Takahashi
    • Organizer
      RISP International Workshop on nonlinear Circuits and Signal Processing
    • Place of Presentation
      Canada
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] An Efficient Method for Large-cale SVM Training2005

    • Author(s)
      Rameswer, Debnath, Haruhiasa, Takahashi
    • Organizer
      Workshop on nonlinear Circuits and ignal Processing
    • Place of Presentation
      RISP International
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] The Variational Correlation Network for Object Detection Proc. Int. Conf. on Comp. Inteligence for Modelling2005

    • Author(s)
      H., Takahashi
    • Organizer
      Control and Automation
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] View Independent Video-Based Face Recognition Using Posterior Probability in Kernel Fisher Discriminant Space2005

    • Author(s)
      Nakano, K., Hotta, H., Takahashi
    • Organizer
      Vienna, Austria
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary

URL: 

Published: 2005-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi