Creative extensions of data mining theory by means of quantum-mechanical labeling

• Project/Area Number: 22300078
• Research Category: Grant-in-Aid for Scientific Research (B)
• Allocation Type: Single-year Grants
• Section: 一般
• Research Field: Sensitivity informatics/Soft computing
• Research Institution: Tohoku University
• Principal Investigator: TANAKA Kazuyuki 東北大学, 大学院・情報科学研究科, 教授 (80217017)
• Co-Investigator(Kenkyū-buntansha): INOUE Jun-ichi 北海道大学, 大学院・情報科学研究科, 准教授 (30311658)
• Co-Investigator(Renkei-kenkyūsha): TSUDA Koji 産業技術総合研究所, 生命情報工学研究センター, 主任研究員 (90357517)
• Project Period (FY): 2010 – 2012
• Project Status: Completed (Fiscal Year 2012)
• Budget Amount: ¥17,940,000 (Direct Cost: ¥13,800,000、Indirect Cost: ¥4,140,000); Fiscal Year 2012: ¥5,590,000 (Direct Cost: ¥4,300,000、Indirect Cost: ¥1,290,000); Fiscal Year 2011: ¥5,980,000 (Direct Cost: ¥4,600,000、Indirect Cost: ¥1,380,000); Fiscal Year 2010: ¥6,370,000 (Direct Cost: ¥4,900,000、Indirect Cost: ¥1,470,000)
• Keywords: 数理工学 / 機械学習 / 統計数学 / 情報統計力学 / 確率的情報処理

Research Abstract

General frameworks of statistical machine learning systems based on quantum-mechanical extended Markov random fields has been provided by using belief propagation methods. Some novel statistical model selection schemes by using quantum belief propagation methods have been proposed. As one of unexpected research results in our present project proposal, we have established new statistical learning frameworks for some statistical models with the first-order phase transitions in the stand point of constrained maximization ofentropies instead of conventional maximum likelihood estimations.

Research Products

• [Journal Article] Susceptibility Propagation by Using Diagonal Consistency (2013)
  • Author(s): Muneki Yasuda and Kazuyuki Tanaka
  • Journal Title: Physical Review E Volume: Vol.87, No.1, Article No.012134 Issue: 1 Pages: 1-6
  • DOI: 10.1103/physreve.87.012134
  • Peer Reviewed
• [Journal Article] Learning Algorithm for Boltzmann Machines Using Max-Product Algorithm and Pseudo-Likelihood (2012)
  • Author(s): Muneki Yasuda, Junya Tannai and Kazuyuki Tanaka
  • Journal Title: Interdisciplinary Information Sciences Volume: 18 Issue: 1 Pages: 55-63
  • DOI: 10.4036/iis.2012.55
  • NAID: 130002531670
  • ISSN: 1340-9050, 1347-6157
  • Peer Reviewed
• [Journal Article] Bayesian ImageModeling by Means of GeneralizedSparse Prior and Loopy Belief Propagation (2012)
  • Author(s): Kazuyuki Tanaka, Muneki Yasuda and D.Michael Titterington
  • Journal Title: Journal of the Physical Society of Japan Volume: Vol.81, No.11, Article No.114802 Issue: 11 Pages: 1-9
  • DOI: 10.1143/jpsj.81.114802
  • Peer Reviewed
• [Journal Article] Effect of quantum fluctuation in error-correcting codes (2012)
  • Author(s): Y. Otsubo, J. Inoue, K. Nagata, M. Okada
  • Journal Title: Physical Review E Volume: 86 Issue: 5 Pages: 1-10
  • DOI: 10.1103/physreve.86.051138
  • Peer Reviewed
• [Journal Article] Replica Plefka expansion of Ising systems (2012)
  • Author(s): Muneki Yasuda, Yoshiyuki Kabashima and Kazuyuki Tanaka
  • Journal Title: Journal of Statistical Mechanics Volume: (2012) Issue: 04 Pages: 1-16
  • DOI: 10.1088/1742-5468/2012/04/p04002
  • Peer Reviewed
• [Journal Article] Inverse Problem in Pairwise Markov Random Fields using Loopy Belief Propagation (2012)
  • Author(s): Muneki Yasuda, Shun Kataoka, Kazuyuki Tanaka
  • Journal Title: Journal of the Physical Society of Japan Volume: 81 Issue: 4 Pages: 1-8
  • DOI: 10.1143/jpsj.81.044801
  • NAID: 40019224431
  • Peer Reviewed
• [Journal Article] Statistical analysis of Gaussian image inpainting problems (2012)
  • Author(s): Shun Kataoka, Muneki Yasuda, Kazuyuki Tanaka
  • Journal Title: Journal of the Physical Society of Japan Volume: 81 Issue: 2 Pages: 1-2
  • DOI: 10.1143/jpsj.81.025001
  • NAID: 210000109417
  • Peer Reviewed
• [Journal Article] TAP Equation for Nonnegative Boltzmann Machine: Philosophical Magazine (2012)
  • Author(s): Muneki Yasuda and Kazuyuki Tanaka
  • Journal Title: The Study of Condensed Matter Volume: Vol.92, Nos.1-3 Issue: 1-3 Pages: 192-209
  • DOI: 10.1080/14786435.2011.634856
  • Peer Reviewed
• [Journal Article] Statistical analysis of the expectation-maximization algorithm with loopy belief propagation in Bayesian image modeling (2012)
  • Author(s): Shun Kataoka, Muneki Yasuda, Kazuyuki Tanaka, D.M.Titterington
  • Journal Title: Philosophical Magazine Volume: 92 Issue: 1-3 Pages: 50-63
  • DOI: 10.1080/14786435.2011.624558
  • Peer Reviewed
• [Journal Article] 2部グラフ型ボルツマンマシンに対する複合最尤法 (2012)
  • Author(s): 浅利岳, 安田宗樹, 和泉勇治, 田中和之
  • Journal Title: 電子情報通信学会技術研究報告 Volume: 112 Pages: 39-44
  • NAID: 110009642382
• [Journal Article] Pattern-recalling processes in quantum Hopfield networks far from saturation (2011)
  • Author(s): Jun-ichi Inoue
  • Journal Title: Journal of Physics:Conference Series Volume: Vol.297, Article No.012012 Pages: 1-10
  • DOI: 10.1088/1742-6596/297/1/012012
  • NAID: 120003354973
  • Peer Reviewed
• [Journal Article] Learning algorithm in restricted Boltzmann machines using Kullback-Leibler importance estimation procedure (2011)
  • Author(s): Muneki Yasuda, Tetsuharu Sakurai and Kazuyuki Tanaka
  • Journal Title: Nonlinear Theory and Its Applications, IEICE Volume: 2 Issue: 2 Pages: 153-164
  • DOI: 10.1587/nolta.2.153
  • NAID: 130000903451
  • ISSN: 2185-4106
  • Peer Reviewed
• [Journal Article] 相関等式を用いたボルツマンマシンの決定論的近似学習アルゴリズム (2010)
  • Author(s): 安田宗樹,田中和之
  • Journal Title: 電子情報通信学会論文誌(D) Volume: Vol.J93-D,No.11 Pages: 2446-2453
  • NAID: 110007880367
  • Peer Reviewed
• [Journal Article] Statistical performance analysis by loopy belief propagation in Bayesian image modeling (2010)
  • Author(s): Kazuyuki Tanaka, Shun Kataoka and Muneki Yasuda
  • Journal Title: Journal of Physics: Conference Series Volume: Vol.233, Article No.012013 Pages: 1-11
  • DOI: 10.1088/1742-6596/233/1/012013
  • Peer Reviewed
• [Journal Article] Deterministic flows of Order Parameters in Stochastic Processes of Quantum Monte Carlo Method (2010)
  • Author(s): Jun-ichi Inoue
  • Journal Title: Journal of Physics: Conference Series Volume: Vol.233, Article No.012010 Pages: 1-14
  • DOI: 10.1088/1742-6596/233/1/012010
  • Peer Reviewed
• [Journal Article] 相関等式を用いたボルツマンマシンの決定論的近似学習アルゴリズム (2010)
  • Author(s): 安田宗樹, 田中和之
  • Journal Title: 電子情報通信学会論文誌(D) Volume: J93-D Pages: 2446-2453
  • NAID: 110007880367
  • Peer Reviewed
• [Journal Article] Statistical performance analysis by loopy belief propagation in Bayesian image modeling (2010)
  • Author(s): Kazuyuki Tanaka, Shun Kataoka, Muneki Yasuda
  • Journal Title: Journal of Physics : Conference Series Volume: 233
  • Peer Reviewed
• [Journal Article] Deterministic flows of order parameters in stochastic processes of Quantum Monte Carlo method (2010)
  • Author(s): Jun-ichi Inoue
  • Journal Title: Journal of Physics : Conference Series Volume: 233
  • Peer Reviewed
• [Presentation] ガウシアングラフィカルモデルを用いた確率的画像補修フィルタの設計 (2012)
  • Author(s): 北川智隆,安田宗樹,田中和之
  • Organizer: 電子情報通信学会ニューロコンピューティング研究会
  • Place of Presentation: 東北大学
  • Year and Date: 2012-11-17
• [Presentation] 2部グラフ型ボルツマンマシンに対する複合最尤法 (2012)
  • Author(s): 浅利岳,安田宗樹,和泉勇治,田中和之
  • Organizer: 電子情報通信学会ニューロコンピューティング研究会
  • Place of Presentation: 東北大学
  • Year and Date: 2012-11-17
• [Presentation] Composite Likelihood Estimation for Restricted Boltzmann Machines (2012)
  • Author(s): Muneki Yasuda, Shun Kataoka, Yuji Waizumi and Kazuyuki Tanaka
  • Organizer: 21st International Conference on Pattern Recognition
  • Place of Presentation: Tsukuba, Japan
  • Year and Date: 2012-11-14
• [Presentation] スパース相互作用をもつ事前分布と確率伝搬法によるベイジアンモデリング (2012)
  • Author(s): 田中和之,安田宗樹
  • Organizer: 日本物理学会2012年秋季大会
  • Place of Presentation: 横浜国立大学
  • Year and Date: 2012-09-18
• [Presentation] Bayesian imagemodeling by generalized sparse Markov random fields and loopy belief propagation (2012)
  • Author(s): Kazuyuki Tanaka
  • Organizer: Interdisciplinary Workshop on Inference ---Information processing in complex systems with applications to traffic forecasting---
  • Place of Presentation: Inria Paris-Rocquencourt (Paris sub-office), Paris, France.
  • Year and Date: 2012-06-12
• [Presentation] 圧縮センシングを用いた画像補修モデリング (2012)
  • Author(s): 片岡駿,安田宗樹,樺島祥介,田中和之
  • Organizer: 日本物理学会第67回年次大会
  • Place of Presentation: 関西学院大学西宮上ケ原キャンパス
  • Year and Date: 2012-03-27
• [Presentation] カラーチャンネル間の相関を考慮したGaussian FoEモデル (2011)
  • Author(s): 村山竜太,安田宗樹,和泉勇治,田中和之
  • Organizer: 電子情報通信学会情報論的学習理論と機械学習研究会
  • Place of Presentation: 奈良女子大学
  • Year and Date: 2011-11-09
• [Presentation] Automatic Ridge Network Detection in Crumpled Paper Based on Graph Density (2011)
  • Author(s): Marvin Huang, Chiou-Ting Hsu and Kazuyuki Tanaka
  • Organizer: 2011 IEEE 13th International Workshop on Multimedia Signal Processing, Digital Object Identifier
  • Place of Presentation: Hangzhou, China
  • Year and Date: 2011-10-19
• [Presentation] ランダム欠損を利用した画像圧縮法 (2011)
  • Author(s): 片岡駿,安田宗樹,田中和之
  • Organizer: 日本物理学会2011年秋季大会
  • Place of Presentation: 富山大学
  • Year and Date: 2011-09-22
• [Presentation] オンサガー項を考慮した感受率伝搬法の改良とその一般化 (2011)
  • Author(s): 安田宗樹,田中和之
  • Organizer: 日本物理学会2011年秋季大会
  • Place of Presentation: 富山大学
  • Year and Date: 2011-09-21
• [Presentation] スパース正則化項をともなうマルコフ確率場における確率伝搬法 (2010)
  • Author(s): 田中和之
  • Organizer: 電子情報通信学会ニューロコンピューティング研究会
  • Place of Presentation: 東北大学
  • Year and Date: 2010-11-18
• [Presentation] 1RSBを考慮したTAP方程式を用いた感受率伝搬法 (2010)
  • Author(s): 安田宗樹,樺島祥介,田中和之
  • Organizer: 日本物理学会2010年秋季大会
  • Place of Presentation: 大阪府立大学中百舌鳥キャンパス
  • Year and Date: 2010-09-25
• [Presentation] 1RSBを考慮したTAP方程式を用いた感受率伝搬法 (2010)
  • Author(s): 安田宗樹, 樺島祥介, 田中和之
  • Organizer: 日本物理学会2010年秋季大会
  • Place of Presentation: 大阪府立大学
  • Year and Date: 2010-09-25
• [Presentation] Plefka Expansion of Replica Extended Ising Model and Its Application to Inverse Ising Problem (2010)
  • Author(s): Muneki Yasuda, Yoshiyuki Kabashima and Kazuyuki Tanaka
  • Organizer: 24 IUPAP International Conference onStatistical Physics
  • Place of Presentation: Cairns, Australia
  • Year and Date: 2010-07-22
• [Presentation] Composite Likelihood Estimation for Restricted Boltzmann Machines
  • Author(s): Muneki Yasuda, Shun Kataoka, Yuji Waizumi, Kazuyuki Tanaka
  • Organizer: 21st International Conference on Pattern Recognition
  • Place of Presentation: Tsukuba, Japan
• [Presentation] Bayesian image modeling by generalized sparse Markov random fields and loopy belief propagation
  • Author(s): Kazuyuki Tanaka
  • Organizer: Interdisciplinary Workshop on Inference ---Information processing in complex systems with applications to traffic forecasting---
  • Place of Presentation: Inria Paris-Rocquencourt (Paris sub-office), Paris, France
  • Invited
• [Presentation] 確率的情報処理への統計力学的アプローチ
  • Author(s): 田中和之
  • Organizer: 計算材料科学と数学の協働によるスマート材料デザイン手法の探索 ---階層構造を解析する---
  • Place of Presentation: 東北大学原子分子材料科学高等研究機構
• [Presentation] スパース相互作用をもつ事前分布と確率伝搬法によるベイジアンモデリング
  • Author(s): 田中和之，安田宗樹
  • Organizer: 日本物理学会2012年秋季大会
  • Place of Presentation: 横浜国立大学
• [Book] ---CVIMチュートリアルシリーズ---コンピュータビジョン最先端ガイド3(八木康史,斎藤英雄編),第6章.大規模確率場と確率的画像処理の深化と展開 (2010)
  • Author(s): 安田宗樹,片岡駿,田中和之共著(分担執筆)
  • Publisher: アドコム・メディア株式会社
• [Book] International Workshop on Statistical-Mechinical Informatics2010, Journal of Physics, Conference Series, Vol.233, Article (2010)
  • Author(s): Jun-ichi Inoue, Yoshiyuki Kabashima, Kazuyuki Tanaka and Toshiyuki Tanaka (eds)
  • Publisher: IOP Publishing
• [Book] 映像情報メディア工学大事典(映像情報メディア学会編)/基礎編,第4部門.画像処理,第12章.確率的画像処理 (2010)
  • Author(s): 田中和之,安田宗樹共著(分担執筆)
  • Publisher: オーム社
• [Book] …CVIMチュートリアルシリーズ…コンピュータビジョン最先端ガイド3,第6章.大規模確率場と確率的画像処理の深化と展開(分担執筆)(八木康史,斎藤英雄編) (2010)
  • Author(s): 安田宗樹, 片岡駿, 田中和之
  • Publisher: アドコム・メディア株式会社
• [Book] 映像情報メディア工学大事典/基礎編,第4部門.画像処理,第12章.確率的画像処理(分担執筆)(映像情報メディア学会編) (2010)
  • Author(s): 田中和之, 安田宗樹
  • Publisher: オーム社
• [Remarks]
  • URL: http://www.smapip.is.tohoku.ac.jp/~kazu/index-j.html
• [Remarks]
  • URL: http://www.smapip.is.tohoku.ac.jp/~kazu/index-j.html