• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Application of Nonparametric Bayesian Methods to Distributional Learning

Research Project

Project/Area Number 26730123
Research Category

Grant-in-Aid for Young Scientists (B)

Allocation TypeMulti-year Fund
Research Field Intelligent informatics
Research InstitutionTokyo University of Technology

Principal Investigator

SHIBATA Chihiro  東京工科大学, コンピュータサイエンス学部, 講師 (00633299)

Project Period (FY) 2014-04-01 – 2019-03-31
Project Status Completed (Fiscal Year 2018)
Budget Amount *help
¥3,510,000 (Direct Cost: ¥2,700,000、Indirect Cost: ¥810,000)
Fiscal Year 2017: ¥650,000 (Direct Cost: ¥500,000、Indirect Cost: ¥150,000)
Fiscal Year 2016: ¥650,000 (Direct Cost: ¥500,000、Indirect Cost: ¥150,000)
Fiscal Year 2015: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Fiscal Year 2014: ¥650,000 (Direct Cost: ¥500,000、Indirect Cost: ¥150,000)
Keywords機械学習 / 自然言語処理 / 構文解析 / ノンパラメトリックベイズ / 統計的学習 / ベイズ学習 / 教師なし学習 / 形式言語理論 / リカレントニューラルネットワーク / 並列分散処理 / Distributional Learning / Nonparametric Bayes / Learning Theory / Grammar Learning
Outline of Final Research Achievements

Based on the basic idea of distributed learning, we propose a grammatical structure with (k, l)-context-dependent probabilities using a hierarchical nonparametric Bayesian model called Hierarchical Pitman-Yor Processes. At the same time, a fast MCMC method for the estimation is proposed. In experiments, it was shown that high prediction accuracy could be obtained. As a final result, we developed the algorithms for improving the accuracy of unsupervised parsing.

Academic Significance and Societal Importance of the Research Achievements

近年の深層学習の発展により,自然言語処理の分野においても,様々なことが加速度的に可能となってきている.例えば,機械翻訳がその代表的な例である.一方で,現在の手法では,大量の教師ありのデータを必要とする.構文解析であれば,構文木を含む構文情報が付与された文のセットが必要となる.本研究成果は,構文木など教師となるものがまったくなくても,構文解析を統計的な学習手法を用いて行うものであり,特に,確率文脈自由文法の学習の観点から見て,より制度の高い確率構造と学習アルゴリズムを新規に提案している.

Report

(6 results)
  • 2018 Annual Research Report   Final Research Report ( PDF )
  • 2017 Research-status Report
  • 2016 Research-status Report
  • 2015 Research-status Report
  • 2014 Research-status Report
  • Research Products

    (19 results)

All 2018 2017 2016 2015 2014 2013

All Journal Article (7 results) (of which Int'l Joint Research: 2 results,  Peer Reviewed: 7 results,  Open Access: 3 results,  Acknowledgement Compliant: 4 results) Presentation (12 results) (of which Int'l Joint Research: 4 results)

  • [Journal Article] Subregular Complexity and Deep Learning2017

    • Author(s)
      Enes Avcu, Chihiro Shibata, Jeffrey Heinz
    • Journal Title

      In proceedings of Conference on Logic and Machine Learning in Natural Language (LaML)

      Volume: 1 Pages: 20-34

    • Related Report
      2017 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Predicting Sequential Data with LSTMs Augmented with Strictly 2-Piecewise Input Vectors2016

    • Author(s)
      Chihiro Shibata and Jeffrey Heinz
    • Journal Title

      JMLR: Workshop and Conference Proceedings 57

      Volume: 57 Pages: 137-142

    • Related Report
      2016 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research / Acknowledgement Compliant
  • [Journal Article] Probabilistic learnability of context-free grammars with basic distributional properties from positive examples2016

    • Author(s)
      Chihiro Shibata and Ryo Yoshinaka
    • Journal Title

      Theoretical computer science, Elsevier

      Volume: 620 Pages: 46-72

    • Related Report
      2015 Research-status Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] On Efficiency of Semantic Relation Extraction through Low-Dimensional Distributed Representations for Substrings2015

    • Author(s)
      Jin Zhan, Chihiro Shibata, Kazuya Tago
    • Journal Title

      in proceedings of the 2015 IEEE International Symposium on Smart Data (with the 17th IEEE International Conference on High Performance Computing and Communications)

      Volume: 0 Pages: 1749-1754

    • Related Report
      2015 Research-status Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Relation Classification through Substring Representations using Nonlinear Classifiers2015

    • Author(s)
      Zhan Jin, Chihiro Shibata, Jingtao Sun and Kazuya Tago
    • Journal Title

      In proceedings of the 2015 International Symposium on Nonlinear Theory & its Applications

      Volume: 0 Pages: 1-8

    • Related Report
      2015 Research-status Report
    • Peer Reviewed
  • [Journal Article] Inferring (k,l)-context-sensitive probabilistic context-free grammars using hierarchical Pitman-Yor processes2014

    • Author(s)
      Chihiro Shibata
    • Journal Title

      in JMLR: Workshop and Conference Proceedings ( Proceedings of the 12th ICGI)

      Volume: 34 Pages: 153-166

    • Related Report
      2014 Research-status Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] A comparison of collapsed Bayesian methods for probabilistic finite automata2013

    • Author(s)
      Chihiro Shibata, Ryo Yoshinaka
    • Journal Title

      Machine Learning

      Volume: NA Issue: 1-2 Pages: 155-188

    • DOI

      10.1007/s10994-013-5410-3

    • Related Report
      2014 Research-status Report
    • Peer Reviewed
  • [Presentation] 構文情報を陽に与えたときの LSTM-RNN による内部表現について2018

    • Author(s)
      岡本(柴田) 千尋,内海 慶,持橋 大地
    • Organizer
      第237回自然言語処理研究会
    • Related Report
      2018 Annual Research Report
  • [Presentation] Subregular Complexity and Deep Learning2017

    • Author(s)
      Enes Avcu, Chihiro Shibata and Jeffrey Heinz
    • Organizer
      LearnAut (Workshop on Thirty-Second Annual ACM/IEEE Symposium on Logic in Computer Science )
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Towards Learning Generalized Residual Finite State Automata2016

    • Author(s)
      Chihiro Shibata and Ryo Yoshinaka
    • Organizer
      The 13th International Conference on Grammatical Inference
    • Place of Presentation
      Delft, Netherlands
    • Year and Date
      2016-10-05
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] ニューラルネット言語モデルによる Twitter 上の発言からの5因子モデルに基づく性格分析2016

    • Author(s)
      塚野駿,柴田千尋,政倉祐子,田胡和哉
    • Organizer
      情報処理学会 第78回全国大会
    • Place of Presentation
      慶応義塾大学矢上キャンパス(神奈川県横浜市)
    • Year and Date
      2016-03-10
    • Related Report
      2015 Research-status Report
  • [Presentation] 深層強化学習ための環境シミュレーションと自律制御ロボットの連携2016

    • Author(s)
      宮島優太郎,李天琦,田胡和哉,柴田千尋
    • Organizer
      情報処理学会 第78回全国大会
    • Place of Presentation
      慶応義塾大学矢上キャンパス(神奈川県横浜市)
    • Year and Date
      2016-03-10
    • Related Report
      2015 Research-status Report
  • [Presentation] Relation Classification through Substring Representations using Nonlinear Classifiers2015

    • Author(s)
      Zhan Jin, Chihiro Shibata, Jingtao Sun and Kazuya Tago
    • Organizer
      2015 International Symposium on Nonlinear Theory & its Applications
    • Place of Presentation
      香港市立大学(中国・香港)
    • Year and Date
      2015-12-02
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] On Efficiency of Semantic Relation Extraction through Low-Dimensional Distributed Representations for Substrings2015

    • Author(s)
      Jin Zhan, Chihiro Shibata, Kazuya Tago
    • Organizer
      IEEE International Symposium on Smart Data in conjunction with the 17th IEEE International Conference on High Performance Computing and Communications
    • Place of Presentation
      Hilton Newark Airport (USA, New York)
    • Year and Date
      2015-08-24
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] 文のテンプレートの学習および感情を考慮した会話文の生成2015

    • Author(s)
      加藤 和樹,柴田 千尋,田胡 和哉
    • Organizer
      情報処理学会 第77回全国大会
    • Place of Presentation
      京都大学(京都府京都市左京区)
    • Year and Date
      2015-03-17 – 2015-03-19
    • Related Report
      2014 Research-status Report
  • [Presentation] 単語ベクトルに基づく記録文書の概念検索2015

    • Author(s)
      三澤 虎遊汰,キン 展,柴田 千尋,田胡 和哉
    • Organizer
      情報処理学会 第77回全国大会
    • Place of Presentation
      京都大学(京都府京都市左京区)
    • Year and Date
      2015-03-17 – 2015-03-19
    • Related Report
      2014 Research-status Report
  • [Presentation] 階層化Pitman-Yor過程を用いた文脈を考慮した確率文脈自由文法の推定-分布学習の実データへの適用にむけて2014

    • Author(s)
      柴田 千尋
    • Organizer
      第17回情報論的学習理論ワークショップ
    • Place of Presentation
      名古屋大学(愛知県名古屋市千種区)
    • Year and Date
      2014-11-16 – 2014-11-19
    • Related Report
      2014 Research-status Report
  • [Presentation] Inferring (k,l)-context-sensitive probabilistic context-free grammars using hierarchical Pitman-Yor processes2014

    • Author(s)
      Chihiro Shibata
    • Organizer
      The 12th International Conference on Grammatical Inference
    • Place of Presentation
      京都大学(京都府京都市左京区)
    • Year and Date
      2014-09-17 – 2014-09-19
    • Related Report
      2014 Research-status Report
  • [Presentation] 連想概念辞書および Wikipedia のデータ を用いた部分・材料概念の抽出2014

    • Author(s)
      キン 展,柴田 千尋
    • Organizer
      2014年度人工知能学会全国大会
    • Place of Presentation
      愛媛県県民文化会館(愛媛県松山市道後町)
    • Year and Date
      2014-05-12 – 2014-05-15
    • Related Report
      2014 Research-status Report

URL: 

Published: 2014-04-04   Modified: 2020-03-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi