• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Controllable Natural Language Generation with Neural Networks

Research Project

Project/Area Number 16H05873
Research Category

Grant-in-Aid for Young Scientists (A)

Allocation TypeSingle-year Grants
Research Field Intelligent informatics
Research InstitutionNara Institute of Science and Technology

Principal Investigator

Neubig Graham  奈良先端科学技術大学院大学, 先端科学技術研究科, 客員准教授 (70633428)

Project Period (FY) 2016-04-01 – 2019-03-31
Project Status Completed (Fiscal Year 2018)
Budget Amount *help
¥22,620,000 (Direct Cost: ¥17,400,000、Indirect Cost: ¥5,220,000)
Fiscal Year 2018: ¥5,070,000 (Direct Cost: ¥3,900,000、Indirect Cost: ¥1,170,000)
Fiscal Year 2017: ¥8,840,000 (Direct Cost: ¥6,800,000、Indirect Cost: ¥2,040,000)
Fiscal Year 2016: ¥8,710,000 (Direct Cost: ¥6,700,000、Indirect Cost: ¥2,010,000)
Keywords言語生成 / 機械翻訳 / ニューラルネットワーク / 機械学習 / 自然言語処理 / 人工知能 / 深層学習 / 自然言語生成 / 制御性
Outline of Final Research Achievements

Technology to generate sentences in natural language has various applications: machine translation, which translates between human languages, dialogue systems, which facilitate communication between humans and machines, and summarization, which converts longer chunks of content into short summaries. Recently, methods based on neural networks (NNs) have outperformed other more traditional models by a large margin, but they often also cause unpredictable and serious errors. In this project, we developed NN-based language generation technology where it is possible to control the results, maintaining the accuracy of NN-based methods while improving practical applicability.

Academic Significance and Societal Importance of the Research Achievements

それぞれの研究成果は、言語生成の性能向上、効率向上、制御性向上などを実現しており、機械翻訳・対話システム・自動要約などの幅広い分野で適応可能である。それぞれの応用において、誤りの削減や制御性の向上、効率の向上を実験により確認している。また、開発したソフトウェアを公開し、研究機関や企業などで広く利用されている。

Report

(4 results)
  • 2018 Annual Research Report   Final Research Report ( PDF )
  • 2017 Annual Research Report
  • 2016 Annual Research Report
  • Research Products

    (22 results)

All 2018 2017 2016 Other

All Journal Article (10 results) (of which Int'l Joint Research: 6 results,  Peer Reviewed: 10 results,  Open Access: 10 results,  Acknowledgement Compliant: 4 results) Presentation (11 results) (of which Int'l Joint Research: 3 results,  Invited: 3 results) Remarks (1 results)

  • [Journal Article] Neural Machine Translation Models using Binarized Prediction and Error Correction2018

    • Author(s)
      小田 悠介, Philip Arthur, Graham Neubig, 吉野 幸一郎, 中村 哲
    • Journal Title

      Journal of Natural Language Processing

      Volume: 25 Issue: 2 Pages: 167-199

    • DOI

      10.5715/jnlp.25.167

    • NAID

      130007397052

    • ISSN
      1340-7619, 2185-8314
    • Year and Date
      2018-03-15
    • Related Report
      2017 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Multi-Source Neural Machine Translation with Data Augmentation2018

    • Author(s)
      Yuta Nishimura, Katsuhito Sudoh, Graham Neubig, Satoshi Nakamura
    • Journal Title

      Proceedings of the 15th International Workshop on Spoken Language Translation

      Volume: 15 Pages: 48-53

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Multi-Source Neural Machine Translation with Missing Data2018

    • Author(s)
      Yuta Nishimura, Katsuhito Sudoh, Graham Neubig, Satoshi Nakamura
    • Journal Title

      Proceedings of the Second Workshop on Neural Machine Translation and Generation

      Volume: 2 Pages: 92-99

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Neural Machine Translation via Binary Code Prediction2017

    • Author(s)
      Yusuke Oda, Philip Arthur, Graham Neubig, Koichiro Yoshino, Satoshi Nakamura
    • Journal Title

      Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics

      Volume: 55 Pages: 850-860

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Tree as a Pivot: Syntactic Matching Methods in Pivot Translation2017

    • Author(s)
      Akiva Miura, Graham Neubig, Katsuhito Sudoh, Satoshi Nakamura
    • Journal Title

      Proceedings of the 2nd Conference on Machine Translation

      Volume: 2 Pages: 90-98

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] An Empirical Study of Mini-Batch Creation Strategies for Neural Machine Translation2017

    • Author(s)
      Makoto Morishita, Yusuke Oda, Graham Neubig, Koichiro Yoshino, Katsuhito Sudoh, Satoshi Nakamura
    • Journal Title

      Proceedings of the First Workshop on Neural Machine Translation

      Volume: 1 Pages: 61-68

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Neural Machine Translation via Binary Code Prediction2017

    • Author(s)
      Yusuke Oda, Philip Arthur, Graham Neubig, Koichiro Yoshino, Satoshi Nakamura
    • Journal Title

      Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (ACL)

      Volume: 55

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] Generalizing and Hybridizing Count-based and Neural Language Models2016

    • Author(s)
      Graham Neubig, Chris Dyer
    • Journal Title

      Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing

      Volume: 2016 Pages: 1163-1172

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research / Acknowledgement Compliant
  • [Journal Article] Incorporating Discrete Translation Lexicons into Neural Machine Translation2016

    • Author(s)
      Philip Arthur, Graham Neubig, Satoshi Nakamura
    • Journal Title

      Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing

      Volume: 2016 Pages: 1557-1567

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] Improving Pivot Translation by Remembering the Pivot2016

    • Author(s)
      三浦明波, Graham Neubig, Sakriani Sakti, 戸田智基, 中村哲
    • Journal Title

      Journal of Natural Language Processing

      Volume: 23 Issue: 5 Pages: 499-528

    • DOI

      10.5715/jnlp.23.499

    • NAID

      130005439795

    • ISSN
      1340-7619, 2185-8314
    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Presentation] What can Neural Networks Teach us about Language?2018

    • Author(s)
      Graham Neubig
    • Organizer
      理化学研究所革新知能プロジェクトセミナー
    • Related Report
      2018 Annual Research Report
    • Invited
  • [Presentation] マルチソースニューラル機械翻訳における翻訳時の原言語欠落補完2018

    • Author(s)
      西村 優汰, 須藤 克仁, Graham Neubig, 中村 哲
    • Organizer
      言語処理学会第24回年次大会(NLP2018)
    • Related Report
      2018 Annual Research Report
  • [Presentation] 目的言語側の構造を考慮した自然言語からの構文的に正しいソースコード生成2017

    • Author(s)
      札場 寛之, 小田 悠介, 吉野 幸一郎, Graham Neubig, 中村 哲
    • Organizer
      言語処理学会第23回年次大会
    • Place of Presentation
      筑波大学(茨城県つくば市)
    • Year and Date
      2017-03-13
    • Related Report
      2016 Annual Research Report
  • [Presentation] ニューラル機械翻訳におけるミニバッチ構成法の違いによる影響の調査2017

    • Author(s)
      森下 睦, 小田 悠介, Graham Neubig, 吉野 幸一郎, 須藤 克仁, 中村 哲
    • Organizer
      言語処理学会第23回年次大会
    • Place of Presentation
      筑波大学(茨城県つくば市)
    • Year and Date
      2017-03-13
    • Related Report
      2016 Annual Research Report
  • [Presentation] 二値符号予測と誤り訂正に基づくコンパクトなニューラルネットワーク翻訳モデル2017

    • Author(s)
      小田 悠介, Philip Arthur, Graham Neubig, 吉野 幸一郎, 中村 哲
    • Organizer
      言語処理学会第23回年次大会
    • Place of Presentation
      筑波大学(茨城県つくば市)
    • Year and Date
      2017-03-13
    • Related Report
      2016 Annual Research Report
  • [Presentation] 構文構造の部分一致を考慮したピボット翻訳手法2017

    • Author(s)
      三浦 明波, Graham Neubig, 須藤 克仁, 中村 哲
    • Organizer
      情報処理学会 第231回自然言語処理研究会
    • Related Report
      2017 Annual Research Report
  • [Presentation] Softmax Approximations for Neural Machine Translation2017

    • Author(s)
      Graham Neubig
    • Organizer
      2017 Machine Translation Marathon in the Americas
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Lexicons and Minimum Risk Training for Neural Machine Translation: NAIST-CMU at WAT20162016

    • Author(s)
      Graham Neubig
    • Organizer
      Workshop on Asian Translation
    • Place of Presentation
      Osaka International Convention Center (大阪府大阪市)
    • Year and Date
      2016-12-12
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Structured Neural Networks for NLP: From Idea to Code2016

    • Author(s)
      Graham Neubig
    • Organizer
      Young Researcher's Symposium on Natural Language Processing
    • Place of Presentation
      Osaka International Convention Center (大阪府大阪市)
    • Year and Date
      2016-12-10
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] 木構造を中間表現とするピボット翻訳手法2016

    • Author(s)
      三浦 明波, Graham Neubig, 中村 哲
    • Organizer
      情報処理学会 第227回自然言語処理研究会
    • Place of Presentation
      岡山県立大学(岡山県総社市)
    • Year and Date
      2016-07-29
    • Related Report
      2016 Annual Research Report
  • [Presentation] 様々な分野における対訳コーパスを用いた構文解析器の自己学習効果の検証2016

    • Author(s)
      森下 睦, 小田 悠介, Graham Neubig, 吉野 幸一郎, 中村 哲
    • Organizer
      情報処理学会 第226回自然言語処理研究会
    • Place of Presentation
      東京工業大学(東京都大田区)
    • Year and Date
      2016-05-15
    • Related Report
      2016 Annual Research Report
  • [Remarks] DyNet: The Dynamic Neural Network Toolkit

    • URL

      https://github.com/clab/dynet/

    • Related Report
      2016 Annual Research Report

URL: 

Published: 2016-04-21   Modified: 2020-03-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi