• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Sentence translation mechanism equipped with an explainable process based on real-world and linguistic knowledge

Research Project

Project/Area Number 19H04162
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Review Section Basic Section 61030:Intelligent informatics-related
Research InstitutionTohoku University

Principal Investigator

Suzuki Jun  東北大学, データ駆動科学・AI教育研究センター, 教授 (80396150)

Co-Investigator(Kenkyū-buntansha) 松林 優一郎  東北大学, 教育学研究科, 准教授 (20582901)
乾 健太郎  東北大学, 情報科学研究科, 教授 (60272689)
赤間 怜奈  東北大学, データ駆動科学・AI教育研究センター, 助教 (70912533)
Project Period (FY) 2019-04-01 – 2022-03-31
Project Status Completed (Fiscal Year 2021)
Budget Amount *help
¥16,900,000 (Direct Cost: ¥13,000,000、Indirect Cost: ¥3,900,000)
Fiscal Year 2021: ¥4,290,000 (Direct Cost: ¥3,300,000、Indirect Cost: ¥990,000)
Fiscal Year 2020: ¥4,550,000 (Direct Cost: ¥3,500,000、Indirect Cost: ¥1,050,000)
Fiscal Year 2019: ¥8,060,000 (Direct Cost: ¥6,200,000、Indirect Cost: ¥1,860,000)
Keywords自然言語処理 / 人工知能 / 機械学習 / 文章生成 / 解釈性 / 説明性 / 深層学習 / 自然言語生成
Outline of Research at the Start

「自然言語て記述された文章から,事前の定義に従って別の文章を生成する」という文章生成の問題(例:自動翻訳,対話)では,「符号化復号化器」と呼ばれるれる深層ニューラルネットワ ークに基づく方法論が現在主流である.しかし,符号化復号化器に基づく方法論とその延長線上の技術では,極めて流暢な文章が得られる半面,説明不能な文章をしばしば生成するという問題点がある.そこで本研究では,「処理過程の説明性を備えた文章変換計算機構の実現により説明不能な生成の発生メカヌズムを解明し,根本的な解決に向けた指針を得られるか」という学術的な問いを探究する.

Outline of Final Research Achievements

Realizing a text generation mechanism at the human level is one of the most critical and challenging unsolved problems in artificial intelligence and natural language processing research. While current methods based on deep neural networks can generate fluent sentences, a new problem, the erroneous generation problem, has been pointed out.
In this study, to solve the erroneous generation problem and reveal the mechanism of its occurrence, we have developed several methods, such as an example-based method to detect reasons for erroneous generation, and an improved natural language analysis system for analyzing erroneous generations.

Academic Significance and Societal Importance of the Research Achievements

文章生成における誤生成問題は一見小さな技術的課題のように思えるが,誹謗中傷,差別,卑猥な表現と捉えられるような,状況的,或いは,社会通念的に不適切な文章を実用システムが一度でも誤生成してしまうと致命的な社会問題となりえるという潜在的リスクがある.このことから,誤生成問題の解決に向けた研究成果は社会的に大きな意義がある.また,学術的にも,人間と同等レベルの文章生成技術の実現は,自然言語処理研究の古くからの最難関未解決課題の一つであり,達成に向けた研究成果の意義は高い.

Report

(4 results)
  • 2021 Annual Research Report   Final Research Report ( PDF )
  • 2020 Annual Research Report
  • 2019 Annual Research Report
  • Research Products

    (50 results)

All 2022 2021 2020 2019

All Journal Article (19 results) (of which Peer Reviewed: 19 results,  Open Access: 19 results) Presentation (31 results) (of which Int'l Joint Research: 4 results)

  • [Journal Article] Evaluating Dialogue Response Generation Systems via Response Selection with Well-chosen False Candidates2022

    • Author(s)
      Sato Shiki、Akama Reina、Ouchi Hiroki、Suzuki Jun、Inui Kentaro
    • Journal Title

      Journal of Natural Language Processing

      Volume: 29 Issue: 1 Pages: 53-83

    • DOI

      10.5715/jnlp.29.53

    • ISSN
      1340-7619, 2185-8314
    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Instance-Based Neural Dependency Parsing2021

    • Author(s)
      Ouchi Hiroki、Suzuki Jun、Kobayashi Sosuke、Yokoi Sho、Kuribayashi Tatsuki、Yoshikawa Masashi、Inui Kentaro
    • Journal Title

      Transactions of the Association for Computational Linguistics

      Volume: 9 Pages: 1493-1507

    • DOI

      10.1162/tacl_a_00439

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Subword-Based Compact Reconstruction for Open-Vocabulary Neural Word Embeddings2021

    • Author(s)
      Sasaki Shota、Suzuki Jun、Inui Kentaro
    • Journal Title

      IEEE/ACM Transactions on Audio, Speech, and Language Processing

      Volume: 29 Pages: 3551-3564

    • DOI

      10.1109/taslp.2021.3125133

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Efficient Estimation of Influence of a Training Instance2021

    • Author(s)
      Sosuke Kobayashi、Yokoi Sho、Suzuki Jun、Inui Kentaro
    • Journal Title

      Journal of Natural Language Processing

      Volume: 28 Issue: 2 Pages: 573-597

    • DOI

      10.5715/jnlp.28.573

    • NAID

      130008052568

    • ISSN
      1340-7619, 2185-8314
    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Phenomenon-wise Evaluation Dataset Towards Analyzing Robustness of Machine Translation Models2021

    • Author(s)
      Fujii Ryo、Mita Masato、Abe Kaori、Hanawa Kazuaki、Morishita Makoto、Suzuki Jun、Inui Kentaro
    • Journal Title

      Journal of Natural Language Processing

      Volume: 28 Issue: 2 Pages: 450-478

    • DOI

      10.5715/jnlp.28.450

    • NAID

      130008052586

    • ISSN
      1340-7619, 2185-8314
    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] SHAPE: Shifted Absolute Position Embedding for Transformers2021

    • Author(s)
      Kiyono Shun、Kobayashi Sosuke、Suzuki Jun、Inui Kentaro
    • Journal Title

      Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing

      Volume: NA Pages: 3309-3321

    • DOI

      10.18653/v1/2021.emnlp-main.266

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Pseudo Zero Pronoun Resolution Improves Zero Anaphora Resolution2021

    • Author(s)
      Konno Ryuto、Kiyono Shun、Matsubayashi Yuichiroh、Ouchi Hiroki、Inui Kentaro
    • Journal Title

      Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing

      Volume: NA Pages: 3790-3806

    • DOI

      10.18653/v1/2021.emnlp-main.308

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] A Data-Oriented Approach for Closed-Book Question Answering2021

    • Author(s)
      鈴木 正敏, 松田 耕史, 大内 啓樹, 鈴木 潤, 乾 健太郎
    • Journal Title

      Journal of Natural Language Processing

      Volume: 28 Issue: 1 Pages: 3-25

    • DOI

      10.5715/jnlp.28.3

    • NAID

      130007998395

    • ISSN
      1340-7619, 2185-8314
    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Efficient Estimation of Influence of a Training Instance2020

    • Author(s)
      Sosuke Kobayashi, Sho Yokoi, Jun Suzuki, Kentaro Inui
    • Journal Title

      Proceedings of SustaiNLP: Workshop on Simple and Efficient Natural Language Processing

      Volume: 1 Pages: 41-47

    • DOI

      10.18653/v1/2020.sustainlp-1.6

    • NAID

      130008052568

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Preventing Critical Scoring Errors in Short Answer Scoring with Confidence Estimation2020

    • Author(s)
      Funayama Hiroaki、Sasaki Shota、Matsubayashi Yuichiroh、Mizumoto Tomoya、Suzuki Jun、Mita Masato、Inui Kentaro
    • Journal Title

      Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics: Student Research Workshop

      Volume: 1 Pages: 237-243

    • DOI

      10.18653/v1/2020.acl-srw.32

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Embeddings of Label Components for Sequence Labeling: A Case Study of Fine-grained Named Entity Recognition2020

    • Author(s)
      Takuma Kato, Kaori Abe, Hiroki Ouchi, Shumpei Miyawaki, Jun Suzuki, Kentaro Inui
    • Journal Title

      Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics: Student Research Workshop

      Volume: 1 Pages: 222-229

    • DOI

      10.18653/v1/2020.acl-srw.30

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Instance-Based Learning of Span Representations: A Case Study through Named Entity Recognition2020

    • Author(s)
      Hiroki Ouchi, Jun Suzuki, Sosuke Kobayashi, Sho Yokoi, Tatsuki Kuribayashi, Ryuto Konno, Kentaro Inui
    • Journal Title

      Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics

      Volume: 1 Pages: 6452-6459

    • DOI

      10.18653/v1/2020.acl-main.575

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Encoder-Decoder Models Can Benefit from Pre-trained Masked Language Models in Grammatical Error Correction2020

    • Author(s)
      Masahiro Kaneko, Masato Mita, Shun Kiyono, Jun Suzuki, Kentaro Inui
    • Journal Title

      Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics

      Volume: 1 Pages: 4248-4254

    • DOI

      10.18653/v1/2020.acl-main.391

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Single Model Ensemble using Pseudo-Tags and Distinct Vectors2020

    • Author(s)
      Ryosuke Kuwabara, Jun Suzuki, Hideki Nakayama
    • Journal Title

      Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics

      Volume: 1 Pages: 3006-3013

    • DOI

      10.18653/v1/2020.acl-main.271

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Evaluating Dialogue Generation Systems via Response Selection2020

    • Author(s)
      Shiki Sato, Reina Akama, Hiroki Ouchi, Jun Suzuki, Kentaro Inui
    • Journal Title

      Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics

      Volume: 1 Pages: 593-599

    • DOI

      10.18653/v1/2020.acl-main.55

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Language Models as an Alternative Evaluator of Word Order Hypotheses: A Case Study in Japanese2020

    • Author(s)
      Tatsuki Kuribayashi, Takumi Ito, Jun Suzuki, Kentaro Inui
    • Journal Title

      Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics

      Volume: 1 Pages: 488-504

    • DOI

      10.18653/v1/2020.acl-main.47

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Word Rotator's Distance2020

    • Author(s)
      Sho Yokoi, Ryo Takahashi, Reina Akama, Jun Suzuki, Kentaro Inui
    • Journal Title

      Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)

      Volume: 1 Pages: 2944-2960

    • DOI

      10.18653/v1/2020.emnlp-main.236

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Filtering Noisy Dialogue Corpora by Connectivity and Content Relatedness2020

    • Author(s)
      Reina Akama, Sho Yokoi, Jun Suzuki, Kentaro Inui
    • Journal Title

      Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)

      Volume: 1 Pages: 941-958

    • DOI

      10.18653/v1/2020.emnlp-main.68

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Attention is Not Only a Weight: Analyzing Transformers with Vector Norms2020

    • Author(s)
      Goro Kobayashi, Tatsuki Kuribayashi, Sho Yokoi, Kentaro Inui
    • Journal Title

      Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)

      Volume: 1 Pages: 7057-7075

    • DOI

      10.18653/v1/2020.emnlp-main.574

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Presentation] Transformerを多層にする際の勾配消失問題と解決法について2022

    • Author(s)
      高瀬翔, 清野舜, 小林颯介, 鈴木潤
    • Organizer
      言語処理学会第28回年次大会
    • Related Report
      2021 Annual Research Report
  • [Presentation] 規範的な日本語日常対話コーパスの設計2022

    • Author(s)
      赤間怜奈, 磯部順子, 鈴木潤, 乾健太郎
    • Organizer
      言語処理学会第28回年次大会
    • Related Report
      2021 Annual Research Report
  • [Presentation] 論述リビジョンのためのメタ評価基盤2022

    • Author(s)
      三田雅人, 坂口慶祐, 萩原正人, 水本智也, 鈴木潤, 乾健太郎
    • Organizer
      言語処理学会第28回年次大会
    • Related Report
      2021 Annual Research Report
  • [Presentation] 記述式答案自動採点における確信度推定とその役割2022

    • Author(s)
      舟山弘晃, 佐藤汰亮, 松林優一郎, 水本智也, 鈴木潤, 乾健太郎
    • Organizer
      言語処理学会第28回年次大会
    • Related Report
      2021 Annual Research Report
  • [Presentation] シフト付き絶対位置埋め込み.2022

    • Author(s)
      清野舜, 小林颯介, 鈴木潤, 乾健太郎
    • Organizer
      言語処理学会第28回年次大会
    • Related Report
      2021 Annual Research Report
  • [Presentation] 目標指向対話のためのサブゴール設計に基づく発話系列生成.2021

    • Author(s)
      岸波洋介, 赤間怜奈, 佐藤志貴, 徳久良子, 鈴木潤, 乾健太郎
    • Organizer
      第93回 人工知能学会 言語・音声理解と対話処理研究会(SLUD)
    • Related Report
      2021 Annual Research Report
  • [Presentation] Towards Detecting Errors of Chat Translation: Evaluating Translated Chat with Classifiers and Building Auto-Evaluatable Translation Chat System2021

    • Author(s)
      李云蒙, 阿部香央莉, 徳久良子, 森下睦, 鈴木潤, 乾健太郎
    • Organizer
      第16回NLP若手の会 シンポジウム
    • Related Report
      2021 Annual Research Report
  • [Presentation] 対話システムの先読み能力実現に向けた未来の展開まで生成する学習戦略の提案と分析2021

    • Author(s)
      岸波洋介, 赤間怜奈, 佐藤志貴, 鈴木潤, 徳久良子, 乾健太郎
    • Organizer
      2021年度人工知能学会全国大会
    • Related Report
      2021 Annual Research Report
  • [Presentation] 事例ベース依存構造解析のための依存関係表現学習2021

    • Author(s)
      大内啓樹, 鈴木潤, 小林颯介, 横井祥, 栗林樹生, 吉川将司, 乾健太郎
    • Organizer
      言語処理学会第27回年次大会
    • Related Report
      2020 Annual Research Report
  • [Presentation] オープンドメイン質問応答における解答可能性判別の役割2021

    • Author(s)
      鈴木正敏, 松田耕史, 大内啓樹, 鈴木潤, 乾健太郎
    • Organizer
      言語処理学会第27回年次大会
    • Related Report
      2020 Annual Research Report
  • [Presentation] 単語埋め込みの決定的縮約2021

    • Author(s)
      仲村祐希, 鈴木潤, 高橋諒, 乾健太郎
    • Organizer
      言語処理学会第27回年次大会
    • Related Report
      2020 Annual Research Report
  • [Presentation] オープンドメインQAにおけるDPRの有効性検証2021

    • Author(s)
      加藤拓真, 宮脇峻平, 西田京介, 鈴木潤
    • Organizer
      言語処理学会第27回年次大会
    • Related Report
      2020 Annual Research Report
  • [Presentation] 対話システムの矛盾応答の生成に対する脆弱性の分析2021

    • Author(s)
      佐藤志貴, 赤間怜奈, 大内啓樹, 鈴木潤, 乾健太郎
    • Organizer
      言語処理学会第27回年次大会
    • Related Report
      2020 Annual Research Report
  • [Presentation] Langsmith: 人とシステムの協働による論文執筆2021

    • Author(s)
      伊藤拓海, 栗林樹生, 日高雅俊, 鈴木潤, 乾健太郎
    • Organizer
      言語処理学会第27回年次大会
    • Related Report
      2020 Annual Research Report
  • [Presentation] ユーザ生成コンテンツの高品質な自動翻訳に向けた言語現象の体系的分析2021

    • Author(s)
      藤井 諒, 三田 雅人, 阿部 香央莉, 塙 一晃, 森下 睦, 鈴木 潤, 乾 健太郎
    • Organizer
      2020年度人工知能学会全国大会
    • Related Report
      2020 Annual Research Report
  • [Presentation] ニューラル対話応答生成のための言語非依存な低品質対話データフィルタリング法の提案と分析2021

    • Author(s)
      赤間 怜奈, 横井 祥, 鈴木 潤, 乾 健太郎
    • Organizer
      2020年度人工知能学会全国大会
    • Related Report
      2020 Annual Research Report
  • [Presentation] JAQKET: クイズを題材にした日本語QAデータセットの構築2020

    • Author(s)
      鈴木正敏, 鈴木潤, 松田耕史, 西田京介, 井之上直也
    • Organizer
      言語処理学会第26回年次大会
    • Related Report
      2019 Annual Research Report
  • [Presentation] スパン間の類似性に基づく事例ベース構造予測2020

    • Author(s)
      大内啓樹, 鈴木潤, 小林颯介, 横井祥, 栗林樹生, 乾健太郎
    • Organizer
      言語処理学会第26回年次大会
    • Related Report
      2019 Annual Research Report
  • [Presentation] 擬似タグと線形移動ベクトルを用いた単一モデルによる擬似モデルアンサンブル2020

    • Author(s)
      桑原亮介, 鈴木潤, 中山英樹
    • Organizer
      言語処理学会第26回年次大会
    • Related Report
      2019 Annual Research Report
  • [Presentation] テキストを通して世界を見る:機械読解における常識的推論のための画像説明文の評価2020

    • Author(s)
      Diana Galvan-Sosa, 西田京介, 松田耕史, 鈴木潤, 乾健太郎
    • Organizer
      言語処理学会第26回年次大会
    • Related Report
      2019 Annual Research Report
  • [Presentation] 単一評価サンプルのためのトランズダクティブ学習2020

    • Author(s)
      佐々木翔大, 大内啓樹, 鈴木潤, Ana Brassard, 乾健太郎
    • Organizer
      言語処理学会第26回年次大会
    • Related Report
      2019 Annual Research Report
  • [Presentation] ベクトル長に基づく自己注意機構の解析2020

    • Author(s)
      小林悟郎, 栗林樹生, 横井祥, 鈴木潤, 乾健太郎
    • Organizer
      言語処理学会第26回年次大会
    • Related Report
      2019 Annual Research Report
  • [Presentation] 大規模疑似データを用いた高性能文法誤り訂正モデルの構築2020

    • Author(s)
      清野舜, 鈴木潤, 三田雅人, 水本智也, 乾健太郎
    • Organizer
      言語処理学会第26回年次大会
    • Related Report
      2019 Annual Research Report
  • [Presentation] 記述式答案自動採点のための確信度推定手法の検討2020

    • Author(s)
      舟山弘晃, 佐々木翔大, 水本智也, 三田雅人, 鈴木潤, 松林優一郎, 乾健太郎
    • Organizer
      言語処理学会第26回年次大会
    • Related Report
      2019 Annual Research Report
  • [Presentation] 評価データのクラスタリングを用いた記述式答案自動採点のためのトランズダクティブ学習2020

    • Author(s)
      佐藤俊, 佐々木翔大, 大内啓樹, 鈴木潤, 乾健太郎
    • Organizer
      言語処理学会第26回年次大会
    • Related Report
      2019 Annual Research Report
  • [Presentation] 句の呼応と話題の一貫性に着目した低品質対話データの教師なしフィルタリング2020

    • Author(s)
      赤間怜奈, 鈴木潤, 横井祥, 乾健太郎
    • Organizer
      言語処理学会第26回年次大会
    • Related Report
      2019 Annual Research Report
  • [Presentation] 対話応答選択による対話応答生成モデルの評価2020

    • Author(s)
      佐藤志貴, 赤間怜奈, 大内啓樹, 鈴木潤, 乾健太郎
    • Organizer
      言語処理学会第26回年次大会
    • Related Report
      2019 Annual Research Report
  • [Presentation] Diamonds in the Rough: Generating Fluent Sentences from Early-stage Drafts2019

    • Author(s)
      Takumi Ito, Tatsuki Kuribayashi, Hayato Kobayashi, Ana Brassard, Masato Hagiwara, Jun Suzuki and Kentaro Inui.
    • Organizer
      Proceedings of the 12th International Conference on Natural Language Generation (INLG-2019)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Select and Attend: Towards Controllable Content Selection in Text Generation2019

    • Author(s)
      Xiaoyu Shen, Jun Suzuki, Kentaro Inui, Hui Su, Dietrich Klakow and Satoshi Sekine.
    • Organizer
      Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP-2019),
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] An Empirical Study of Incorporating Pseudo Data into Grammatical Error Correction2019

    • Author(s)
      Shun Kiyono, Jun Suzuki, Masato Mita, Tomoya Mizumoto and Kentaro Inui.
    • Organizer
      Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP-2019),
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Transductive Learning of Neural Language Models for Syntactic and Semantic Analysis2019

    • Author(s)
      Hiroki Ouchi, Jun Suzuki and Kentaro Inui.
    • Organizer
      Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP-2019),
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research

URL: 

Published: 2019-04-18   Modified: 2023-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi