• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Unsupervised Neural Machine Translation in Universal Scenarios

Research Project

Project/Area Number 19K20354
Research Category

Grant-in-Aid for Early-Career Scientists

Allocation TypeMulti-year Fund
Review Section Basic Section 61030:Intelligent informatics-related
Research InstitutionNational Institute of Information and Communications Technology

Principal Investigator

Wang Rui  国立研究開発法人情報通信研究機構, 先進的音声翻訳研究開発推進センター先進的翻訳技術研究室, 研究員 (00837635)

Project Period (FY) 2019-04-01 – 2021-03-31
Project Status Discontinued (Fiscal Year 2020)
Budget Amount *help
¥4,160,000 (Direct Cost: ¥3,200,000、Indirect Cost: ¥960,000)
Fiscal Year 2021: ¥910,000 (Direct Cost: ¥700,000、Indirect Cost: ¥210,000)
Fiscal Year 2020: ¥910,000 (Direct Cost: ¥700,000、Indirect Cost: ¥210,000)
Fiscal Year 2019: ¥2,340,000 (Direct Cost: ¥1,800,000、Indirect Cost: ¥540,000)
KeywordsMachine Translation / Unsupervised Learning / NLP / machine translation / AI / unsupervised learning
Outline of Research at the Start

I will conduct unsupervised neural machine translation (NMT) in universal scenarios.
1. In the scenario of rich-resource languages, the abundant monolingual corpora are available. I will generate high-quality pseudo parallel data by back-translation.
2. In the scenario of low-resource languages, the monolingual corpora are rare. I will conduct high-quality bilingual word embedding for robust UNMT.
3. In the real-scenario translation, the domain of user query (test data) is difficult to predict and is sometimes different from the training data. I will adapt the UNMT according to user queries.

Outline of Annual Research Achievements

I have proposed a universal unsupervised approach which train the translation model without using any parallel data. Compared with the existing unsupervised neural machine translation (UNMT) methods, which has only been applied to similar or rich-resource language pairs, my methods can be adapted to universal scenarios. I have published more than 20 peer-reviewed research papers (I am the corresponding authors of most of these papers). Most of these papers are published in the top-tier conferences and journal. Such as 7 ACL, 1 EMNLP, 2 AAAI, 2 ICLR, and 3 IEEE/ACM transactions. I won several first places in top-tier MT/NLP shared tasks, such as WMT-2019, WMT-2020, CoNLL-2019, etc.

Report

(2 results)
  • 2020 Annual Research Report
  • 2019 Research-status Report
  • Research Products

    (41 results)

All 2020 2019

All Journal Article (6 results) (of which Int'l Joint Research: 4 results,  Peer Reviewed: 4 results) Presentation (35 results) (of which Int'l Joint Research: 33 results)

  • [Journal Article] Neural Machine Translation with Target-Attention Model2020

    • Author(s)
      M Yang, M Zhang, K Chen, R Wang, T Zhao
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E103.D Issue: 3 Pages: 684-694

    • DOI

      10.1587/transinf.2019EDP7157

    • NAID

      130007804149

    • ISSN
      0916-8532, 1745-1361
    • Year and Date
      2020-03-01
    • Related Report
      2019 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Unsupervised Neural Machine Translation With Cross-Lingual Language Representation Agreement2020

    • Author(s)
      Sun Haipeng、Wang Rui、Chen Kehai、Utiyama Masao、Sumita Eiichiro、Zhao Tiejun
    • Journal Title

      IEEE/ACM Transactions on Audio, Speech, and Language Processing

      Volume: 28 Pages: 1170-1182

    • DOI

      10.1109/taslp.2020.2982282

    • Related Report
      2020 Annual Research Report 2019 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Neural Machine Translation with Target-Attention Model2020

    • Author(s)
      M Yang, M Zhang, K Chen, R Wang, T Zhao
    • Journal Title

      IEICE TRANSACTIONS on Information and Systems

      Volume: E103.D 巻 3 Pages: 684-694

    • NAID

      130007804149

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] A Survey of Domain Adaptation for Machine Translation2020

    • Author(s)
      C Chu, R Wang
    • Journal Title

      Journal of Information Processing

      Volume: -

    • NAID

      130007887723

    • Related Report
      2020 Annual Research Report 2019 Research-status Report
  • [Journal Article] Towards More Diverse Input Representation for Neural Machine Translation2020

    • Author(s)
      K Chen, R Wang, M Utiyama, E Sumita, T Zhao, M Yang, H Zhao
    • Journal Title

      IEEE/ACM Transactions on Audio, Speech, and Language Processing

      Volume: -

    • Related Report
      2020 Annual Research Report 2019 Research-status Report
  • [Journal Article] Neural machine translation with sentence-level topic context2019

    • Author(s)
      Chen Kehai, Wang Rui, Utiyama Masao, Sumita Eiichiro, Zhao Tiejun
    • Journal Title

      IEEE/ACM Transactions on Audio, Speech, and Language Processing

      Volume: 27 Issue: 12 Pages: 1970-1984

    • DOI

      10.1109/taslp.2019.2937190

    • Related Report
      2020 Annual Research Report 2019 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Presentation] Knowledge Distillation for Multilingual Unsupervised Neural Machine Translation2020

    • Author(s)
      H Sun, R Wang, K Chen, M Utiyama, E Sumita, T Zhao
    • Organizer
      The 58th Annual Meeting of the Association for Computational Linguistics (ACL-2020)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Content Word Aware Neural Machine Translation2020

    • Author(s)
      K Chen, R Wang, M Utiyama, E Sumita
    • Organizer
      The 58th Annual Meeting of the Association for Computational Linguistics (ACL-2020)
    • Related Report
      2020 Annual Research Report 2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Regularized Context Gates on Transformer for Machine Translation2020

    • Author(s)
      X Li, L Liu, R Wang, G Huang, M Meng
    • Organizer
      The 58th Annual Meeting of the Association for Computational Linguistics (ACL-2020)
    • Related Report
      2020 Annual Research Report 2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Data-dependent Gaussian Prior Objective for Language Generation2020

    • Author(s)
      Z Li, R Wang, K Chen, M Utiyama, E Sumita, Z Zhang, H Zhao
    • Organizer
      International Conference on Learning Representations (ICLR-2020)
    • Related Report
      2020 Annual Research Report 2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Neural Machine Translation with Universal Visual Representation2020

    • Author(s)
      Z Zhang, K Chen, R Wang, M Utiyama, E Sumita, Z Li, H Zhao
    • Organizer
      International Conference on Learning Representations (ICLR-2020)
    • Related Report
      2020 Annual Research Report 2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] SG-Net: Syntax-guided machine reading comprehension2020

    • Author(s)
      Z Zhang, Y Wu, J Zhou, S Duan, H Zhao, R Wang
    • Organizer
      Thirty-Fourth AAAI Conference on Artificial Intelligence (AAAI-2020)
    • Related Report
      2020 Annual Research Report 2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Explicit Sentence Compression for Neural Machine Translation2020

    • Author(s)
      Z Li, R Wang, K Chen, M Utiyama, E Sumita, Z Zhang, H Zhao
    • Organizer
      Thirty-Fourth AAAI Conference on Artificial Intelligence (AAAI-2020)
    • Related Report
      2020 Annual Research Report 2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Unsupervised Bilingual Word Embedding Agreement for Unsupervised Neural Machine Translation2020

    • Author(s)
      H Sun, R Wang, K Chen, M Utiyama, E Sumita, T Zhao
    • Organizer
      The 57th Annual Meeting of the Association for Computational Linguistics (ACL-2019)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Sentence-Level Agreement for Neural Machine Translation2020

    • Author(s)
      M Yang, R Wang, K Chen, M Utiyama, E Sumita, M Zhang, T Zhao
    • Organizer
      The 57th Annual Meeting of the Association for Computational Linguistics (ACL-2019)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Neural Machine Translation with Reordering Embeddings2020

    • Author(s)
      K Chen, R Wang, M Utiyama, E Sumita
    • Organizer
      The 57th Annual Meeting of the Association for Computational Linguistics (ACL-2019)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Lattice-Based Transformer Encoder for Neural Machine Translation2020

    • Author(s)
      F Xiao, J Li, H Zhao, R Wang, K Chen
    • Organizer
      The 57th Annual Meeting of the Association for Computational Linguistics (ACL-2019)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] English-Myanmar Supervised and Unsupervised NMT: NICT’s Machine Translation Systems at WAT-20192020

    • Author(s)
      R Wang, H Sun, K Chen, C Ding, M Utiyama, E Sumita
    • Organizer
      The 6th Workshop on Asian Translation (WAT-2019)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Recurrent Positional Embedding for Neural Machine Translation2020

    • Author(s)
      K Chen, R Wang, M Utiyama, E Sumita
    • Organizer
      2019 Conference on Empirical Methods in Natural Language Processing and 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP2019)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] SJTU-NICT at MRP 2019: Multi-Task Learning for End-to-End Uniform Semantic Graph Parsing2020

    • Author(s)
      Z Li, H Zhao, Z Zhang, R Wang, M Utiyama, E Sumita
    • Organizer
      2019 Conference on Natural Language Learning (CoNLL-2019)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Cross-Domain Transfer Learning for Dependency Parsing2020

    • Author(s)
      Z Li, J Zhou, H Zhao, R Wang
    • Organizer
      The CCF International conference on Natural Language Processing and Chinese Computing (NLPCC-2019)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] NICT’s Machine Translation Systems for CCMT-2019 Translation Task2020

    • Author(s)
      K Chen, R Wang, M Utiyama, E Sumita
    • Organizer
      5th China Conference on Machine Translation (CCMT)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] NICT’s Unsupervised Neural and Statistical Machine Translation Systems for the WMT19 News Translation Task2020

    • Author(s)
      B Marie, H Sun, R Wang, K Chen, A Fujita, M Utiyama, E Sumita
    • Organizer
      2019 Fourth Conference on Machine Translation (WMT-2019)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] NICT’s Supervised Neural Machine Translation Systems for the WMT19 News Translation Task2020

    • Author(s)
      R Dabre, K Chen, B Marie, R Wang, A Fujita, M Utiyama, E Sumita
    • Organizer
      2019 Fourth Conference on Machine Translation (WMT-2019)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Syntax-aware Transformer Encoder for Neural Machine Translation2020

    • Author(s)
      S Duan, H Zhao, J Zhou, R Wang
    • Organizer
      2019 International Conference on Asian Language Processing (IALP-2019)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Bilingual Word Embedding: A Survey from Supervised to Unsupervised2020

    • Author(s)
      H Sun, R Wang, K Chen, M Utiyama, E Sumita, T Zhao
    • Organizer
      言語処理学会第26回年次大会(NLP-2019)
    • Related Report
      2020 Annual Research Report
  • [Presentation] A Survey of Advances and Challenges in Unsupervised Neural Machine Translation2020

    • Author(s)
      R Wang, H Sun, M Utiyama, E Sumita
    • Organizer
      言語処理学会第27回年次大会(NLP-2020)
    • Related Report
      2020 Annual Research Report 2019 Research-status Report
  • [Presentation] Knowledge Distillation for Multilingual Unsupervised Neural Machine Translation2020

    • Author(s)
      H Sun, R Wang, K Chen, M Utiyama, E Sumita, T Zhao
    • Organizer
      The 58th Annual Meeting of the Association for Computational Linguistics (ACL-2020)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Unsupervised Bilingual Word Embedding Agreement for Unsupervised Neural Machine Translation2019

    • Author(s)
      H Sun, R Wang, K Chen, M Utiyama, E Sumita, T Zhao
    • Organizer
      The 57th Annual Meeting of the Association for Computational Linguistics (ACL-2019)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Sentence-Level Agreement for Neural Machine Translation2019

    • Author(s)
      M Yang, R Wang, K Chen, M Utiyama, E Sumita, M Zhang, T Zhao
    • Organizer
      The 57th Annual Meeting of the Association for Computational Linguistics (ACL-2019)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Neural Machine Translation with Reordering Embeddings2019

    • Author(s)
      K Chen, R Wang, M Utiyama, E Sumita
    • Organizer
      The 57th Annual Meeting of the Association for Computational Linguistics (ACL-2019)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Lattice-Based Transformer Encoder for Neural Machine Translation2019

    • Author(s)
      F Xiao, J Li, H Zhao, R Wang, K Chen
    • Organizer
      The 57th Annual Meeting of the Association for Computational Linguistics (ACL-2019)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] English-Myanmar Supervised and Unsupervised NMT: NICT’s Machine Translation Systems at WAT-20192019

    • Author(s)
      R Wang, H Sun, K Chen, C Ding, M Utiyama, E Sumita
    • Organizer
      The 6th Workshop on Asian Translation (WAT-2019)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Recurrent Positional Embedding for Neural Machine Translation2019

    • Author(s)
      K Chen, R Wang, M Utiyama, E Sumita
    • Organizer
      2019 Conference on Empirical Methods in Natural Language Processing and 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP2019)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] SJTU-NICT at MRP 2019: Multi-Task Learning for End-to-End Uniform Semantic Graph Parsing2019

    • Author(s)
      Z Li, H Zhao, Z Zhang, R Wang, M Utiyama, E Sumita
    • Organizer
      2019 Conference on Natural Language Learning (CoNLL-2019)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Cross-Domain Transfer Learning for Dependency Parsing2019

    • Author(s)
      Z Li, J Zhou, H Zhao, R Wang
    • Organizer
      The CCF International conference on Natural Language Processing and Chinese Computing (NLPCC-2019)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] NICT’s Machine Translation Systems for CCMT-2019 Translation Task2019

    • Author(s)
      K Chen, R Wang, M Utiyama, E Sumita
    • Organizer
      5th China Conference on Machine Translation (CCMT)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] NICT’s Unsupervised Neural and Statistical Machine Translation Systems for the WMT19 News Translation Task2019

    • Author(s)
      B Marie, H Sun, R Wang, K Chen, A Fujita, M Utiyama, E Sumita
    • Organizer
      2019 Fourth Conference on Machine Translation (WMT-2019)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] NICT’s Supervised Neural Machine Translation Systems for the WMT19 News Translation Task2019

    • Author(s)
      R Dabre, K Chen, B Marie, R Wang, A Fujita, M Utiyama, E Sumita
    • Organizer
      2019 Fourth Conference on Machine Translation (WMT-2019)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Syntax-aware Transformer Encoder for Neural Machine Translation2019

    • Author(s)
      S Duan, H Zhao, J Zhou, R Wang
    • Organizer
      2019 International Conference on Asian Language Processing (IALP-2019)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Bilingual Word Embedding: A Survey from Supervised to Unsupervised2019

    • Author(s)
      H Sun, R Wang, K Chen, M Utiyama, E Sumita, T Zhao
    • Organizer
      言語処理学会第26回年次大会(NLP-2019)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research

URL: 

Published: 2019-04-18   Modified: 2021-12-27  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi