• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Development of Japanese CCG parser "lightblue"

Research Project

Project/Area Number 18H03284
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Review Section Basic Section 61030:Intelligent informatics-related
Research InstitutionOchanomizu University

Principal Investigator

Bekki Daisuke  お茶の水女子大学, 基幹研究院, 教授 (90431783)

Project Period (FY) 2018-04-01 – 2022-03-31
Project Status Completed (Fiscal Year 2022)
Budget Amount *help
¥17,160,000 (Direct Cost: ¥13,200,000、Indirect Cost: ¥3,960,000)
Fiscal Year 2021: ¥4,290,000 (Direct Cost: ¥3,300,000、Indirect Cost: ¥990,000)
Fiscal Year 2020: ¥4,290,000 (Direct Cost: ¥3,300,000、Indirect Cost: ¥990,000)
Fiscal Year 2019: ¥3,900,000 (Direct Cost: ¥3,000,000、Indirect Cost: ¥900,000)
Fiscal Year 2018: ¥4,680,000 (Direct Cost: ¥3,600,000、Indirect Cost: ¥1,080,000)
Keywords計算言語学 / 組合せ範疇文法 / 統語解析 / 深層ニューラルネットワーク / 統語解析器 / 形式意味論 / 深層学習 / 依存型理論 / 含意関係認識
Outline of Final Research Achievements

The aim of this research was to develop a CCG syntactic parser based on a hybrid method of theoretical linguistics and deep neural networks. We successfully formulated and implemented RNN-CCG, a system that converts the grammatical theory of RNNG from CFG to CCG. We also studied automatic theorem prover with Dependent-Type Semantics (DTS) and successfully implemented a proof search algorithm by Haskell. In parallel, we also conducted research to evaluate the performance of natural language inference tasks with large-scale language models and showed their limitations, and empirical research in theoretical linguistics using dependent tye semantics, such as comparative constructions, Weak Crossover and the Proviso problem.

Academic Significance and Societal Importance of the Research Achievements

本研究では、理論言語学と機械学習を融合させた深い意味解析を行う手法や、自然言語理解の自動化を可能にするCCGパーザと依存型意味論(DTS)の研究など、自然言語処理における重要な課題に取り組んできました。これらの研究成果は、査読付き国際学会や国内学会の発表を通じて学術的に評価され、また企業向けのセミナーやメディア掲載などを通じて社会に還元されました。今後、自然言語処理のさらなる進展に向けて、理論言語学と深層学習のハイブリッドアプローチを進めることが求められます。

Report

(5 results)
  • 2022 Final Research Report ( PDF )
  • 2021 Annual Research Report
  • 2020 Annual Research Report
  • 2019 Annual Research Report
  • 2018 Annual Research Report
  • Research Products

    (50 results)

All 2023 2022 2021 2020 2019

All Journal Article (19 results) (of which Int'l Joint Research: 4 results,  Open Access: 13 results,  Peer Reviewed: 14 results) Presentation (28 results) (of which Int'l Joint Research: 9 results,  Invited: 13 results) Funded Workshop (3 results)

  • [Journal Article] Implementing Natural Language Inference for Comparatives2023

    • Author(s)
      Izumi Haruta, Koji Mineshima, Daisuke Bekki
    • Journal Title

      Journal of Language Modelling

      Volume: 10 Issue: 1 Pages: 139-191

    • DOI

      10.15398/jlm.v10i1.294

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Recurrent Neural Network CCG 構文解析器の実装2023

    • Author(s)
      田上青空,戸次大介
    • Journal Title

      言語処理学会第29回年次大会論文集

      Volume: ANLP2023

    • Related Report
      2021 Annual Research Report
    • Open Access
  • [Journal Article] Towards Recognizing Textual Entailment of Numerical Expressions in Real Text2021

    • Author(s)
      小谷野 華那、鈴木 莉子、春田 和泉、谷中 瞳、戸次 大介
    • Journal Title

      Proceedings of the Annual Conference of JSAI

      Volume: JSAI2021 Issue: 0 Pages: 4J2GS6e02-4J2GS6e02

    • DOI

      10.11517/pjsai.JSAI2021.0_4J2GS6e02

    • NAID

      130008051915

    • Related Report
      2021 Annual Research Report
    • Open Access
  • [Journal Article] Towards Multiword Expression Analysis for Logic-based Medical Case Retrieval2021

    • Author(s)
      石田 真捺、谷中 瞳、馬目 華奈、戸次 大介
    • Journal Title

      Proceedings of the Annual Conference of JSAI

      Volume: JSAI2021 Issue: 0 Pages: 4J3GS6f05-4J3GS6f05

    • DOI

      10.11517/pjsai.JSAI2021.0_4J3GS6f05

    • NAID

      130008052025

    • Related Report
      2021 Annual Research Report
    • Open Access
  • [Journal Article] Building development environment of Japanese CCG parser using Yesod2021

    • Author(s)
      石嶋 美咲、戸次 大介
    • Journal Title

      Proceedings of the Annual Conference of JSAI

      Volume: JSAI2021 Issue: 0 Pages: 4J1GS6d01-4J1GS6d01

    • DOI

      10.11517/pjsai.JSAI2021.0_4J1GS6d01

    • NAID

      130008051930

    • Related Report
      2021 Annual Research Report
    • Open Access
  • [Journal Article] Knowledge Distillation of Japanese Morphological Analyzer2021

    • Author(s)
      田上 青空、戸次 大介
    • Journal Title

      Proceedings of the Annual Conference of JSAI

      Volume: JSAI2021 Issue: 0 Pages: 4J1GS6d02-4J1GS6d02

    • DOI

      10.11517/pjsai.JSAI2021.0_4J1GS6d02

    • NAID

      130008051929

    • Related Report
      2021 Annual Research Report
    • Open Access
  • [Journal Article] A Proof-theoretic Analysis of Weak Crossover2021

    • Author(s)
      Bekki, Daisuke
    • Journal Title

      Proceedings of the 18th International Workshop on Logic and Engineering of Natural Language Semantics (LENLS18)

      Volume: LENLS18 Pages: 75-88

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed
  • [Journal Article] The proviso problem from a proof-theoretic perspective2021

    • Author(s)
      Yana, Yukiko; Mineshima, Koji; Bekki, Daisuke
    • Journal Title

      Proceedings of Logical Aspects of Computational Linguistics (LACL) 2021

      Volume: LACL2021 Pages: 159-176

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed
  • [Journal Article] The proviso problem from a proof-theoretic perspective2021

    • Author(s)
      Yukiko Yana, Koji Mineshima, Daisuke Bekki
    • Journal Title

      Logical Aspects of Computational Linguistics (LACL) 2021

      Volume: X Pages: 159-176

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed
  • [Journal Article] A Proof-theoretic Analysis of Weak Crossover2021

    • Author(s)
      Daisuke Bekki
    • Journal Title

      the 18th International Workshop on Logic and Engineering of Natural Language Semantics (LENLS18)

      Volume: X Pages: 75-88

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Combining Event Semantics and Degree Semantics for Natural Language Inference2020

    • Author(s)
      Haruta,Izumi; Mineshima,Koji; Bekki,Daisuke;
    • Journal Title

      Proceedings of the COLING2020 (short paper), Barcelona, Spain (Online)

      Volume: 28 Pages: 1758-1764

    • DOI

      10.18653/v1/2020.coling-main.156

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Logical Inferences with Comparatives and Generalized Quantifiers2020

    • Author(s)
      Haruta,Izumi; Mineshima,Koji; Bekki,Daisuke;
    • Journal Title

      Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics Student Research Workshp (ACL2020-SRW), Seattle, USA.

      Volume: 58 Pages: 263-270

    • DOI

      10.18653/v1/2020.acl-srw.35

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Logical Inferences with Comparatives and Generalized Quantifiers2020

    • Author(s)
      Haruta, Izumi; Mineshima, Koji; Bekki, Daisuke;
    • Journal Title

      Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics Student Research Workshp (ACL2020-SRW)

      Volume: -

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Variable Handling and Compositionality: Comparing DRT and DTS2019

    • Author(s)
      Yana Yukiko、Mineshima Koji、Bekki Daisuke
    • Journal Title

      Journal of Logic, Language and Information

      Volume: 28 Issue: 2 Pages: 261-285

    • DOI

      10.1007/s10849-019-09294-3

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] A CCG-based Compositional Semantics and Inference System for Comparatives2019

    • Author(s)
      Haruta, Izumi; Mineshima, Koji; Bekki, Daisuke;
    • Journal Title

      Proceedings of the 33rd Pacific Asia Conference on Language, Information and Computation (PACLIC33)

      Volume: - Pages: 67-76

    • NAID

      120006772920

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Can Neural Networks Understand Monotonicity Reasoning?2019

    • Author(s)
      Yanaka Hitomi、Mineshima Koji、Bekki Daisuke、Inui Kentaro、Sekine Satoshi、Abzianidze Lasha、Bos Johan
    • Journal Title

      Proceedings of the 2019 ACL Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP

      Volume: 2019 Pages: 31-40

    • DOI

      10.18653/v1/w19-4804

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] HELP: A Dataset for Identifying Shortcomings of Neural Models in Monotonicity Reasoning2019

    • Author(s)
      Yanaka Hitomi、Mineshima Koji、Bekki Daisuke、Inui Kentaro、Sekine Satoshi、Abzianidze Lasha、Bos Johan
    • Journal Title

      Proceedings of the Eighth Joint Conference on Lexical and Computational Semantics (*SEM 2019)

      Volume: 2019 Pages: 250-255

    • DOI

      10.18653/v1/s19-1027

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Underspecification and interpretive parallelism in Dependent Type Semantics2019

    • Author(s)
      Kubota Yusuke、Mineshima Koji、Levine Robert、Bekki Daisuke
    • Journal Title

      Proceedings of the IWCS 2019 Workshop on Computing Semantics with Types, Frames and Related Structures

      Volume: 2019 Pages: 1-9

    • DOI

      10.18653/v1/w19-1001

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Questions in Dependent Type Semantics2019

    • Author(s)
      Watanabe Kazuki、Mineshima Koji、Bekki Daisuke
    • Journal Title

      Proceedings of the Sixth Workshop on Natural Language and Computer Science

      Volume: 2019 Pages: 23-33

    • DOI

      10.18653/v1/w19-1103

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access
  • [Presentation] 組合せ範疇文法(CCG)入門2023

    • Author(s)
      戸次大介
    • Organizer
      言語学フェス2023, 2023/1/28
    • Related Report
      2021 Annual Research Report
  • [Presentation] 言語理論の証明論的転回2022

    • Author(s)
      戸次大介
    • Organizer
      言語学フェス2022, 2022/1/29
    • Related Report
      2021 Annual Research Report
  • [Presentation] A Proof-theoretic Analysis of Weak Crossover2022

    • Author(s)
      Bekki, Daisuke
    • Organizer
      the 2nd workshop on Language Faculty Science, online, February 12
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Dependent Types and Dynamics of Natural Language2022

    • Author(s)
      Bekki, Daisuke
    • Organizer
      the International Workshop on Type-Theoretical Semantics (IWoTTS), online, June 25
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] 依存型と自然言語のダイナミクス2022

    • Author(s)
      戸次大介
    • Organizer
      みちのく情報伝達学セミナー(Mics),東北大学,2022/07/27
    • Related Report
      2021 Annual Research Report
    • Invited
  • [Presentation] An introduction to Combinatory Categorial Grammar2022

    • Author(s)
      Daisuke, Bekki
    • Organizer
      A talk in IUT de bordeaux, 2022/12/13
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] A Proof-theoretic Analysis of Weak Crossover2022

    • Author(s)
      Daisuke Bekki
    • Organizer
      the 2nd workshop on Language Faculty Science (2022/2/12)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] 言語理論の証明論的転回2022

    • Author(s)
      戸次大介
    • Organizer
      言語学フェス2022 (2022/1/29)
    • Related Report
      2020 Annual Research Report
  • [Presentation] 理論言語学と深層学習のハイブリッドアプローチによる自然言語推論2021

    • Author(s)
      戸次大介
    • Organizer
      半導体エネルギー研究所, 2021/5/19
    • Related Report
      2021 Annual Research Report
    • Invited
  • [Presentation] 日本語形態素解析器の知識蒸留2021

    • Author(s)
      田上青空,戸次大介
    • Organizer
      第34回人工知能学会全国大会
    • Related Report
      2020 Annual Research Report
  • [Presentation] Yesodによる日本語CCGパーザ開発環境の構築2021

    • Author(s)
      石嶋美咲,戸次大介
    • Organizer
      第34回人工知能学会全国大会
    • Related Report
      2020 Annual Research Report
  • [Presentation] 実テキストにおける数量表現の含意関係認識に向けて2021

    • Author(s)
      小谷野華那,鈴木莉子,春田和泉,谷中瞳,戸次大介
    • Organizer
      第34回人工知能学会全国大会
    • Related Report
      2020 Annual Research Report
  • [Presentation] 理論言語学と深層学習のハイブリッドアプローチによる自然言語推論2021

    • Author(s)
      戸次大介
    • Organizer
      半導体エネルギー研究所 (2021/5/19)
    • Related Report
      2020 Annual Research Report
    • Invited
  • [Presentation] DTSの部分体系のための定理自動証明器の実装に向けて2021

    • Author(s)
      大洞日音, 戸次大介
    • Organizer
      言語処理学会第27回年次大会, 北九州国際会議場/オンライン, 2021/3/15-19.
    • Related Report
      2019 Annual Research Report
  • [Presentation] Why parsing is a part of Language Faculty Science2020

    • Author(s)
      Bekki,Daisuke
    • Organizer
      The 2020 Zoom Workshop on Language Faculty Science: Linguistic Intuitions and Replication, 2020/12/20
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] A hybrid approach toward Natural Language Understanding2020

    • Author(s)
      Bekki,Daisuke
    • Organizer
      Centre for Linguistic Theory and Studies in Probability (CLASP), 2020/12/09
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Development of an automated theorem prover for the fragment of DTS2020

    • Author(s)
      Daido,Hinari; Bekki,Daisuke;
    • Organizer
      the 17th International Workshop on Logic and Engineering of Natural Language Semantics (LENLS17).
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] CCGと自動定理証明による比較表現の計算意味論2020

    • Author(s)
      春田和泉, 峯島宏次, 戸次大介
    • Organizer
      人工知能学会第34回年次大会, オンライン開催, 2020/6/9-12.
    • Related Report
      2019 Annual Research Report
  • [Presentation] ニューラルネットは自然言語推論の体系性を学習するか2020

    • Author(s)
      谷中瞳, 峯島宏次, 戸次大介, 乾健太郎
    • Organizer
      言語処理学会第26回年次大会
    • Related Report
      2018 Annual Research Report
  • [Presentation] 汎用言語モデルBERTを用いた多言語テキストにおける意味現象タグ予測2020

    • Author(s)
      伊藤美賀, 佐藤七海, 田上青空, 谷中瞳, 峯島宏次, 戸次大介
    • Organizer
      言語処理学会第26回年次大会
    • Related Report
      2018 Annual Research Report
  • [Presentation] CCGとCoqを用いた日本語マルチモーダル推論システムの構築2020

    • Author(s)
      秋山雛乃, 石嶋美咲, 石田真捺, 高野紗輝, 鈴木莉子, 谷中瞳, 峯島宏次, 戸次大介
    • Organizer
      言語処理学会第26回年次大会
    • Related Report
      2018 Annual Research Report
  • [Presentation] マルチモーダル推論評価のための日本語データセットの試案2020

    • Author(s)
      飯野早貴, 石田真捺, 小谷野華那, 松本留奈, 鈴木莉子, 谷中瞳, 峯島宏次, 戸次大介
    • Organizer
      言語処理学会第26回年次大会
    • Related Report
      2018 Annual Research Report
  • [Presentation] クラウドソーシングによる単調推論データセットの構築2019

    • Author(s)
      谷中瞳, 戸次大介, 峯島宏次, 関根聡, 乾健太郎
    • Organizer
      第33回人工知能学会全国大会
    • Related Report
      2018 Annual Research Report
  • [Presentation] テキスト情報と画像情報を組み合わせた論理推論システムの構築2019

    • Author(s)
      鈴木莉子, 吉川将司, 谷中瞳, 峯島宏次, 戸次大介
    • Organizer
      第33回人工知能学会全国大会
    • Related Report
      2018 Annual Research Report
  • [Presentation] Dependent Types and Theory of Meaning2019

    • Author(s)
      Bekki, Daisuke
    • Organizer
      Nanzan Workshop on the Foundational Issues in Linguistics and Philosophy of Language
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] 理論言語学に基づく自然言語理解の最前線2019

    • Author(s)
      戸次大介
    • Organizer
      日本英語学会第37回大会
    • Related Report
      2018 Annual Research Report
    • Invited
  • [Presentation] Hybrid natural language understanding: neural network, logic and beyond2019

    • Author(s)
      Bekki, Daisuke; Yanaka, Hitomi
    • Organizer
      Konferenz zur Verarbeitung naturlicher Sprache (KONVENS2019)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] 自然言語理解技術の動向2019

    • Author(s)
      戸次大介
    • Organizer
      NEDO TSC Foresightセミナー(第1回)
    • Related Report
      2018 Annual Research Report
    • Invited
  • [Funded Workshop] Logic and Engeneering of Natural Language Semantics 19 (LENLS19)2022

    • Related Report
      2021 Annual Research Report
  • [Funded Workshop] Logic and Engeneering of Natural Language Semantics (LENLS18)2021

    • Related Report
      2020 Annual Research Report
  • [Funded Workshop] Logic and Engeneering of Natural Language Semantics (LENLS17)2020

    • Related Report
      2019 Annual Research Report

URL: 

Published: 2018-04-23   Modified: 2024-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi