• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Building acceptability rating database that enables authentication of linguists' intuitions

Research Project

Project/Area Number 16K13223
Research Category

Grant-in-Aid for Challenging Exploratory Research

Allocation TypeMulti-year Fund
Research Field Linguistics
Research InstitutionKyorin University

Principal Investigator

Kuroda Kow  杏林大学, 医学部, 准教授 (30425764)

Co-Investigator(Kenkyū-buntansha) 阿部 慶賀  岐阜聖徳学園大学, 教育学部, 准教授 (70467041)
Research Collaborator ASAO Yoshihiko  
KANAMARU Toshiyuki  
KOBAYASHI Yuuichiro  
TAGAWA Takumi  
TSUCHIYA Tomoyuki  
YOKONO Hikaru  
Project Period (FY) 2016-04-01 – 2019-03-31
Project Status Completed (Fiscal Year 2018)
Budget Amount *help
¥3,120,000 (Direct Cost: ¥2,400,000、Indirect Cost: ¥720,000)
Fiscal Year 2018: ¥1,690,000 (Direct Cost: ¥1,300,000、Indirect Cost: ¥390,000)
Fiscal Year 2017: ¥780,000 (Direct Cost: ¥600,000、Indirect Cost: ¥180,000)
Fiscal Year 2016: ¥650,000 (Direct Cost: ¥500,000、Indirect Cost: ¥150,000)
Keywordsacceptability judgment / multivariate analysis / computational modeling / large scale data / evidence-based research / 容認度評定 / 容認性判断 / 容認度評定の認証システム / 確証バイアス / 容認度評定反応データ / 日本語の容認度評定 / 容認度評定データベース構築 / 逸脱文の自動生成 / 実例の見本抽出 / データベースへの要望調査 / 言語学 / 心理学 / 社会学 / 言語処理 / 言語資源開発
Outline of Final Research Achievements

In 2016, we ran a survey of acceptability judgments by professional linguists based on samples taken from textbooks of Japanese linguistics. The results were reported at 23rd Annual Meeting of NLP. In 2017, we developed a script for semi-automated generation of potentially deviant sentences, called Japanese sentence mutators (JSM). We made this public. We then ran a pilot study targeting roughly 300 raters which consists of university students. Used stimuli were 200 and each of the participants rated randomized group of 20 sentences. The results were reported in 24th Annual Meeting of NLP. In 2018, we carried out our main study in two phases. In phase 1, roughly 200 university students participated. In phase 2, roughly 1700 people in general public participated. In both phases, 300 sentences are randomly separated into 10 groups, and each participant rated one of them, consisting of 30 sentences. The results were reported at 25th Annual Meeting of NLP.

Academic Significance and Societal Importance of the Research Achievements

言語学の課題の一つは,普通に使われうる文と使われない文の境界を確定する事である.前者を容認度可能な文と,容認不可能 (か困難) な文と呼ぶ.困った事に,2種類の表現の区別は理論から中立に行なえない.それにより言語学者が自説に都合の良い結果しか見ないという結果が生じる.これは「確証バイアス」の名で知られる.
これを回避するには,理論的立場に影響されない文を十分な数用意し,非専門家がそれらに与える容認度判断を基本反応として収集しておき,理論的利害が関わる事例の容認度評定の際に参照するしかない.日本語容認度評定データ (ARDJ) を,世界で初めてそのような目的をもつ中立データとして構築した.

Report

(4 results)
  • 2018 Annual Research Report   Final Research Report ( PDF )
  • 2017 Research-status Report
  • 2016 Research-status Report
  • Research Products

    (11 results)

All 2019 2018 2017 2016 Other

All Presentation (9 results) (of which Int'l Joint Research: 1 results,  Invited: 1 results) Remarks (2 results)

  • [Presentation] Insights from a large scale web survey for Acceptability Rating Data for Japanese (ARDJ) project2019

    • Author(s)
      Kow Kuroda, Hikaru Yokono, Keiga Abe, Tomoyuki Tsuchiya, Yoshihiko Asao, Yuichiro Kobayashi, Toshiyuki Kanamaru and Takumi Tagawa
    • Organizer
      25th Annual Meeting for Natural Language Processing Society
    • Related Report
      2018 Annual Research Report
  • [Presentation] Rudimentary modeling of acceptability judgement from a large-scale, unbiased data2019

    • Author(s)
      Kow Kuroda, Hikaru Yokono, Keiga Abe, Tomoyuki Tsuchiya, Yoshihiko Asao, Yuichiro Kobayashi, Toshiyuki Kanamaru, and Takumi Tagawa
    • Organizer
      41st Annual Meeting of the Cognitive Science Society
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 意味の社会性を意識した動詞の分類とその理論的含意2018

    • Author(s)
      黒田 航
    • Organizer
      認知科学会第35回大会
    • Related Report
      2018 Annual Research Report
  • [Presentation] Development of Acceptability Rating Data of Japanese (ARDJ): An Initial Report2018

    • Author(s)
      Kow Kuroda, Hikaru Yokono, Keiga Abe, Tomoyuki Tsuchiya, Yoshihiko Asao, Yuichiro Kobayashi, Toshiyuki Kanamaru, and Takumi Tagawa
    • Organizer
      24th Annual Meeting of the Association for Natural Language Processing
    • Related Report
      2018 Annual Research Report
  • [Presentation] Development of Acceptability Rating Data for Japanese (ARDJ): An Initial Report2018

    • Author(s)
      Kow Kuroda, Hikaru Yokono, Keiga Abe, Tomoyuki Tsuchiya, Yoshihiko Asao, Yuichiro Kobayashi, Toshiyuki Kanamaru, and Takumi Tagawa
    • Organizer
      言語処理学会
    • Related Report
      2017 Research-status Report
  • [Presentation] How ordinary people respond to (potentially deviant) sentences is not as simple as linguists thought to be: An initial report on Acceptability Rating Database of Japanese (ARDJ) project2017

    • Author(s)
      Kow Kuroda
    • Organizer
      23rd Joint Workshop of Linguistics and Language Processing
    • Related Report
      2017 Research-status Report
    • Invited
  • [Presentation] 言語学は事例をどう扱っているのか? 見本抽出から明らかになった扱い方の (意外な) 片寄り.2017

    • Author(s)
      黒田 航, 浅尾 仁彦, 金丸 敏幸, 小林 雄一郎, 田川 拓海, 横野 光, 土屋 智行, 阿部 慶賀
    • Organizer
      言語処理学会第23回年次大会
    • Place of Presentation
      筑波大学春日キャンパス
    • Related Report
      2016 Research-status Report
  • [Presentation] 心理学的により現実的な容認度評定のモデルを求めて2016

    • Author(s)
      黒田 航.
    • Organizer
      認知言語学会第17回全国大会
    • Place of Presentation
      明治大学中野キャンパス
    • Related Report
      2016 Research-status Report
  • [Presentation] (言語学者による) 容認度評定の認証システムを試作する構想: 入念に設計された日本語文の容認度評定データベースに基づいて2016

    • Author(s)
      黒田 航, 阿部 慶賀, 横野 光, 田川 拓海, 小林 雄一郎, 金丸 敏幸, 土屋 智行, 浅尾 仁彦
    • Organizer
      日本認知科学会第33回大会
    • Place of Presentation
      北海道大学
    • Related Report
      2016 Research-status Report
  • [Remarks] Overview of Acceptability Rating Data of Japanese

    • URL

      https://kow-k.github.io/Acceptability-Rating-Data-of-Japanese/

    • Related Report
      2018 Annual Research Report
  • [Remarks] Acceptability Rating Data of Japanese (ARDJ)

    • URL

      https://github.com/database-of-japanese-acceptability

    • Related Report
      2016 Research-status Report

URL: 

Published: 2016-04-21   Modified: 2020-03-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi