• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

A Study on Automated Writing/Speech Feedback

Research Project

Project/Area Number 17K13511
Research Category

Grant-in-Aid for Young Scientists (B)

Allocation TypeMulti-year Fund
Research Field Foreign language education
Research InstitutionNihon University

Principal Investigator

KOBAYASHI Yuichiro  日本大学, 生産工学部, 講師 (00725666)

Project Period (FY) 2017-04-01 – 2021-03-31
Project Status Completed (Fiscal Year 2020)
Budget Amount *help
¥3,770,000 (Direct Cost: ¥2,900,000、Indirect Cost: ¥870,000)
Fiscal Year 2020: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Fiscal Year 2019: ¥780,000 (Direct Cost: ¥600,000、Indirect Cost: ¥180,000)
Fiscal Year 2018: ¥650,000 (Direct Cost: ¥500,000、Indirect Cost: ¥150,000)
Fiscal Year 2017: ¥910,000 (Direct Cost: ¥700,000、Indirect Cost: ¥210,000)
Keywords自動採点 / 学習者コーパス / フィードバック / 自動評価 / コーパス / 自然言語処理 / 機械学習
Outline of Final Research Achievements

The purpose of the present study is to assess written/spoken English as a foreign language (EFL) using automated scoring techniques. Automated scoring, in which computer technology evaluates and scores written or spoken content, aims to sort a large body of data, which it assigns to a small number of discrete proficiency levels. Objectively measurable features are used as exploratory variables to predict scores defined as criterion variables. We automatically evaluated the L2 speech of 364 Japanese EFL learners. As a result, the accuracy rate of the random forests model using basic information pertaining to speech was 65.66% and that of the model using lexical and grammatical features was 70.88% in total. In addition, we identified some major linguistic futures that are useful for automated feedback. However, we were not able to conduct the feedback experiment in the classroom setting due to the Covid-19.

Academic Significance and Societal Importance of the Research Achievements

学習者が好きな時間に、好きな場所で繰り返し英語を学習し、フィードバックを受けられるシステムの開発は、社会的に極めて有用である。また、現在のように、感染症対策のためのオンライン授業が多くなっている状況を考えると、自宅学習に活用することができる、自動採点・自動フィードバックを用いた学習コンテンツのニーズは高いと思われる。

Report

(5 results)
  • 2020 Annual Research Report   Final Research Report ( PDF )
  • 2019 Research-status Report
  • 2018 Research-status Report
  • 2017 Research-status Report
  • Research Products

    (40 results)

All 2021 2020 2019 2018 2017

All Journal Article (11 results) (of which Int'l Joint Research: 1 results,  Peer Reviewed: 9 results,  Open Access: 9 results) Presentation (24 results) (of which Int'l Joint Research: 13 results,  Invited: 1 results) Book (5 results)

  • [Journal Article] Rhetorical preferences in L2 writings: A contrastive analysis of metadiscourse markers2020

    • Author(s)
      Yuichiro Kobayashi
    • Journal Title

      Journal of Modern Languages

      Volume: 30(1) Pages: 1-24

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] L2ライティングにおけるメタ談話標識の頻度を用いたL1グループの分類2020

    • Author(s)
      小林雄一郎
    • Journal Title

      Learner Corpus Studies in Asia and the World

      Volume: 5 Pages: 43-48

    • NAID

      120006942789

    • Related Report
      2020 Annual Research Report
    • Open Access
  • [Journal Article] 英語ライティング指導のための自動フィードバックシステムの開発に向けて2019

    • Author(s)
      小林雄一郎・石井雄隆
    • Journal Title

      日本大学生産工学部研究報告B

      Volume: 52 Pages: 7-15

    • NAID

      40021954802

    • Related Report
      2019 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] 生産工学部のクォーターシステム下における英語必修科目運営状況の報告2019

    • Author(s)
      今滝暢子・濱田彰・小林雄一郎・Michel Johnson・Ian Ellsworth・福岡悦子・羽田美也子・Christopher Hewitt・石部千紗・石塚操・木下ひろみ・小暮正人・Kevin Miller・大木富・Jacob Schere・嶋田和子・矢部直己
    • Journal Title

      日本大学生産工学部研究報告B

      Volume: 52 Pages: 1-6

    • NAID

      40021954793

    • Related Report
      2019 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Recurrent multiword combinations in L1 and L2 argumentative essays2018

    • Author(s)
      Masumi Narita, Yuichiro Kobayashi & Mariko Abe
    • Journal Title

      Asian EFL Journal

      Volume: 20(1) Pages: 250-275

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] 英語初級者向け教育用例文コーパスSCoREの英文難易度評価2018

    • Author(s)
      中條清美・濱田彰・小林雄一郎・Michelle Johnson
    • Journal Title

      日本大学生産工学部研究報告B

      Volume: 51 Pages: 27-36

    • NAID

      40021612740

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] 教育用例文コーパスSCoRE第4次開発2018

    • Author(s)
      中條清美・濱田彰・若松弘子・小林雄一郎・横田賢司・内山将夫・赤瀬川史朗・Michelle Johnson・西垣知佳子
    • Journal Title

      日本大学生産工学部研究報告B

      Volume: 51 Pages: 1-12

    • NAID

      40021612717

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] ライティングの自動採点で語順はどのように扱われるか2018

    • Author(s)
      小林雄一郎
    • Journal Title

      英語教育

      Volume: 67(2) Pages: 32-32

    • Related Report
      2018 Research-status Report
  • [Journal Article] Developmental patterns of metadiscourse in second language writing2017

    • Author(s)
      Yuichiro Kobayashi
    • Journal Title

      Journal of Pan-Pacific Association of Applied Linguistics

      Volume: 21(2) Pages: 41-54

    • Related Report
      2017 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Investigating the chronological variation of popular song lyrics through lexical indices2017

    • Author(s)
      Yuichiro Kobayashi, Misaki Amagasa, & Takafumi Suzuki
    • Journal Title

      Journal of the Japanese Association for Digital Humanities

      Volume: 2 Pages: 90-107

    • Related Report
      2017 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] 中古における接続表現の統計的分析―指示詞を構成要素とするものを中心に2017

    • Author(s)
      小林雄一郎・岡﨑友子
    • Journal Title

      国立国語研究所論集

      Volume: 13 Pages: 65-77

    • NAID

      120006319940

    • Related Report
      2017 Research-status Report
    • Peer Reviewed / Open Access
  • [Presentation] スピーキングコーパスを用いた英語学習者の発達指標の特定2021

    • Author(s)
      阿部真理子・小林雄一郎・近藤悠介・藤原康弘
    • Organizer
      英語コーパス学会語彙SIG 2020年度研究会
    • Related Report
      2020 Annual Research Report
  • [Presentation] A longitudinal study of novice learners’ development of complexity2020

    • Author(s)
      Mariko Abe, Yusuke Kondo, Yasuhiro Fujiwara, & Yuichiro Kobayashi
    • Organizer
      Teaching and Learning Corpora 2020
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Simulating acceptability judgments using ARDJ data2020

    • Author(s)
      黒田航・横野光・阿部慶賀・土屋智行・浅尾仁彦・小林雄一郎・金丸敏幸・田川拓海
    • Organizer
      言語処理学会第27回年次大会
    • Related Report
      2020 Annual Research Report
  • [Presentation] 大学生を対象とする英語スピーキングテストの回答音声に基づくコーパス構築2020

    • Author(s)
      神澤克徳・小林雄一郎・田中悠介
    • Organizer
      英語コーパス学会第46回大会
    • Related Report
      2020 Annual Research Report
  • [Presentation] L2ライティングにおけるL1の影響ーメタ談話の観点から2020

    • Author(s)
      小林雄一郎
    • Organizer
      Learner Corpus Studies in Asia and the World (LCSAW) 2020
    • Related Report
      2020 Annual Research Report
  • [Presentation] Rhetorical preferences in L2 writings: A contrastive analysis of metadiscourse markers2019

    • Author(s)
      Yuichiro Kobayashi
    • Organizer
      Language in Focus 2019
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Rudimentary modeling of acceptability judgement from a large scale, unbiased data2019

    • Author(s)
      Kow Kuroda, Hikaru Yokono, Keiga Abe, Tomoyuki Tsuchida, Yoshihiko Asao, Yuichiro Kobayashi, & Toshiyuki Kanamaru
    • Organizer
      Rudimentary modeling of acceptability judgement from a large scale, unbiased data
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] A longitudinal study of L2 spoken English: Development of fluency and pronunciation2019

    • Author(s)
      Mariko Abe, Yusuke Kondo, Yuichiro Kobayashi, Akira Murakami & Yasuhiro Fujiwara
    • Organizer
      Learner Corpus Research 2019
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] 容認度評定に影響する要因の定量的評価ー日本語容認度評定データ (ARDJ) から得られた知見2019

    • Author(s)
      黒田航・阿部慶賀・横野光・土屋智行・小林雄一郎・浅尾仁彦・金丸敏幸・田川拓海
    • Organizer
      日本認知科学会
    • Related Report
      2019 Research-status Report
  • [Presentation] Rによる成績データ分析入門2019

    • Author(s)
      小林雄一郎
    • Organizer
      日本言語テスト学会 (JTLA) 研究例会
    • Related Report
      2019 Research-status Report
  • [Presentation] Second language discourse in Asian Englishes: A corpus-based approach2019

    • Author(s)
      Yuichiro Kobayashi
    • Organizer
      CamTESOL 2019
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Insights from a large scale web survey for Acceptability Rating Data for Japanese (ARDJ) project.2019

    • Author(s)
      黒田航・横野光・阿部慶賀・土屋智行・浅尾仁彦・小林雄一郎・金丸敏幸・田川拓海
    • Organizer
      言語処理学会
    • Related Report
      2018 Research-status Report
  • [Presentation] Predicting EFL learners’ oral proficiency levels in monologue tasks.2018

    • Author(s)
      Yuichiro Kobayashi, Yusuke Kondo & Mariko Abe
    • Organizer
      Asia Pacific Corpus Linguistics Conference 2018
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Constructing a longitudinal learner corpus.2018

    • Author(s)
      Mariko Abe, Yusuke Kondo & Yuichiro Kobayashi
    • Organizer
      The 12th International Free Linguistics Conference
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Initial findings from a longitudinal learner corpus: A year-long development of L2 speaking performance.2018

    • Author(s)
      Mariko Abe, Yusuke Kondo, Yuichiro Kobayashi, Akira Murakami & Yasuhiro Fujiwara
    • Organizer
      Teaching and Learning Corpora 2018
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Evaluating the appropriateness of the sentence corpus of remedial English to benefit beginner level EFL students.2018

    • Author(s)
      Kiyomi Chujo, Atsushi Mizumoto, Yuichiro Kobayashi, Akira Hamada & Kathryn Oghigian
    • Organizer
      Teaching and Learning Corpora 2018
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] The relationship between word error rate in automatic speech recognition and proficiency of L2 speech.2018

    • Author(s)
      Yusuke Kondo, Mariko Abe, Yutaka Ishii, & Yuichiro Kobayashi
    • Organizer
      PAAL 2018
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] データ駆動型文法学習を促進する英語例文の特徴―学習者による主観的評価のモデリングから2018

    • Author(s)
      濱田彰・小林雄一郎
    • Organizer
      英語コーパス学会DDL SIGシンポジウム 2018
    • Related Report
      2018 Research-status Report
  • [Presentation] 計量文献学の技法を用いた歌詞の通時的分析2018

    • Author(s)
      小林雄一郎
    • Organizer
      テキストマイニング2018
    • Related Report
      2018 Research-status Report
    • Invited
  • [Presentation] データ駆動型学習用コーパスSCoREを構成する英文の評価―英文難易度、教育用語句のカバー率、および意味分野別カバー率の分布から2018

    • Author(s)
      中條清美・濱田彰・小林雄一郎
    • Organizer
      日本英語教育学会・日本教育言語学会第48回年次研究集会
    • Related Report
      2017 Research-status Report
  • [Presentation] Development of acceptability rating data for Japanese (ARDJ): An initial report2018

    • Author(s)
      黒田航・横野光・阿部慶賀・土屋智行・浅尾仁彦・ 小林雄一郎・金丸敏幸・田川拓海
    • Organizer
      言語処理学会第24回年次大会
    • Related Report
      2017 Research-status Report
  • [Presentation] Developmental patterns of metadiscourse in second language writing2017

    • Author(s)
      Yuichiro Kobayashi
    • Organizer
      Corpus Linguistics 2017
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Automated speech scoring: A text classification approach2017

    • Author(s)
      Yuichiro Kobayashi
    • Organizer
      Conference of the International Federation of Classification Societies 2017
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Tracking L2 language development through construction of a longitudinal spoken learner corpus2017

    • Author(s)
      Mariko Abe, Yasuhiro Fujiwara & Yuichiro Kobayashi
    • Organizer
      Learner Corpus Research 2017
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Book] Rによる教育データ分析入門2020

    • Author(s)
      小林雄一郎、濱田彰、水本篤
    • Total Pages
      242
    • Publisher
      オーム社
    • ISBN
      9784274225918
    • Related Report
      2020 Annual Research Report
  • [Book] 英語教育における自動採点2020

    • Author(s)
      石井雄隆、近藤悠介、小林雄一郎、他
    • Total Pages
      164
    • Publisher
      ひつじ書房
    • ISBN
      9784823410604
    • Related Report
      2020 Annual Research Report
  • [Book] ことばのデータサイエンス2019

    • Author(s)
      小林雄一郎
    • Total Pages
      180
    • Publisher
      朝倉書店
    • ISBN
      9784254510638
    • Related Report
      2019 Research-status Report
  • [Book] 文化情報学事典2019

    • Author(s)
      村上征勝、小林雄一郎他
    • Total Pages
      850
    • Publisher
      勉誠出版
    • ISBN
      9784585200710
    • Related Report
      2019 Research-status Report
  • [Book] Rによるやさしいテキストマイニングー活用事例編2018

    • Author(s)
      小林雄一郎
    • Total Pages
      213
    • Publisher
      オーム社
    • ISBN
      9784274222771
    • Related Report
      2018 Research-status Report

URL: 

Published: 2017-04-28   Modified: 2022-01-27  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi