• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Open-source English ability test with automatic grading of speaking and writing

Research Project

Project/Area Number 19K00829
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Review Section Basic Section 02100:Foreign language education-related
Research InstitutionKochi University of Technology

Principal Investigator

Bateson Gordon  高知工科大学, 共通教育教室, 教授 (00340018)

Project Period (FY) 2019-04-01 – 2025-03-31
Project Status Granted (Fiscal Year 2023)
Budget Amount *help
¥1,690,000 (Direct Cost: ¥1,300,000、Indirect Cost: ¥390,000)
Fiscal Year 2021: ¥390,000 (Direct Cost: ¥300,000、Indirect Cost: ¥90,000)
Fiscal Year 2020: ¥390,000 (Direct Cost: ¥300,000、Indirect Cost: ¥90,000)
Fiscal Year 2019: ¥910,000 (Direct Cost: ¥700,000、Indirect Cost: ¥210,000)
Keywordsfour-skills / online test / essay auto-grade / speak auto-grade / open-source / AI-generated questions / four-skills online test / e-learning / Moodle / 4-skills test
Outline of Research at the Start

A new open-source online English test will be developed that features the automatic grading of not only reading and listening, but also speaking and writing. This four-skills test will allow the general English ability of large numbers of students to be checked quickly online, thus making it suitable for use in entrance exams and placements tests.

Outline of Annual Research Achievements

In 2023, I developed software to generate quiz questions automatically using AI tools. The motivation for this project was to speed up the generation of questions for the 4-skills test. This software allows the teacher to build prompts for ChatGPT that are composed of three distinct parts: definition of roles, definition of task, and definition of output format. Once the prompt produces suitable questions consistently and reliably, the importing of questions into Moodle can be set to proceed automatically. I presented this software at the MoodleMoot 2024 conference (Nagasaki, Japan) and the TEFL-Praxis 2024 (Kochi, Japan).

Current Status of Research Progress
Current Status of Research Progress

3: Progress in research has been slightly delayed.

Reason

Although the project is not proceeding as quickly as was originally envisioned, I am in a position now where I can generate questions and build a 4-skills test before the end of the project.

The main reason for the delay is the recent re-design of the Englsh curriculum and consequent increased teaching load at my university. In addition, the continuing development of AI tools has led to me spending time on investigating those, and researching how they could be used beneficially in the correct project.

Unfortunately, this year was again marred by the death of an immediate family member. This significantly impaired my ability to carry out research tasks during the latter part of 2023.

Strategy for Future Research Activity

(1) I will collect data on AI-generated questions to determine which are judged to be suitable for testing and which are not.

(2) I will build the preliminary versions of the 4-skills test and collect data comparing students' performance on the test with external data such as TOEIC scores and course grades.

(3) I will present the findings of steps (1) and (2) at conferences in February and March of 2025.

Report

(5 results)
  • 2023 Research-status Report
  • 2022 Research-status Report
  • 2021 Research-status Report
  • 2020 Research-status Report
  • 2019 Research-status Report
  • Research Products

    (9 results)

All 2024 2023 2022 2021 2019 Other

All Journal Article (1 results) (of which Int'l Joint Research: 1 results,  Peer Reviewed: 1 results,  Open Access: 1 results) Presentation (7 results) (of which Int'l Joint Research: 4 results,  Invited: 3 results) Remarks (1 results)

  • [Journal Article] Enhancing Course Page Usability on a Standard Moodle Site Using Generic JavaScript and Bootstrap CSS2022

    • Author(s)
      Gordon BATESON
    • Journal Title

      TEFL Praxis Journal

      Volume: Vol. 1 Pages: 56-64

    • Related Report
      2022 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Presentation] Creating quiz question banks with ChatGPT2024

    • Author(s)
      Gordon BATESON
    • Organizer
      MoodleMoot 2024
    • Related Report
      2023 Research-status Report
  • [Presentation] Using AI tools to generate quiz questions for an LMS2024

    • Author(s)
      Gordon BATESON
    • Organizer
      3rd International TEFL-Praxis Conference
    • Related Report
      2023 Research-status Report
  • [Presentation] Comparison of the automatic grading of student writing: Deepl, ChatGPT Essay (auto-grade)2023

    • Author(s)
      Gordon BATESON
    • Organizer
      2nd International TEFL-Praxis Conference
    • Related Report
      2022 Research-status Report
  • [Presentation] Testing 4-skills online: What is possible?2021

    • Author(s)
      Gordon BATESON
    • Organizer
      GLoCALL 2021
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] Creating a 4-skills online assessment tool using the Moodle LMS2021

    • Author(s)
      Gordon BATESON
    • Organizer
      GLoCALL 2021
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] Grading writing automatically2019

    • Author(s)
      Gordon Bateson
    • Organizer
      GLoCALL 2019 (Danang, Vietnam)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Developing an online test to measure writing and speaking skills automatically2019

    • Author(s)
      Gordon Bateson
    • Organizer
      ETLTC 2020 (Aizu, Japan)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research / Invited
  • [Remarks] The Vocabulary activity plugin for Moodle

    • URL

      https://github.com/gbateson/moodle-mod_vocab

    • Related Report
      2023 Research-status Report

URL: 

Published: 2019-04-18   Modified: 2024-12-25  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi