• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Development of an open-source speaking evaluation platform with automated scoring

Research Project

Project/Area Number 20K00807
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Review Section Basic Section 02100:Foreign language education-related
Research InstitutionKochi University of Technology

Principal Investigator

Daniels Paul  高知工科大学, 共通教育教室, 教授 (50307245)

Co-Investigator(Kenkyū-buntansha) 熊井 信弘  学習院大学, 付置研究所, 教授 (00248999)
Project Period (FY) 2020-04-01 – 2024-03-31
Project Status Completed (Fiscal Year 2023)
Budget Amount *help
¥2,210,000 (Direct Cost: ¥1,700,000、Indirect Cost: ¥510,000)
Fiscal Year 2022: ¥650,000 (Direct Cost: ¥500,000、Indirect Cost: ¥150,000)
Fiscal Year 2021: ¥650,000 (Direct Cost: ¥500,000、Indirect Cost: ¥150,000)
Fiscal Year 2020: ¥910,000 (Direct Cost: ¥700,000、Indirect Cost: ¥210,000)
Keywordsautomated / speech / assessment / language / learning / speaking / AI / EFL / automated essay scoring / grammar / listening / writing / computer / scoring / feedback / English / Automated / recognition
Outline of Research at the Start

Over the last 6 years, we have been actively developing an online system that automatically scores learners's speech and provides personalized feedback. It is a low-cost solution for Japanese students to practice their English speaking skills for entrance exams and proficiency tests.

Outline of Final Research Achievements

Successful development of an open-source automated speaking assessment platform was achieved. The platform automated the scoring of speaking tasks, allowed the instructor to add custom speaking tasks, and offered learners individualized speaking feedback. Data collected from student use of the system indicated that student’s overall speaking abilities improved. Learners also indicated that the speaking tasks with individualized feedback was helpful. In addition, a positive correlation was observed between the human-generated and computer-generated scores for speaking tasks.

Academic Significance and Societal Importance of the Research Achievements

Through the development of an open-source system with automated scoring of speech, language learners in large classes had more opportunities for extensive speaking practice. In addition, the system proved beneficial for speaking practice for standardized language learning tests.

Report

(5 results)
  • 2023 Annual Research Report   Final Research Report ( PDF )
  • 2022 Research-status Report
  • 2021 Research-status Report
  • 2020 Research-status Report
  • Research Products

    (20 results)

All 2024 2023 2022 2021 2020

All Journal Article (6 results) (of which Int'l Joint Research: 3 results,  Peer Reviewed: 5 results,  Open Access: 5 results) Presentation (14 results) (of which Int'l Joint Research: 6 results,  Invited: 2 results)

  • [Journal Article] Automated Grammar Scoring with AI Chatbots2023

    • Author(s)
      Paul Daniels
    • Journal Title

      TEFL Praxis Journal

      Volume: 2(1) Pages: 59-68

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Moodle上で行うディクテーション用プラグインの開発とその評価2023

    • Author(s)
      Nobuhiro Kumai
    • Journal Title

      言語・文化・社会』学習院大学外国語教育研究センター紀要

      Volume: 22 Pages: 83-101

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Designing an In-house Language Placement Test for Technology Students2022

    • Author(s)
      Paul Daniels and Aya Yamasaki
    • Journal Title

      TEFL Praxis Journal

      Volume: 1 Pages: 43-55

    • Related Report
      2022 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Auto-scoring of Student Speech: Proprietary vs. Open-source Solutions2022

    • Author(s)
      Paul Daniels
    • Journal Title

      TESL-EJ

      Volume: 26 Issue: 3 Pages: 1-14

    • DOI

      10.55593/ej.26103int

    • Related Report
      2022 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] English and Career Planning: A Case for Students in the School of Environmental Science and Engineering2021

    • Author(s)
      Paul Daniels & 渡部 伸一
    • Journal Title

      高知工科大学紀要

      Volume: 18 Issue: 1 Pages: 139-146

    • DOI

      10.32149/00002395

    • NAID

      120007185523

    • URL

      http://hdl.handle.net/10173/00002395

    • Year and Date
      2021-12-28
    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] 英語のリスニング能力を高めるための授業実践 : 音声変化のアウトプットを中心に2021

    • Author(s)
      熊井 信弘
    • Journal Title

      学習院大学外国語教育研究センター紀要 『言語・文化・社会』

      Volume: 19 Pages: 55-68

    • NAID

      120007037871

    • Related Report
      2020 Research-status Report
  • [Presentation] Exploring Beliefs, Attitudes, and Experiences of Generative AI in Education2024

    • Author(s)
      Paul Daniels
    • Organizer
      3rd International TEFL Praxis Conference
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Group presentation evaluation2022

    • Author(s)
      Paul Daniels
    • Organizer
      East Shikoku JALT
    • Related Report
      2022 Research-status Report
  • [Presentation] Moodle presentation feedback database2022

    • Author(s)
      Paul Daniels
    • Organizer
      MoodleMoot Japan
    • Related Report
      2022 Research-status Report
  • [Presentation] A new extensive speaking tool for Moodle2022

    • Author(s)
      Paul Daniels
    • Organizer
      JALTCALL 2022
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] AI and the self-directed language learner2022

    • Author(s)
      Paul Daniels
    • Organizer
      Inaugural research meeting of the TEFL Praxis Association
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] Using automatic speech recognition to develop speaking skills2021

    • Author(s)
      Paul Daniels
    • Organizer
      JACET ESP SIG Kanto
    • Related Report
      2021 Research-status Report
    • Invited
  • [Presentation] Designing computer-scored speaking tasks2021

    • Author(s)
      Paul Daniels
    • Organizer
      JALT 2021 International Conference
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Designing auto-scored speaking tasks in Moodle2021

    • Author(s)
      Paul Daniels
    • Organizer
      JALT CALL 2021 Conference
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Computer-scored speaking activities in Moodle2021

    • Author(s)
      Paul Daniels
    • Organizer
      Moodle Moot Japan 2021
    • Related Report
      2021 Research-status Report
  • [Presentation] Lighten the load - computer-scored assignments in Moodle2020

    • Author(s)
      Paul Daniels
    • Organizer
      46th Annual International Conference on Language Teaching and Learning & Educational Materials Exhibition
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] An open-source speaking practice and testing application2020

    • Author(s)
      Paul Daniels
    • Organizer
      JALTCALL 2020
    • Related Report
      2020 Research-status Report
  • [Presentation] Moodle 1012020

    • Author(s)
      Paul Daniels
    • Organizer
      Japan Association of Language Teaching, East Shikoku Chapter Event
    • Related Report
      2020 Research-status Report
  • [Presentation] A new Moodle quiz question type for speaking practice2020

    • Author(s)
      Paul Daniels
    • Organizer
      Moodle Moot Japan 2020
    • Related Report
      2020 Research-status Report
  • [Presentation] Promoting active learning in the language classroom2020

    • Author(s)
      Paul Daniels
    • Organizer
      The Japan Association for Language Teaching, Matsuyama Chapter
    • Related Report
      2020 Research-status Report
    • Invited

URL: 

Published: 2020-04-28   Modified: 2025-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi