• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Measuring the extent speech-to-text functionality aids speaking fluency (breakdown & speed-fluency) in EFL learners using a mobile assisted language learning app

Research Project

Project/Area Number 19K00803
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Review Section Basic Section 02100:Foreign language education-related
Research InstitutionTeikyo University (2021-2023)
Tokai University (2019-2020)

Principal Investigator

Robert Cvitkovic  帝京大学, 外国語学部, 准教授 (00412627)

Co-Investigator(Kenkyū-buntansha) ボビー ヒロユキ  九州産業大学, 語学教育研究センター, 准教授 (20536247)
Project Period (FY) 2019-04-01 – 2025-03-31
Project Status Granted (Fiscal Year 2023)
Budget Amount *help
¥4,550,000 (Direct Cost: ¥3,500,000、Indirect Cost: ¥1,050,000)
Fiscal Year 2022: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2021: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2020: ¥780,000 (Direct Cost: ¥600,000、Indirect Cost: ¥180,000)
Fiscal Year 2019: ¥1,690,000 (Direct Cost: ¥1,300,000、Indirect Cost: ¥390,000)
Keywordsspeaking fluency / elicited imitation / AI language assessment / educational technology / comprehensibility / speed fluency / breakdown fluency / shadowing / STT / MALL / speech to text / TEL
Outline of Research at the Start

We will quantify the effect of short to moderate duration usage of Speech recognition technology on speaking characteristics of Japanese EFL learners. This will be carried out on mobile phones in a customized English learning app.

This research will help further our understanding of the effects of advanced mobile features such as Speech-to-Text, Voice-recognition embedded in highly interactive English learning activities by quantifying their effects. This will aid in the design of more effective mobile English learning tasks for EFL learners.

Outline of Annual Research Achievements

Our research this year has focused on integrating AI-driven analysis with traditional human evaluations to assess ESL learners' pronunciation and fluency. By using RASCH analysis on elicited imitation data, we aimed to identify differences and similarities between AI evaluators and human raters, potentially reshaping language assessment methods for enhanced consistency and scalability.
At the 2023 JALT National Conference, we highlighted the importance of comprehensibility and speaking evaluation in ESL education and demonstrated various data collection techniques for classroom application. We discussed both perception-based assessments and phonetic transcription, utilizing tools like the IPA to enhance pronunciation accuracy and integrate these methods into teaching practices effectively.
Additionally, our TnT Conference workshop focused on computer-based analysis for speaking fluency evaluation, showing how technology can offer better evaluation tools. This integration can significantly boost the efficiency of speaking training.
At the PanSIG Conference, we revisited elicited imitation techniques, which have been overshadowed by newer technologies but were preferred by students over traditional conversation practices according to our survey. This method improves pronunciation and fluency, suggesting a need to revitalize such techniques in modern ESL classrooms.

These studies collectively advocate for a blend of technology and traditional methods in ESL education, highlighting the need for adaptive teaching strategies to meet learners' evolving needs.

Current Status of Research Progress
Current Status of Research Progress

2: Research has progressed on the whole more than it was originally planned.

Reason

This year, our research has successfully integrated AI-driven analysis with traditional human evaluations to assess ESL learners' pronunciation and fluency. Using RASCH analysis on elicited imitation data, we've identified key differences and similarities between AI evaluators and human raters, which has helped to refine and potentially reshape language assessment methods towards enhanced consistency and scalability.
We have also developed and demonstrated various data collection techniques, including perception-based assessments and phonetic transcription. These methods have been effectively integrated into teaching practices, significantly improving pronunciation accuracy. Additionally, our focus on computer-based analysis has shown how technology can provide better evaluation tools, boosting the efficiency of speaking training.
Feedback from students indicates a strong preference for our revitalized elicited imitation techniques over traditional methods, underscoring their effectiveness in improving pronunciation and fluency. Collectively, our research supports a balanced approach that merges technology with traditional methods, emphasizing the need for adaptive teaching strategies to meet the evolving needs of learners.

Strategy for Future Research Activity

Moving forward with our research project, we plan to further utilize our comprehensive data sets on fluency and speech performance, alongside our elicited imitation data, to deepen our evaluation of AI's efficacy in assessing speaking performance and fluency. This continued analysis aims to refine our understanding of how AI can complement and enhance traditional evaluation methods, ensuring more robust and scalable assessment techniques in the field of language learning.

In addition to our analytical efforts, we will actively disseminate our findings within the academic and professional communities. We intend to present our latest research outcomes at upcoming conferences. Moreover, we are in the process of drafting an academic paper that will encapsulate our recent discoveries and theoretical advancements.

Furthermore, we are committed to expanding our network within the speech evaluation community. By engaging with other researchers in this field, we hope to foster collaborative relationships that can lead to joint research initiatives. Through these strategic partnerships, we aim to not only enhance the scope and impact of our research but also to contribute to the broader goal of improving ESL pedagogy through cutting-edge technology and evidence-based practices.

Report

(5 results)
  • 2023 Research-status Report
  • 2022 Research-status Report
  • 2021 Research-status Report
  • 2020 Research-status Report
  • 2019 Research-status Report
  • Research Products

    (18 results)

All 2023 2022 2021

All Journal Article (3 results) (of which Peer Reviewed: 3 results) Presentation (15 results) (of which Int'l Joint Research: 8 results)

  • [Journal Article] Student Perceptions of Elicited Imitation and Shadowing for Improving L2 Speaking Skills2023

    • Author(s)
      Cvitkovic, Robert
    • Journal Title

      Teikyo Journal of Language Studies

      Volume: 15 Pages: 203-218

    • Related Report
      2023 Research-status Report
    • Peer Reviewed
  • [Journal Article] A New Instrument to Measure Educational App Value2023

    • Author(s)
      Cvitkovic, Robert
    • Journal Title

      Teikyo Journal of Language Studies

      Volume: 14 Pages: 137-159

    • Related Report
      2022 Research-status Report
    • Peer Reviewed
  • [Journal Article] AI is on track to take us one billion meters from today2023

    • Author(s)
      Cvitkovic, Robert
    • Journal Title

      Mind, Brain, and Education Think Tank: ChatGPT

      Volume: 9 (3) Pages: 21-25

    • Related Report
      2022 Research-status Report
    • Peer Reviewed
  • [Presentation] Isn’t it Time for More Elicited Imitation Textbooks?2023

    • Author(s)
      Cvitkovic, Robert
    • Organizer
      JALT PanSIG Conference
    • Related Report
      2023 Research-status Report
  • [Presentation] Measuring the Extent Elicited Imitation Aids Speaking Fluency in MALL2023

    • Author(s)
      Massoud, Omar; Cvitkovic, Robert
    • Organizer
      JALT PanSIG Conference
    • Related Report
      2023 Research-status Report
  • [Presentation] Speech-to-Text Enhanced Elicited Imitation for Improving English Speaking Fluency2023

    • Author(s)
      Cvitkovic, Robert
    • Organizer
      JALTCALL 2023: CALLing the Future
    • Related Report
      2023 Research-status Report
  • [Presentation] Unlocking Pronunciation: Data Collection Approaches2023

    • Author(s)
      Cvitkovic, Robert
    • Organizer
      JALT2023 International Conference
    • Related Report
      2023 Research-status Report
    • Int'l Joint Research
  • [Presentation] Leveraging Technology for Pronunciation Evaluation2023

    • Author(s)
      Cvitkovic, Robert
    • Organizer
      Teaching and Technology at JALT2023 International Conference
    • Related Report
      2023 Research-status Report
    • Int'l Joint Research
  • [Presentation] Improving speaking fluency with speech-to-text shadowing tasks2022

    • Author(s)
      Cvitkovic, Robert
    • Organizer
      48th Annual Conference on Language Teaching and Learning & Educational Materials Exhibition
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] Quickly create effective auto-grading quizzes with Google Sheets+Forms2022

    • Author(s)
      Cvitkovic, Robert
    • Organizer
      48th Annual Conference on Language Teaching and Learning & Educational Materials Exhibition
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] Low Effort, High Return - Auto graded quizzes that make themselves2022

    • Author(s)
      Cvitkovic, Robert
    • Organizer
      48th Annual Conference on Language Teaching and Learning & Educational Materials Exhibition
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] Characterizing the Interaction between Speed and Breakdown Fluency in EFL Learners2022

    • Author(s)
      Cvitkovic, Robert
    • Organizer
      The 61st JACET International Convention
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] Measuring the extent speech-to-text shadowing aids speaking fluency in EFL learners using MALL2022

    • Author(s)
      Cvitkovic, Robert
    • Organizer
      13th annual Pronunciation in Second Language Learning and Teaching (PSLLT)
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] Measuring the Extent Speech-To-Text Can Affect Speaking Performance2022

    • Author(s)
      Cvitkovic, Robert
    • Organizer
      The 23rd Temple University Applied Linguistics Colloquium
    • Related Report
      2021 Research-status Report
  • [Presentation] Quantifying Speaking Characteristics in Intermediate Japanese Learners2022

    • Author(s)
      Cvitkovic, Robert; Massoud, O.
    • Organizer
      The 23rd Temple University Applied Linguistics Colloquium
    • Related Report
      2021 Research-status Report
  • [Presentation] Providing high-quality speaking opportunities with micro-learning, feedback and gamification2021

    • Author(s)
      Cvitkovic, Robert
    • Organizer
      Remote Teaching & Beyond JALTCALL2021
    • Related Report
      2021 Research-status Report
  • [Presentation] Evaluating a multi-skill language learning platform2021

    • Author(s)
      Cvitkovic, Robert; Massoud, O.
    • Organizer
      Remote Teaching & Beyond JALTCALL2021
    • Related Report
      2021 Research-status Report
  • [Presentation] Training Speaking and Vocab With Microlearning and Feedback2021

    • Author(s)
      Cvitkovic, Robert; Massoud, O.
    • Organizer
      JALT International 2021: Reflections and New Perspectives
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research

URL: 

Published: 2019-04-18   Modified: 2024-12-25  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi