• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

A study into the use of Extended Concept Maps and Speech Recognition to improve lower-order language skills and higher-order thinking skills for language learners in Japan

Research Project

Project/Area Number 22K00760
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Review Section Basic Section 02100:Foreign language education-related
Research InstitutionKanazawa University

Principal Investigator

Gary Ross  金沢大学, 薬学系, 准教授 (10708142)

Co-Investigator(Kenkyū-buntansha) ヘネベリー スティーヴン  島根県立大学, 国際関係学部, 教授 (30405477)
ヨーク ジェームズ  明治大学, 政治経済学部, 専任講師 (90774498)
Project Period (FY) 2022-04-01 – 2026-03-31
Project Status Granted (Fiscal Year 2023)
Budget Amount *help
¥4,290,000 (Direct Cost: ¥3,300,000、Indirect Cost: ¥990,000)
Fiscal Year 2025: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2024: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Fiscal Year 2023: ¥780,000 (Direct Cost: ¥600,000、Indirect Cost: ¥180,000)
Fiscal Year 2022: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Keywordsspeech recognition / Large Language Models / ChatGPT / AI / chatbot / Concept Maps / online learning / concept maps / higher-order skills
Outline of Research at the Start

The research will cover four keys areas:
* determine the most effective extended speech maps/Speech Recognition activities and framework, and analyse speech recognition accuracy.
* determine whether ECM and Speech Recognition leads to better language outcomes, engagement, self-reflection, and understanding.
* (i) refine the teaching framework to be disseminated at teacher workshops, with the aim of allowing teachers to integrate ECMs and Speech Recognition into their classrooms (ii) discover language patterns used by Japanese students.
* Attitudes toward ECM creation during Covid-19

Outline of Annual Research Achievements

Since the initiation of this project, the rapid advancement of AI technologies has prompted a slight expansion in our goals. Integration of AI Large Language Models with Concept Maps. Specifically, we have explored the application of Concept Maps to model interactions between pharmacy students and various aspects of lifestyle, medicine, and health. Our efforts have yielded successful results in several key areas:
Speech Recognition Integration: We have successfully implemented a speech recognition interface that works in conjunction with AI chatbots. This setup enables a detailed analysis of the complex interactions between patient needs, societal demands, and professional responses.
Enhanced Learning Experiences: By utilizing speech-synthesized AI chatbots, students engaged in simulated interactions that mirror real-world scenarios. This approach has proven effective in providing practical experiences, fostering a deeper understanding of patient-professional dynamics.
These achievements underscore the potential of combining AI with Concept Maps to enhance the learning and analytical capabilities of pharmacy students, paving the way for more innovative educational methodologies. Additionally, this approach can be adapted to address other complex problems beyond the medical field, offering valuable insights and practical applications in areas such as environmental science, engineering, and social sciences.

Current Status of Research Progress
Current Status of Research Progress

2: Research has progressed on the whole more than it was originally planned.

Reason

Project Overview: This research project has made significant strides in integrating advancements in AI language models with Extended Concept Maps (ECMs). These enhancements have positively impacted our objectives and outcomes across several key areas.
Achievement of Objectives: The integration of AI Large Language Models has been successfully implemented, enabling more sophisticated and nuanced interactions within the ECMs. This has improved the accuracy and responsiveness of speech recognition interfaces and AI-driven chatbots, facilitating better analysis and learning experiences.
Innovative Applications: By extending ECMs to interdisciplinary fields such as medicine, we have broadened the scope and impact of our research.
Collaboration and User Engagement: Development of collaborative platforms has allowed for real-time interaction with ECMs, fostering greater collaboration. User feedback has been integral in continuously improving the functionality and user experience of the ECMs.
Conclusion: The project has successfully integrated cutting-edge AI advancements.

Strategy for Future Research Activity

Moving forward, the research will focus on:

Interdisciplinary Applications: We will extend Extended Concept Maps (ECMs) to fields like social sciences to analyze complex interactions and broaden our research's scope and impact.
Advanced AI Integration: We will refine the integration of AI Large Language Models with ECMs, improving AI-driven speech recognition interfaces and chatbots to handle sophisticated interactions and provide nuanced insights.
Collaborative Platforms: We aim to develop platforms for real-time interaction with ECMs, fostering greater collaboration among students, educators, and professionals.
Data Analytics and Feedback: We will use advanced data analytics and pilot studies to assess ECM effectiveness and collect user feedback to improve functionality and user experience.

Report

(2 results)
  • 2023 Research-status Report
  • 2022 Research-status Report
  • Research Products

    (9 results)

All 2023 2022

All Journal Article (1 results) (of which Peer Reviewed: 1 results,  Open Access: 1 results) Presentation (8 results) (of which Int'l Joint Research: 1 results)

  • [Journal Article] Medical English communication training using ChatGPT and speech recognition2023

    • Author(s)
      Jeanette Dennisson and Gary Ross
    • Journal Title

      Journal of Medical English Education

      Volume: 22 Pages: 87-90

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Open Access
  • [Presentation] ChatGPT and Speech Recognition in the ESP Classroom2023

    • Author(s)
      Gary Ross, Jeanette Dennisson
    • Organizer
      PanSIG 2023
    • Related Report
      2023 Research-status Report
  • [Presentation] Online speech: utilizing speech recognition in spaced learning2023

    • Author(s)
      Gary Ross, Jeanette Dennisson
    • Organizer
      JALTCALL 2023
    • Related Report
      2023 Research-status Report
  • [Presentation] Learning a foreign language with digital games. What does it take?2023

    • Author(s)
      Gary Ross, James York
    • Organizer
      JALTCALL 2023
    • Related Report
      2023 Research-status Report
  • [Presentation] Doctor-patient interview training chatbot and speech recognition technology2023

    • Author(s)
      Gary Ross, Jeanette Dennisson
    • Organizer
      JASMEE 2023 Academic Meeting
    • Related Report
      2023 Research-status Report
  • [Presentation] Use of AI, Speech Recognition and Synthesis in task-based language learning contexts2023

    • Author(s)
      Gary Ross, Jeanette Dennisson
    • Organizer
      EuroCALL 2023, Iceland
    • Related Report
      2023 Research-status Report
    • Int'l Joint Research
  • [Presentation] Improve Speaking in ESP Using Chatbot and Speech Recognition2023

    • Author(s)
      Gary Ross, Jeanette Dennisson
    • Organizer
      JALT International Conference 2023
    • Related Report
      2023 Research-status Report
  • [Presentation] AI: Threats and Opportunities for Teachers and Learners2023

    • Author(s)
      Gary Ross, Mark Brierley
    • Organizer
      JALT International Conference 2023
    • Related Report
      2023 Research-status Report
  • [Presentation] Speech recognition: overview and accuracy2022

    • Author(s)
      Gary Ross, Stephen Henneberry, Aya Hasan
    • Organizer
      JALTCALL 2022
    • Related Report
      2022 Research-status Report

URL: 

Published: 2022-04-19   Modified: 2024-12-25  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi