• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

miXai^learn: Multimodal Interactions, and Explainable AI for Embodied learning

Research Project

Project/Area Number 24KK0051
Research Category

Fund for the Promotion of Joint International Research (International Collaborative Research)

Allocation TypeMulti-year Fund
Review Section Medium-sized Section 9:Education and related fields
Research InstitutionKumamoto University

Principal Investigator

Majumdar Rwito  熊本大学, 半導体・デジタル研究教育機構, 准教授 (30823348)

Co-Investigator(Kenkyū-buntansha) Flanagan Brendan  京都大学, 国際高等教育院, 特定准教授 (00807612)
李 慧勇  九州大学, 情報基盤研究開発センター, 助教 (60913910)
久保田 真一郎  熊本大学, 半導体・デジタル研究教育機構, 准教授 (80381143)
Project Period (FY) 2024-09-09 – 2027-03-31
Project Status Granted (Fiscal Year 2024)
Budget Amount *help
¥20,930,000 (Direct Cost: ¥16,100,000、Indirect Cost: ¥4,830,000)
Fiscal Year 2026: ¥7,280,000 (Direct Cost: ¥5,600,000、Indirect Cost: ¥1,680,000)
Fiscal Year 2025: ¥7,800,000 (Direct Cost: ¥6,000,000、Indirect Cost: ¥1,800,000)
Fiscal Year 2024: ¥5,850,000 (Direct Cost: ¥4,500,000、Indirect Cost: ¥1,350,000)
KeywordsMultimodal Interactions / Explainable AI / LA-ReflecT / miXai Framework / Embodied Cognition / Social Robotics / Learning Analytics / miXai framework
Outline of Research at the Start

This joint research takes the standpoint that learning has embodied experiences distributed in the physical and virtual spaces. While current online learning systems often focus on the cognitive skills, there is a lack of data-driven approaches for tracking learning process and provide feedback on tasks that are distributed in physical and virtual spaces. This research explores an innovative integration of Artificial Intelligence (AI) and socially assistive robotics in a technical infrastructure to enhance learner’s critical reflection in the psychomotor and cognitive aspects of learning.

Outline of Annual Research Achievements

In the first 6 months of this international miXai project, the research leader could have meetings with all the members and have the initial execution plan of each of the sub projects involved. For partners in Japan there were face to face meetings and the teams could deploy a version of the LA-ReflecT platform in each of the universities. LA-ReflecT is also piloted with a high school team and then data collection was done in an actual class in that school. With partners in Spain, a conceptual paper was presented at an international conference workshop. It highlights the system description which uses vision based AI to track human movements and shows how psychomotor and cognitive skills can be trained together. We are working to propose an unified pedagogy, technology and analytics model for psychomotor development using smart technologies. With partners from India, we could have initial discussion and purchased the same robotic arm such that the studies can be conducted in parallel in both counties. The international research teams are further organizing a workshop at the international conference of Artificial Intelligence in Education related to the project in July 2025. The first version of the system is also piloted with other countries research group, specifically Taiwan and Vietnam.

Current Status of Research Progress
Current Status of Research Progress

2: Research has progressed on the whole more than it was originally planned.

Reason

In the 6 months, the project could partner up with a public high school and continue joint research in Japan. The domestic and international collaborators have continuous meetings and have prepared the agenda of the initial phase of research.

Strategy for Future Research Activity

AI driven technologies like web-based eye tracking will be integrated in the LA-ReflecT platform. The work will continue with the international research partners to continue and collect actual field data. The analysis of the data for modeling and the initial redesign of the tasks and technology module is planned in the next phase

Report

(1 results)
  • 2024 Research-status Report
  • Research Products

    (9 results)

All 2024 Other

All Int'l Joint Research (4 results) Journal Article (1 results) (of which Int'l Joint Research: 1 results,  Peer Reviewed: 1 results,  Open Access: 1 results) Presentation (1 results) (of which Int'l Joint Research: 1 results) Remarks (2 results) Funded Workshop (1 results)

  • [Int'l Joint Research] UNED, Spain(スペイン)

    • Related Report
      2024 Research-status Report
  • [Int'l Joint Research] IIT Gandhinagar(インド)

    • Related Report
      2024 Research-status Report
  • [Int'l Joint Research] Soochow University(その他の国・地域)

    • Related Report
      2024 Research-status Report
  • [Int'l Joint Research] University of Zagreb(クロアチア)

    • Related Report
      2024 Research-status Report
  • [Journal Article] Exploring Cognitive Engagement in AI-Driven Adaptive Psychomotor Sport Training2024

    • Author(s)
      PORTAZ Miguel、MAJUMDAR Rwitajit、SANTOS Olga
    • Journal Title

      International Conference on Computers in Education

      Volume: 1 Pages: 1-10

    • DOI

      10.58459/icce.2024.4903

    • Related Report
      2024 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Presentation] LA-ReflecT Dashboard: Scaffolding Reflection on Learning with Teacher Prompts & LLM Interactions2024

    • Author(s)
      Rwitajit MAJUMDAR, Patrick OCHEJA, Huiyong LI, Jayakrishnan.M. WARRIEM
    • Organizer
      Technology 4 Education (T4E 2024)
    • Related Report
      2024 Research-status Report
    • Int'l Joint Research
  • [Remarks] miXailearn webpage

    • URL

      https://sites.google.com/view/mixailearn

    • Related Report
      2024 Research-status Report
  • [Remarks] 第40回 熊本大学 eラーニング連続セミナー(2025年3月27日)

    • URL

      https://www.ield.kumamoto-u.ac.jp/mod/page/view.php?id=781

    • Related Report
      2024 Research-status Report
  • [Funded Workshop] Designing Multimodal Interactions for Seamless Reflective Learning2024

    • Related Report
      2024 Research-status Report

URL: 

Published: 2024-09-10   Modified: 2025-12-26  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi