| 研究実績の概要 |
In this period, we explored applications of virtual reality (VR) and augmented reality (AR) in education and healthcare. First, we conducted a study on educational comics that utilized eye-tracking in VR to identify key gaze features to help estimate the difficulty levels perceived by readers, suggesting a way to dynamically adjust educational content. We also developed, AMSwipe, a method that allows for gaze-based text input into virtual environments, which allows for efficient, hands-free typing without the need for physical controllers. Additionally, EyeShadows, a tool that we developed and tested with both AR and VR, improves the selection and manipulation of virtual elements using peripheral copies of items, enabling faster, more accurate interactions. Furthermore, we leveraged VR to enhance medical training, particularly by simulating the experiences of Parkinson’s disease patients to foster empathy and insight among healthcare students. These technologies demonstrate significant potential for enhancing remote education, providing immersive, interactive learning experiences that can be tailored to individual needs and capabilities. We also explored the use of interactive re-training of neural networks for applications in language learning.
|
| 今後の研究の推進方策 |
The last phase of the research will proceed as planned, though we have made some updates due to the advancement of AI technology. In addition, we are working on an in-situ object labeling approach, which can assist with a more specific learning task, language learning. Our system will be extended to incorporate Large Language Models(LLM), which will be customized to power virtual educational agents. This should result in more interactive and context-based learning, leading to longer retention of the concepts.
|
