2022 Fiscal Year Annual Research Report
Development of Cognitive Symbiosis in Virtual Agents to Improve Remote Classroom Learning Outcomes
| Project/Area Number |
21H03482
|
|---|
| Allocation Type | Single-year Grants |
|---|
| Research Institution | Osaka University |
|---|
Principal Investigator |
ORLOSKY JASON 大阪大学, サイバーメディアセンター, 特任准教授(常勤) (10815111)
|
|---|
| Co-Investigator(Kenkyū-buntansha) |
白井 詩沙香 大阪大学, サイバーメディアセンター, 講師 (30757430)
清川 清 奈良先端科学技術大学院大学, 先端科学技術研究科, 教授 (60358869)
|
|---|
| Project Period (FY) |
2021-04-01 – 2025-03-31
|
| Keywords | augmented reality / virtual reality / eye tracking |
|---|
| Outline of Annual Research Achievements |
In this research, we have developed new augmented reality (AR) and virtual reality (VR) technologies designed to improve remote education experiences. Our Layerable Apps model in AR allows for multitasking and fast switching between multiple applications, enhancing user efficiency and spatial awareness. This was demonstrated in a study with 44 participants, where Layerable Apps outperformed traditional models in multi-application tasks, suggesting a significant benefit for users needing to manage diverse information sources simultaneously. In VR, we explored advanced 3D locomotion techniques to enhance user interactivity and enjoyment. We evaluated interfaces like Slider, Teleport, and Point-Tug, with Slider proving superior in usability and workload, enabling intuitive, free movement in three dimensions. This can help with navigation in spatial educational settings, making learning more engaging. Additionally, we addressed the challenge of VR sickness with algorithms that adjust the user's field of view based on specific motion triggers, reducing discomfort. Our experiments showed that dynamic modulation could effectively mitigate VR sickness symptoms, making VR more accessible. These innovations show the potential of AR and VR to improve remote education by making digital environments more interactive, comfortable, and user-friendly.
|
| Current Status of Research Progress |
Current Status of Research Progress
2: Research has progressed on the whole more than it was originally planned.
Reason
This research is generally progressing on schedule. We have several very initial publications, and we have completed the system development for a virtual reality testbed as well as eye tracking. These will allow us to develop better interfaces for enabling remote education and interaction in the coming year.
|
| Strategy for Future Research Activity |
For the next year, we will focus on advancing the use of virtual reality (VR) and augmented reality (AR) in education and healthcare. We plan to enhance educational materials through eye-tracking technology in VR, aiming to dynamically adjust content based on the difficulty levels perceived by users. We have already developed the interface to do so and plan to conduct an experiment shortly. Additionally, we will gaze-based interactive systems for virtual environments, designed to allow efficient, hands-free typing, selection, and manipulation without controllers. This will also give us easier access to gaze information relative to the user's target selections. Finally, we plan to explore VR to simulate patient experiences, specifically targeting empathy and understanding in medical training through immersive simulations of Parkinson’s disease scenarios.
|
