2018 Fiscal Year Research-status Report
Engineering virtual reality for real learning
| Project/Area Number |
18K02940
|
|---|
| Research Institution | Future University-Hakodate |
|---|
Principal Investigator |
Vallance Michael 公立はこだて未来大学, システム情報科学部, 教授 (00423781)
|
|---|
| Project Period (FY) |
2018-04-01 – 2021-03-31
|
| Keywords | virtual reality / education |
|---|
| Outline of Annual Research Achievements |
Pilot study with virtual-to-real robots and remote collaboration determined two types of communication: intra-cognitive communication: information transfer between two humans; and inter-cognitive communication: information transfer between a human and an artificially cognitive system. By adopting an antidisciplinary approach, we determined that a more substantial and motivational context was required. Consequently, we developed a virtual solar power plant in Unity; modeled upon a real-world plant whose form was accurately mapped using a drone. Humidity and temperature sensors were attached to an Arduino board; its data uploaded to our online database and automatically imported to the Unity project 3D display. International collaboration was initiated.
|
| Current Status of Research Progress |
Current Status of Research Progress
2: Research has progressed on the whole more than it was originally planned.
Reason
To design rich learning and training scenarios in VR it is not only necessary to focus on different interactivities but also to design experiences with different characteristics and problems. Varying 3D displays of voltage, current, inductance and power are being trialed in order to develop a narrative template for effectively communicating the 3D data. Educational activities are being designed in order to determine the efficacy of real-to-virtual VR for learning. A virtual robot which can be maneuvered remotely in the SolarVR Unity Project space viewable using the Oculus Rift HMD will be used to seek out maintenance issues. This process and its programming were informed by our experiences with the virtual robot and Arduino EV3 Shield technologies.
|
| Strategy for Future Research Activity |
Initially we planned to collect qualitative data of learners using pre and post surveys; using Bloom’s Taxonomy. We recognize that such self-reporting, although commonplace, can be unreliable. In 2018, while working on another research project, we discovered a more effective and, we posit, informative quantitative data acquisition using a physiological device named Empatica. We plan to use the Empatica to capture learner’s bio-signals to determine their anxiety, pleasure and, possibly, flow as they are engaged in virtual-to-real VR tasks. Learning outcomes will also be designed to determine how biodata can be used to support learning metrics while engaged in VR education. The virtual-to-real VR simulation requires additional programming, design and development of hardware and application.
|
| Causes of Carryover |
The virtual-to-real VR remains incomplete. 3D data visualization needs to be appropriately programmed to capture live data and display in a number of formats for interpretation. The real-world solar simulation and virtual robot avatar require programming. Education tasks require planning and trialing. Links with the UK university need to be further established for international collaboration. Publication of current research is necessary.
|
| Remarks |
Homepage for lab.
|
