Development of Mixed Reality Technique with Force Feedback and Application to Education involving Experiments

• Project/Area Number: 16K01060
• Research Category: Grant-in-Aid for Scientific Research (C)
• Allocation Type: Multi-year Fund
• Section: 一般
• Research Field: Educational technology
• Research Institution: Tokyo University of Agriculture and Technology
• Principal Investigator: TAKEMURA Atsushi 東京農工大学, 工学(系)研究科(研究院), 助教 (20297617)
• Project Period (FY): 2016-04-01 – 2019-03-31
• Project Status: Completed (Fiscal Year 2018)
• Budget Amount: ¥4,680,000 (Direct Cost: ¥3,600,000、Indirect Cost: ¥1,080,000); Fiscal Year 2018: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000); Fiscal Year 2017: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000); Fiscal Year 2016: ¥2,080,000 (Direct Cost: ¥1,600,000、Indirect Cost: ¥480,000)
• Keywords: 教育支援システム / バーチャルリアリティ / 実験教育 / 複合現実 (MR) / 電子回路 / ものづくり

Outline of Final Research Achievements

This study developed the novel mixed reality technique which enables users to operate 3-dimensional virtual equipments using force sense. Moreover, this study verified its applicability to educational support system for technological experiments involving construction of electronic circuits and robots. The technological novelty of this system are listed as follows: (1) The proposed MR system does not necessitate use of attached devices which disturb learning and experiments; (2) Users can operate 3-dimensional contents using force sense; (3) The proposed education system is applicable to various environments and purposes of individual users.

Academic Significance and Societal Importance of the Research Achievements

これまでにも，生体信号を用いたマシン・インターフェースの開発が行われてきたが，裸眼立体映像に対して筋電信号に基づいて力覚を伴う操作と作業を可能にする試みは，本研究が初めてである。また，提案システムを実験教育に用いる場合，実験作業を妨げる装着デバイスがなく，実験者の様々な環境や用途にも応用できるため，得られる教育効果は，従来の教育支援システムと比べて飛躍的に増大すると考えられる。さらに，本システムは，理工系の以外の分野（生体医工学，スポーツなど）においても，広い応用が期待できる。

Research Products

• [Journal Article] e-Learning system for electronic circuit construction using handwriting recognition and mixed reality techniques (2018)
  • Author(s): A. Takemura
  • Journal Title: Proceedings of IADIS International Conference e-Learning Volume: 12 Pages: 161-166
  • Peer Reviewed
• [Journal Article] Recognition of handwritten schematic symbols and its application to a web-based education system for electronic circuit construction (2017)
  • Author(s): A. Takemura
  • Journal Title: Proceedings of IADIS ITS 2017 Volume: 8 Pages: 163-168
  • Peer Reviewed
• [Journal Article] e-Learning system using segmentation-based MR technique for learning circuit construction (2016)
  • Author(s): A. Takemura
  • Journal Title: Proceedings of IADIS CELDA 2016 Volume: 13 Pages: 329-334
  • Peer Reviewed / Acknowledgement Compliant
• [Presentation] e-Learning system for electronic circuit construction using handwriting recognition and mixed reality techniques (2018)
  • Author(s): A. Takemura
  • Organizer: International Association for Development of the Information Society (IADIS)
  • Int'l Joint Research
• [Presentation] Recognition of handwritten schematic symbols and its application to a web-based education system for electronic circuit construction (2017)
  • Author(s): A. Takemura
  • Organizer: IADIS International Conference on Internet Technologies and Society
  • Int'l Joint Research
• [Presentation] An e-Learning system with MR for experiments involving circuit construction to control a robot (2016)
  • Author(s): A. Takemura
  • Organizer: IADIS International Conference on Internet Technologies and Society
  • Place of Presentation: Royal Melbourne Institute of Technology (RMIT), Melbourne, Australia
  • Year and Date: 2016-12-06
  • Int'l Joint Research