Construction of a deep immersive training system using a substitutional reality system

• Project/Area Number: 26330237
• Research Category: Grant-in-Aid for Scientific Research (C)
• Allocation Type: Multi-year Fund
• Section: 一般
• Research Field: Human interface and interaction
• Research Institution: Konan University
• Principal Investigator: TAMURA Yuichi 甲南大学, 知能情報学部, 教授 (50311212)
• Co-Investigator(Kenkyū-buntansha): 梅谷 智弘 甲南大学, 知能情報学部, 准教授 (10397630) ; 中村 浩章 核融合科学研究所, ヘリカル研究部, 教授 (30311210) ; 久米 健次 奈良女子大学, その他部局等, 名誉教授 (10107344)
• Project Period (FY): 2014-04-01 – 2018-03-31
• Project Status: Completed (Fiscal Year 2017)
• Budget Amount: ¥4,680,000 (Direct Cost: ¥3,600,000、Indirect Cost: ¥1,080,000); Fiscal Year 2017: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000); Fiscal Year 2016: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000); Fiscal Year 2015: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000); Fiscal Year 2014: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
• Keywords: 訓練システム / 代替現実感 / 特異スペクトル解析 / バーチャルリアリティ / 訓練支援 / ジェスチャー認識 / SingularSpectrumAnalysis / Head Mounted Display / ジェスチャ認識

Outline of Final Research Achievements

In this research, we studied the followings.
1) We developed a binocular stereoscopic omnidirectional camera using four action cams for constructing a substitutional reality system. 2) We developed a method for superimposing hand behavior on substitutional reality system, and made it possible to automatically extract image key frames using Singular Spectrum Analysis. 3) We developed a training and measurement system for the elderly people, and objectively evaluated cognitive function and gait function.

Research Products

• [Journal Article] An Adaptive Orthogonal SSA Decomposition Algorithm for a Time Series (2018)
  • Author(s): Kume Kenji、Nose-Togawa Naoko
  • Journal Title: Advances in Data Science and Adaptive Analysis Volume: 10 Issue: 01 Pages: 1850002-1850002
  • DOI: 10.1142/s2424922x1850002x
  • Peer Reviewed
• [Journal Article] An Intuitive Interface for Visualizing Numerical Data in a Head-Mounted Display with Gesture Control (2016)
  • Author(s): Yuichi Tamura, Hiroaki Nakamura and Susumu Fujiwara
  • Journal Title: Plasma and Fusion Research Volume: 11 Issue: 0 Pages: 2406060-2406060
  • DOI: 10.1585/pfr.11.2406060
  • NAID: 130005401651
  • ISSN: 1880-6821
  • Peer Reviewed / Open Access
• [Journal Article] An interactive aquarium type display that enables to float virtual objects in the water (2016)
  • Author(s): 出口真美，田村祐一
  • Journal Title: Transactions of the Virtual Reality Society of Japan Volume: 21 Issue: 3 Pages: 525-528
  • DOI: 10.18974/tvrsj.21.3_525
  • NAID: 130005268377
  • ISSN: 1344-011X, 2423-9593
  • Peer Reviewed / Open Access / Acknowledgement Compliant
• [Journal Article] Change Detection of Indoor Environments Using Singular Spectrum Transformation of Strength of Wireless LAN Signals (2016)
  • Author(s): 梅谷智弘，田村祐一
  • Journal Title: Transactions of the Society of Instrument and Control Engineers Volume: 52 Issue: 3 Pages: 127-133
  • DOI: 10.9746/sicetr.52.127
  • NAID: 130005139007
  • ISSN: 0453-4654, 1883-8189
  • Peer Reviewed / Open Access / Acknowledgement Compliant
• [Journal Article] Visualization of dust particle data with plasma simulation results by using virtual-reality system (2016)
  • Author(s): H. Ohtani, M. Shoji, N. Ohno, Y. Suzuki, S. Ishiguro, A. Kageyama and Y. Tamura
  • Journal Title: Contribution to Plasma Physics Volume: 56 Issue: 6-8 Pages: 692-697
  • DOI: 10.1002/ctpp.201610054
  • Peer Reviewed / Open Access / Acknowledgement Compliant
• [Journal Article] Dissipative Particle Dynamics Simulation of Self-Assembly in a Bolaamphiphilic Solution (2016)
  • Author(s): S. Fujiwara, Y. Takahashi, H. Ikebe, T. Mizuguchi, M. Hashimoto, Y. Tamura, H. Nakamura, and R. Horiuchi
  • Journal Title: Plasma and Fusion Research Volume: 11 Issue: 0 Pages: 2401073-2401073
  • DOI: 10.1585/pfr.11.2401073
  • NAID: 130005330453
  • ISSN: 1880-6821
  • Peer Reviewed / Open Access
• [Journal Article] 無線LAN信号強度を利用した屋内環境における状態変化検出の検討 (2015)
  • Author(s): 梅谷 智弘, 澤田 祐志, 田村 祐一
  • Journal Title: 計測自動制御学会論文集 Volume: 28 Pages: 140-146
  • NAID: 130005088336
  • Peer Reviewed
• [Journal Article] Detection of finger gesture using singular spectrum transformation (2015)
  • Author(s): Yuichi TAMURA, Tomohiro UMETANI and Hiroaki NAKAMURA
  • Journal Title: Journal of Physics Volume: 574 Pages: 1-4
  • Peer Reviewed / Open Access / Acknowledgement Compliant
• [Journal Article] MolecularDynamicsSimulationofPhaseBehaviorina BolaamphiphilicSolution (2015)
  • Author(s): Susumu FUJIWARA, Takumi MIYATA, Masato HASHIMOTO, Yuichi TAMURA, Hiroaki NAKAMURA and Ritoku HORIUCHI
  • Journal Title: Plasma and Fusion Research Volume: 10 Pages: 1-4
  • Peer Reviewed / Acknowledgement Compliant
• [Journal Article] Dynamic Gesture Classification using Skeleton Model on RGB-D Data (2014)
  • Author(s): Yuichi Tamura, Tomohiro Umetani, Naoya Kashima and Hiroaki Nakamura
  • Journal Title: Journal of Physics: Conference Series Volume: 490 Pages: 1-4
  • DOI: 10.1088/1742-6596/490/1/012103
  • Peer Reviewed / Open Access / Acknowledgement Compliant
• [Journal Article] Interactive visualization system to analyze corrugated millimeter-waveguide component of ECH in nuclear fusion with FDTD simulation (2014)
  • Author(s): Naoya Kashima, Hiroaki Nakamura, Yuichi Tamura, Atsushi M. Ito, Shin Kubo
  • Journal Title: Journal of Physics: Conference Series Volume: 490 Pages: 1-4
  • DOI: 10.1088/1742-6596/490/1/012179
  • Peer Reviewed / Open Access / Acknowledgement Compliant
• [Presentation] Evaluations of Traffic-related Cognitive Function of Japanese Older Adults by Virtual Reality System (2017)
  • Author(s): N. Takehara R. Sasakura N. Ohno Y. Tamura R. Varadhan H. Uchida
  • Organizer: IAGG World Congress of Gerontology and Geriatrics
  • Int'l Joint Research
• [Presentation] Dissipative particle dynamics simulation for self-assembly of symmetric bolaamphiphilic molecules in a solution (2017)
  • Author(s): S. Fujiwara, Y. Iida, T. Tsutsui, T. Mizuguchi, M. Hashimoto, Y. Tamura and H. Nakamura
  • Organizer: International Toki Conference
  • Int'l Joint Research
• [Presentation] Classification of finger movement using singular spectrum transformation (2014)
  • Author(s): Yuichi Tamura
  • Organizer: International Conference on Mathematical Modeling in Physical Sciences
  • Place of Presentation: Madrid, Spain
  • Year and Date: 2014-08-30