• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Development of a Motion Learning Assist System Combining Visual and Vibration Stimulus -Application to Shamisen Learning Assist-

Research Project

Project/Area Number 18K18163
Research Category

Grant-in-Aid for Early-Career Scientists

Allocation TypeMulti-year Fund
Review Section Basic Section 62030:Learning support system-related
Research InstitutionIbaraki University (2019-2022)
Muroran Institute of Technology (2018)

Principal Investigator

Shibata Takeshi  茨城大学, 理工学研究科(工学野), 助教 (90649550)

Project Period (FY) 2018-04-01 – 2023-03-31
Project Status Completed (Fiscal Year 2022)
Budget Amount *help
¥4,160,000 (Direct Cost: ¥3,200,000、Indirect Cost: ¥960,000)
Fiscal Year 2020: ¥780,000 (Direct Cost: ¥600,000、Indirect Cost: ¥180,000)
Fiscal Year 2019: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2018: ¥2,210,000 (Direct Cost: ¥1,700,000、Indirect Cost: ¥510,000)
Keywords身体動作 / 学習支援 / バーチャルリアリティ / 振動刺激 / 身体動作解析 / マルチモーダル
Outline of Final Research Achievements

Recognizing details of human motion is important for learning skills including musical instruments performance. A learning assist method by visual stimulus has been proposed in the literature; however, this approach cannot sufficiently recognize human motion in 3D space. Moreover, instead of visual stimulus, haptics stimulus is also used for learning assistance. However, the haptics feedback has a probability to impede the motion. Hence, in this study, we proposed a system that provides visual and haptics feedback without impeding the motion.
First, we discussed a fundamental method to represent human motion by haptic stimulus. After that, a motion representation system via visual and vibrational feedback for learning Japanese musical instrument, such as shamisen, was proposed. Our experimental results demonstrated that the combination stimulus of visual and vibrational feedback is better at learning the shamisen motion compared to a previously developed system.

Academic Significance and Societal Importance of the Research Achievements

本研究の成果によって,三味線学習の初期に必要となる右腕の三次元的な動きを,視覚と振動を組み合わせて提示可能となり,短い時間で基礎練習を完了してスムーズに曲の練習に移行可能となった.これにより,日本の代表的な民俗芸能である三味線の学習を支援することができる.また,本成果は,三次元的な動きの習得が必要な他の楽器や身体技能の習得にも活用できると考えられる.特に奥行方向の動きを含む動作で,従来の映像による学習が難しい動作においても効果的な学習支援が可能であり,幅広い応用が期待できる.

Report

(6 results)
  • 2022 Annual Research Report   Final Research Report ( PDF )
  • 2021 Research-status Report
  • 2020 Research-status Report
  • 2019 Research-status Report
  • 2018 Research-status Report
  • Research Products

    (6 results)

All 2023 2020 2019 2018

All Journal Article (1 results) (of which Peer Reviewed: 1 results) Presentation (5 results)

  • [Journal Article] Development of a forearm motion learning-assist system for playing the Japanese shamisen instrument2023

    • Author(s)
      Takeshi Shibata, Misa Tanaka
    • Journal Title

      Entertainment Computing

      Volume: 46 Pages: 1-16

    • DOI

      10.1016/j.entcom.2023.100564

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed
  • [Presentation] 視覚と振動を用いた反復動作の学習支援システムの評価2020

    • Author(s)
      田中聖紗,柴田傑
    • Organizer
      第25回日本バーチャルリアリティ学会
    • Related Report
      2020 Research-status Report
  • [Presentation] 三味線演奏の入門学習を支援するVR教材の提案2020

    • Author(s)
      中村奏水,柴田傑
    • Organizer
      情報処理北海道シンポジウム2020
    • Related Report
      2020 Research-status Report
  • [Presentation] 振動を用いた動きの教示による撥さばき習得システムの検討2019

    • Author(s)
      谷川華奈子,柴田傑
    • Organizer
      情報処理北海道シンポジウム2019
    • Related Report
      2019 Research-status Report
  • [Presentation] 視覚刺激と振動刺激を用いた位置情報提示手法の評価2019

    • Author(s)
      田中聖紗,柴田傑,
    • Organizer
      第24回日本バーチャルリアリティ学会全国大会
    • Related Report
      2019 Research-status Report
  • [Presentation] 電気刺激を用いた誘導の提示方法の検討2018

    • Author(s)
      田中聖紗,柴田傑
    • Organizer
      情報処理北海道シンポジウム 2018,23
    • Related Report
      2018 Research-status Report

URL: 

Published: 2018-04-23   Modified: 2024-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi