• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Prototype magnetic 3D motion sensor system and its application to unexplored problems

Research Project

Project/Area Number 18H04103
Research Category

Grant-in-Aid for Scientific Research (A)

Allocation TypeSingle-year Grants
Section一般
Review Section Medium-sized Section 61:Human informatics and related fields
Research InstitutionTohoku University

Principal Investigator

Kitamura Yoshifumi  東北大学, 電気通信研究所, 教授 (80294023)

Co-Investigator(Kenkyū-buntansha) 片山 統裕  尚絅学院大学, 総合人間科学研究機構, 教授 (20282030)
高嶋 和毅  東北大学, 電気通信研究所, 准教授 (60533461)
藤田 和之  東北大学, 電気通信研究所, 助教 (70835545)
枦 修一郎  東北学院大学, 工学部, 教授 (90324285)
Project Period (FY) 2018-04-01 – 2021-03-31
Project Status Completed (Fiscal Year 2021)
Budget Amount *help
¥44,590,000 (Direct Cost: ¥34,300,000、Indirect Cost: ¥10,290,000)
Fiscal Year 2020: ¥12,870,000 (Direct Cost: ¥9,900,000、Indirect Cost: ¥2,970,000)
Fiscal Year 2019: ¥14,690,000 (Direct Cost: ¥11,300,000、Indirect Cost: ¥3,390,000)
Fiscal Year 2018: ¥17,030,000 (Direct Cost: ¥13,100,000、Indirect Cost: ¥3,930,000)
Keywordsバーチャルリアリティ / モーションキャプチャ / 3次元ユーザインタフェース
Outline of Final Research Achievements

Dexterous 3D motion data can be used for multiple purposes: biologists can use the data to record detailed movements of small animals in their living environments, scientists can track the flow of fluids, and researchers can track finger movements and objects being manipulated by users in virtual reality.
We have captured dexterous 3D motion data from a flexible magnetic flux sensor array, using deep learning and a structure-aware temporal bilateral filter. We invented our new method by applying these ideas on a new magnetic tracking principle. First, the neural networks learn the regression from the simulation flux values to the LC coils 3D configuration at any location and orientation. The new filter further compensates the data to reconstruct smooth and accurate motion. Markers do not require batteries, so observation time can be maximized. As a result, the new integrated system can track multiple LC coils at 100Hz speed at millimeter level accuracy.

Academic Significance and Societal Importance of the Research Achievements

これまで様々な原理に基づく3次元モーションセンサが提案されてきたが,いずれも原理上の制約から3次元の運動を計測できる対象に制限があり,利用できる分野は限定的だった.例えば,道具使用時の細かい手作業中の手指の運動や,土中や障害物の中で動き回わる小動物の運動,互いに複雑に絡み合う多関節物体の動き,流体の3次元的な動きなどを直接計測することはできなかった.
本研究より,これら従来は計測できなかった対象の3次元の動きを計測できる新しい磁気式モーションセンサシステムを実現することができた.これを用いて様々な分野への実応用や,重要な未踏問題の解決につなげることができる.

Report

(4 results)
  • 2021 Final Research Report ( PDF )
  • 2020 Annual Research Report
  • 2019 Annual Research Report
  • 2018 Annual Research Report
  • Research Products

    (16 results)

All 2022 2021 2019 2018 Other

All Int'l Joint Research (4 results) Journal Article (5 results) (of which Int'l Joint Research: 4 results,  Peer Reviewed: 5 results,  Open Access: 5 results) Presentation (7 results) (of which Int'l Joint Research: 6 results,  Invited: 1 results)

  • [Int'l Joint Research] University Palermo(イタリア)

    • Related Report
      2019 Annual Research Report
  • [Int'l Joint Research] エジンバラ大学(英国)

    • Related Report
      2019 Annual Research Report
  • [Int'l Joint Research] University of Edingburgh(英国)

    • Related Report
      2018 Annual Research Report
  • [Int'l Joint Research] University of Palermo(イタリア)

    • Related Report
      2018 Annual Research Report
  • [Journal Article] Hypercube + Rubik’s Cube + Music = HyperCubeHarmonic2022

    • Author(s)
      Mannone, M., Yoshino, T., Chiu, P., Kitamura, Y.
    • Journal Title

      Proceedings of Mathematics and Computation in Music

      Volume: -

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Enabling Robot-assisted Motion Capture with Human Scale Tracking Optimization2021

    • Author(s)
      Chiu Pascal、Huang Jiawei、Kitamura Yoshifumi
    • Journal Title

      Proceedings of ACM Symposium on Virtual Reality Software and Technology (VRST)

      Volume: - Pages: 1-6

    • DOI

      10.1145/3489849.3489881

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Random-Forest-Based Initializer for Solving Inverse Problem in 3D Motion Tracking Systems2018

    • Author(s)
      Ryo Sugawara, Jiawei Huang, Kazuki Takashima, Taku Komura and Yoshifumi Kitamura
    • Journal Title

      Proceeding of the 24th ACM Symposium on Virtual Reality Software and Technology (VRST)

      Volume: Article 116 Pages: 1-2

    • DOI

      10.1145/3281505.3283393

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Cubeharmonic: A New Interface from a Magnetic 3D Motion Tracking System to Music Performance2018

    • Author(s)
      Mannnone Maria, Eri Kitamura, Jiawei Huang, Ryo Sugawara and Yoshifumi Kitamura
    • Journal Title

      Proceedings of the International Conference on New Interfaces for Musical Expression

      Volume: - Pages: 350-351

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Musical Combinatorics, Tonnetz, and the CubeHarmonic2018

    • Author(s)
      M. Mannone, E. Kitamura, J. Huang, R. Sugawara, and Y. Kitamura
    • Journal Title

      Journal of Collected papers of Academy of Arts

      Volume: Sixth Issue Pages: 104-116

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Presentation] Designing Interactive Content with Digital and Physical Artifacts2019

    • Author(s)
      Yoshifumi Kitamura
    • Organizer
      6th International Conference on Networking, Systems and Security
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Random-Forest-Based Initializer for Real-time Optimization-based 3D Motion Tracking Problems2019

    • Author(s)
      Jiawei Huang, Ryo Sugawara, Taku Komura, and Yoshifumi Kitamura
    • Organizer
      ICAT-EGVE 2019 - International Conference on Artificial Reality and Telexistence and Eurographics Symposium on Virtual Environments
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] CubeHarmonic: A New Musical Instrument Based on Rubik’s Cube with Embedded Motion Sensor2019

    • Author(s)
      Maria Mannone, Eri Kitamura, Jiawei Huang, Ryo Sugawara, Pascal Chiu, and Yoshifumi Kitamura
    • Organizer
      ACM SIGGRAPH 2019 Poster
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] FreeMo: Extending Hand Tracking Experiences Through Capture Volume and User Freedom2019

    • Author(s)
      Pascal Chiu, Isamu Endo, Kazuki Takashima, Kazuyuki Fujita, Yoshifumi Kitamura
    • Organizer
      SIGGRAPH Asia 2019 XR
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Pursuit Sensing: Extending Hand Tracking Space in Mobile VR Applications2019

    • Author(s)
      Pascal Chiu, Kazuki Takashima, Kazuyuki Fujita, Yoshifumi Kitamura
    • Organizer
      ACM Symposium on Spatial User Interaction
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Interacting with 3D Images on a Rear-projection Tabletop 3D Display Using Wireless Magnetic Markers and an Annular Coil Array2019

    • Author(s)
      Ryo Sugawara, Yoshifumi Kitamura, Jiawei Huang and Shunsuke Yoshida
    • Organizer
      Proceeding of IEEE Conference on Virtual Reality and 3D User Interfaces 2019
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 磁気式モーションセンサと CNN を用いたオクルージョンに強い非グローブ型手形状・位置・姿勢推定手法2018

    • Author(s)
      菅原 諒, 黄 佳維, 高嶋 和毅, 北村 喜文
    • Organizer
      第 23 回日本バーチャルリアリティ学会大会論文集
    • Related Report
      2018 Annual Research Report

URL: 

Published: 2018-04-23   Modified: 2023-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi