• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Extraction and visualization of the important features of motions by experts for supporting training of motion forms.

Research Project

Project/Area Number 15H02704
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Multimedia database
Research InstitutionKyushu Institute of Technology

Principal Investigator

Oshita Masaki  九州工業大学, 大学院情報工学研究院, 准教授 (20363400)

Co-Investigator(Kenkyū-buntansha) 向井 智彦  首都大学東京, システムデザイン研究科, 准教授 (10432296)
栗山 繁  豊橋技術科学大学, 工学(系)研究科(研究院), 教授 (20264939)
Project Period (FY) 2015-04-01 – 2020-03-31
Project Status Completed (Fiscal Year 2019)
Budget Amount *help
¥18,070,000 (Direct Cost: ¥13,900,000、Indirect Cost: ¥4,170,000)
Fiscal Year 2019: ¥3,510,000 (Direct Cost: ¥2,700,000、Indirect Cost: ¥810,000)
Fiscal Year 2018: ¥3,380,000 (Direct Cost: ¥2,600,000、Indirect Cost: ¥780,000)
Fiscal Year 2017: ¥3,380,000 (Direct Cost: ¥2,600,000、Indirect Cost: ¥780,000)
Fiscal Year 2016: ¥3,640,000 (Direct Cost: ¥2,800,000、Indirect Cost: ¥840,000)
Fiscal Year 2015: ¥4,160,000 (Direct Cost: ¥3,200,000、Indirect Cost: ¥960,000)
Keywords動作解析・評価 / 機械学習 / 可視化
Outline of Final Research Achievements

The purpose of this research was to extract the important features of motions by experts such as athletes, dancers, and craftsmen in order to utilize them for novices to learn how to move like experts. We had developed various methods for computation of kinematics motions features, selection of important motion features by applying machine learning, construction of statistical models of motion features and their relationships, visualization of spatial ranges of motions, visualization of the difference between the motion model and an input motion, and generation and deformation of motions of experts by several approaches such as deep learning, optimization, and motion interpolation. Based on these methods, we had developed a prototype of motion training for testis shot forms and evaluated the effectiveness of our system through a user study.

Academic Significance and Societal Importance of the Research Achievements

本研究の成果により、熟練者の動作データの特徴を抽出して可視化したり、練習者の動作との差異を可視化したりすることで、初心者が熟練者の動作を効率的に習得することができるシステムを実現できた。感覚的なものであり具体的に伝えることが難しいと言われていた熟練者の動作のコツを、情報工学的なアプローチで扱えることを明らかにできた。また、本研究の成果である、深層学習・最適化問題・動作補間の複数のアプローチによる熟練者の動作の生成・変形手法は、一般的なアニメーション制作にも応用が期待できる。

Report

(6 results)
  • 2019 Annual Research Report   Final Research Report ( PDF )
  • 2018 Annual Research Report
  • 2017 Annual Research Report
  • 2016 Annual Research Report
  • 2015 Annual Research Report
  • Research Products

    (45 results)

All 2019 2018 2017 2016 2015

All Journal Article (8 results) (of which Peer Reviewed: 8 results,  Open Access: 1 results,  Acknowledgement Compliant: 3 results) Presentation (36 results) (of which Int'l Joint Research: 16 results,  Invited: 2 results) Book (1 results)

  • [Journal Article] Development and Evaluation of a Self-Training System for Tennis Shots with Motion Feature Assessment and Visualization2019

    • Author(s)
      Masaki Oshita, Takumi Inao, Shunsuke Ineno, Tomohiko Mukai, Shigeru Kuriyama
    • Journal Title

      The Visual Computer

      Volume: 35 (11) Issue: 11 Pages: 1517-1529

    • DOI

      10.1007/s00371-019-01662-1

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Agent Navigation Using Deep Learning with Agent Space Heat Map for Crowd Simulation2019

    • Author(s)
      Masaki Oshita
    • Journal Title

      Computer Animation and Virtual Worlds

      Volume: 30 (3-4) Issue: 3-4 Pages: 1-12

    • DOI

      10.1002/cav.1878

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 深層学習に基づく人物モーションの生成と編集2018

    • Author(s)
      木佐省吾, 栗山 繁, 向井智彦
    • Journal Title

      画像電子学会誌

      Volume: 47 (4) Pages: 440-446

    • NAID

      130007947564

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Sampling-based Rig Conversion into Non-rigid Helper Bones2018

    • Author(s)
      Tomohiko Mukai
    • Journal Title

      Proceedings of the ACM on Computer Graphics and Interactive Techniques

      Volume: 1 Issue: 1 Pages: 1-17

    • DOI

      10.1145/3203190

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Motion Interpolation Using Adjectives and Motion Features2017

    • Author(s)
      Masaki Oshita, Aoi Honda, Maho Katsurada, Yuya Aosaki
    • Journal Title

      The Journal of the Society for Art and Science

      Volume: 16 Pages: 138-153

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Generating Hand Motion from Body Motion Based on Hand Pose Estimation2016

    • Author(s)
      Masaki Oshita, Yuta Senju
    • Journal Title

      Computer Animation and Virtual Worlds

      Volume: 未定 Issue: 6 Pages: 8-8

    • DOI

      10.1002/cav.1730

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Efficient Dynamic Skinning with Low-Rank Helper Bone Controllers2016

    • Author(s)
      Tomohiko Mukai and Shigeru Kuriyama
    • Journal Title

      ACM Transactions on Graphics

      Volume: 35 Issue: 4 Pages: 1-11

    • DOI

      10.1145/2897824.2925905

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Character Motion Synthesis by Principal Component Analysis and Motion Control Interface by Hands2015

    • Author(s)
      Masaki Oshita, Hayato Oshima, Yuta Senju, Syun Morishige
    • Journal Title

      Computer Animation and Virtual Worlds

      Volume: N/A Issue: 6 Pages: 14-14

    • DOI

      10.1002/cav.1673

    • Related Report
      2015 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Presentation] Motion Volume: Visualization of Human Motion Manifolds2019

    • Author(s)
      Masaki Oshita
    • Organizer
      17th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry (VRCAI 2019)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Motion Adaptation with Cascaded Inequality Tasks2019

    • Author(s)
      Tomohiko Mukai, Shigeru Kuriyama, Masaki Oshita
    • Organizer
      12th ACM SIGGRAPH Conference on Motion, Interaction and Games (MIG 2019)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A Tangible Interface Using 3D Printed Figures for Searching for Combat Motions of Two Characters2019

    • Author(s)
      Kouhei Hino, Masaki Oshita
    • Organizer
      International Conference on Cyberworlds 2019
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] RNNを用いたデータ駆動型モーションリターゲット2019

    • Author(s)
      出口 風人, 遠藤 結城, 栗山 繁
    • Organizer
      第18回情報科学技術フォーラム
    • Related Report
      2019 Annual Research Report
  • [Presentation] 人の関節回転角系列からの身体中心位置の推定2019

    • Author(s)
      木佐 省吾, 遠藤 結城, 栗山 繁
    • Organizer
      第18回情報科学技術フォーラム
    • Related Report
      2019 Annual Research Report
  • [Presentation] 人の姿勢系列情報からの身体中心位置の推定2019

    • Author(s)
      木佐 省吾, 遠藤 結城, 栗山 繁
    • Organizer
      Visual Computing 2019(ポスター発表)
    • Related Report
      2019 Annual Research Report
  • [Presentation] 縦続型二次計画法を用いた動作変形とその応用2019

    • Author(s)
      向井 智彦, 栗山 繁, 尾下 真樹
    • Organizer
      Visual Computing 2019(ポスター発表)
    • Related Report
      2019 Annual Research Report
  • [Presentation] 編集履歴の半教師あり学習によるモーションデータの品質判定2019

    • Author(s)
      渡邉 俊綱, 向井 智彦, 熱田 清明
    • Organizer
      情報処理学会第81回全国大会
    • Related Report
      2018 Annual Research Report
  • [Presentation] 3次元キャラクタモーション制作履歴データ事例に対する一検討2019

    • Author(s)
      大森 葵, 向井 智彦, 安藤 大地
    • Organizer
      インタラクション2019
    • Related Report
      2018 Annual Research Report
  • [Presentation] Self-Training System for Tennis Shots with Motion Feature Assessment and Visualization2018

    • Author(s)
      Masaki Oshita, Takumi Inao, Tomohiko Mukai, Shigeru Kuriyama
    • Organizer
      International Conference on Cyberworlds 2018
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 深層学習と周辺状況画像を用いた群集シミュレーションのためのエージェント移動制御2018

    • Author(s)
      尾下 真樹
    • Organizer
      Visual Computing 2018
    • Related Report
      2018 Annual Research Report
  • [Presentation] Deep Compact Motion Manifold に基づくモーションの生成と編集2018

    • Author(s)
      木佐省吾, 栗山 繁, 向井智彦
    • Organizer
      Visual Computing 2018
    • Related Report
      2018 Annual Research Report
  • [Presentation] 編集履歴データの学習によるモーションデータの主観的品質判定の模倣2018

    • Author(s)
      渡邉 俊綱, 向井 智彦
    • Organizer
      情報処理学会 第80回全国大会(学生奨励賞)
    • Related Report
      2017 Annual Research Report
  • [Presentation] Crowd Simulation Using Deep Leaning and Agent Space Heat Maps2017

    • Author(s)
      Masaki Oshita, Yasutaka Honda
    • Organizer
      ACM SIGGRAPH ASIA Workshop: Data-Driven Animation Techniques (D2AT) 2017
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Lattice-Guided Human Motion Deformation for Collision Avoidance2017

    • Author(s)
      Masaki Oshita
    • Organizer
      International Conference on Motion in Games 2017
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Expressive Human Pose Deformation Based on the Rules of Attractive Poses2017

    • Author(s)
      Masaki Oshita, Kei Yamamura, Aoi Honda
    • Organizer
      6th EAI International Conference: ArtsIT, Interactivity & Game Creation (ArtsIT 2017)
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Finding Rules of Attractive Human Poses Using Decision Tree and Generating Novel Attractive Poses2017

    • Author(s)
      Masaki Oshita, Kei Yamamura, Aoi Honda
    • Organizer
      Computer Graphics International 2017
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 動的線形システムに基づく動作生成の入力成分推定2017

    • Author(s)
      寺門修平, 栗山繁
    • Organizer
      情報処理学会 CG・DCC・CVIM合同研究発表会
    • Related Report
      2017 Annual Research Report
  • [Presentation] モーションキャプチャによるアーチェリーフォームの分析2017

    • Author(s)
      宮内肇, 栗山繁
    • Organizer
      電気学会 基礎・材料・共通部門大会
    • Related Report
      2017 Annual Research Report
  • [Presentation] テニスサーブにおける身体特徴量の実時間可視化システムの検討2017

    • Author(s)
      渡邉 俊綱, 梅澤 俊二, 向井 智彦
    • Organizer
      情報処理学会 コンピュータグラフィックスとビジュアル情報学研究報告
    • Place of Presentation
      東京
    • Related Report
      2016 Annual Research Report
  • [Presentation] Making Decision for the Next Step in Dense Crowd Simulation Using Support Vector Machines2016

    • Author(s)
      Shamsul Mohamad, Masaki Oshita, Tsukasa Noma, Mohd Shahrizal Sunar, Fawwaz Mohd Nasir, Kunio Yamamota, Yusutaka Honda
    • Organizer
      15th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry (VRCAI 2016)
    • Place of Presentation
      Zhuhai, China
    • Year and Date
      2016-12-03
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Simulating Group Formation and Behaviour in Dense Crowd2016

    • Author(s)
      Fawwaz Mohd Nasir, Tsukasa Noma, Masaki Oshita, Kunio Yamamoto, Mohd Shahrizal Sunar, Shamsul Mohamad, Yasutaka Honda
    • Organizer
      15th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry (VRCAI 2016)
    • Place of Presentation
      Zhuhai, China
    • Year and Date
      2016-12-03
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] モーションキャプチャを用いたスポーツフォーム練習のための特徴量・可視化手法の検討2016

    • Author(s)
      稲尾 拓海,尾下 真樹,向井 智彦,栗山 繁
    • Organizer
      情報処理学会研究報告 コンピュータグラフィックスとビジュアル情報学 第165回
    • Place of Presentation
      福岡
    • Year and Date
      2016-11-09
    • Related Report
      2016 Annual Research Report
  • [Presentation] モーションキャプチャを用いたスポーツフォーム練習のための特徴量・可視化手法の検討2016

    • Author(s)
      稲尾 拓海,尾下 真樹,向井 智彦,栗山 繁
    • Organizer
      ビジュアルコンピューティングワークショップ 2016
    • Place of Presentation
      沖縄
    • Year and Date
      2016-10-09
    • Related Report
      2016 Annual Research Report
  • [Presentation] 位相振動子適用のためのアーチェリーフォーム三次元分析2016

    • Author(s)
      田中大地, 宮内肇, 栗山繁
    • Organizer
      電気学会基礎・材料・共通部門大会
    • Place of Presentation
      福岡
    • Year and Date
      2016-09-05
    • Related Report
      2016 Annual Research Report
  • [Presentation] Motion Interpolation Using Adjectives2016

    • Author(s)
      Masaki Oshita, Maho Katsurada, Aoi Honda
    • Organizer
      NICOGRAPH Internaional 2016
    • Place of Presentation
      Hangzhou, China
    • Year and Date
      2016-06-06
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] モーションキャプチャを通じた舞踊技能の可視化システム開発2016

    • Author(s)
      向井智彦
    • Organizer
      秋田大学民俗芸能情報技術研究所シンポジウム
    • Place of Presentation
      秋田
    • Year and Date
      2016-03-05
    • Related Report
      2015 Annual Research Report
    • Invited
  • [Presentation] モーションデータの合成のための形容詞を用いた直感的なインターフェースの提案2016

    • Author(s)
      桂田 真歩, 本田 あおい, 尾下 真樹
    • Organizer
      画像電子学会 第276回研究会 講演予稿集
    • Place of Presentation
      福岡
    • Year and Date
      2016-03-03
    • Related Report
      2015 Annual Research Report
  • [Presentation] アーチェリー射形可視化のための弓曳童子の開発2016

    • Author(s)
      田中大地, 宮内肇, 栗山繁
    • Organizer
      電気・情報関連学会中国支部連合大会
    • Place of Presentation
      広島
    • Related Report
      2016 Annual Research Report
  • [Presentation] Towards Development of Sports Training System Using Kinect2015

    • Author(s)
      Takumi Inao, Masaki Oshita, Tomohiko Mukai, Shigeru Kuriyama
    • Organizer
      3rd International Symposium on Applied Engineering and Sciences (SAES 2015)
    • Place of Presentation
      Selangor, Malaysia
    • Year and Date
      2015-11-23
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Making Character Animations by Utilizing Motion Capture Data2015

    • Author(s)
      Masaki Oshita
    • Organizer
      3rd International Symposium on Applied Engineering and Sciences (SAES 2015)
    • Place of Presentation
      Selangor, Malaysia
    • Year and Date
      2015-11-23
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Visualization of Motion Features for Sports Training System Using Kinect2015

    • Author(s)
      Takumi Inao, Masaki Oshita, Tomohiko Mukai, Shigeru Kuriyama
    • Organizer
      14th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry (VRCAI 2015)
    • Place of Presentation
      Kobe, Japan
    • Year and Date
      2015-10-30
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Key Pose Deformations in Changing the 3D Character Motion Style2015

    • Author(s)
      Ismahafezi Ismail, Masaki Oshita, Mohd Shahrizal Sunar
    • Organizer
      14th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry (VRCAI 2015)
    • Place of Presentation
      Kobe, Japan
    • Year and Date
      2015-10-30
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 統計解析を用いた熟練運動技能特徴の可視化に向けて2015

    • Author(s)
      向井智彦
    • Organizer
      情報処理学会人文科学とコンピュータ研究会
    • Place of Presentation
      京都
    • Year and Date
      2015-10-24
    • Related Report
      2015 Annual Research Report
  • [Presentation] Garment Design System Based on Body Model2015

    • Author(s)
      Masaki Oshita, Syouma Yamanaka
    • Organizer
      International Conference on Cyberworlds 2015
    • Place of Presentation
      Gotland, Sweden
    • Year and Date
      2015-10-07
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 身体動作データの統計解析による熟練技能の可視化に向けて2015

    • Author(s)
      向井智彦
    • Organizer
      「モーションキャプチャ技術と身体動作処理」シンポジウム
    • Place of Presentation
      東京
    • Year and Date
      2015-07-17
    • Related Report
      2015 Annual Research Report
    • Invited
  • [Book] Proceedings of the 14th ACM SIGGRAPH International Conference on Virtual Reality Continuum and its Applications in Industry (VRCAI 2015)2015

    • Author(s)
      Issei Fujishiro, Zhigeng Pan, Nadia Magnenat-Thalmann, Masaki Oshita, Xubo Yang, Hyun Seung Yang and Stephen N. Spencer (共同編集)
    • Total Pages
      104
    • Publisher
      ACM Digital Library
    • Related Report
      2015 Annual Research Report

URL: 

Published: 2015-04-16   Modified: 2022-11-04  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi