• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Full automatic 3D sport analysis based on video sensing

Research Project

Project/Area Number 16K13006
Research Category

Grant-in-Aid for Challenging Exploratory Research

Allocation TypeMulti-year Fund
Research Field Sports science
Research InstitutionWaseda University

Principal Investigator

Ikenaga Takeshi  早稲田大学, 理工学術院(情報生産システム研究科・センター), 教授 (90367178)

Research Collaborator CHENG Xina  
HONDA Masaaki  
IKOMA Norikazu  
Project Period (FY) 2016-04-01 – 2019-03-31
Project Status Completed (Fiscal Year 2018)
Budget Amount *help
¥3,640,000 (Direct Cost: ¥2,800,000、Indirect Cost: ¥840,000)
Fiscal Year 2018: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Fiscal Year 2017: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Fiscal Year 2016: ¥910,000 (Direct Cost: ¥700,000、Indirect Cost: ¥210,000)
Keywordsスポーツ解析 / 映像認識 / 実時間画像処理 / 物体追跡 / パーティクルフィルター / パーティクルフィルタ / 映像処理 / 3次元解析 / 実時間処理 / GPU / 動作検出 / 画像認識
Outline of Final Research Achievements

The purpose of this research is to implement a full-automatic 3D sports analysis system from multiple high-definition video cameras for advanced game strategies based on analysis data and TV sports broadcasting. By creating various technologies based on abrupt motion feature and spatial importance in Volleyball analysis, 3D position and velocity of a ball and twelve players are obtained in video rate (60fps) with an accuracy of 99% or more. In addition, we confirm that the event data on what play (e.g. receive, toss, spikes) has been made and the strategy data to decide the play efficacy (e.g. the number of available attackers and blockers, the attack tempo, the attack type, the set zone) are obtained automatically with 92%-100% accuracy.

Academic Significance and Societal Importance of the Research Achievements

実試合に適用可能な高精度な完全自動3次元スポーツ解析技術により、あらゆるバレーボール試合の多様な解析データが人手を介さず簡易に取得可能となる。これにより、バレーボール戦略の構築に、従来にない全く新しい手段を提供できることになり、スポーツ科学の世界に新たな可能性とインパクトを与えるものと思われる。さらに、実際に、ナショナルチーム等と協力しながら、オリンピック等の国際試合のメダル等の結果につなげていくことにより、社会的にも大きなインパクトを示せる。さらに本提案で検討・実現した各種3次元情報取得の基盤技術は、将来的に卓球、テニスなど幅広いスポーツに展開でき、将来のスポーツ産業への貢献も期待できる。

Report

(4 results)
  • 2018 Annual Research Report   Final Research Report ( PDF )
  • 2017 Research-status Report
  • 2016 Research-status Report
  • Research Products

    (34 results)

All 2018 2017 2016 Other

All Int'l Joint Research (2 results) Journal Article (11 results) (of which Peer Reviewed: 5 results,  Open Access: 6 results,  Acknowledgement Compliant: 2 results) Presentation (19 results) (of which Int'l Joint Research: 19 results) Remarks (2 results)

  • [Int'l Joint Research] Nanjing University(China)

    • Related Report
      2017 Research-status Report
  • [Int'l Joint Research] 南京大学(中国)

    • Related Report
      2016 Research-status Report
  • [Journal Article] View Priority Based Threads Allocation and Binary Search Oriented Reweight for GPU Accelerated Real-Time 3D Ball Tracking2018

    • Author(s)
      HOU Yilin、DENG Ziwei、CHENG Xina、IKENAGA Takeshi
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E101.D Issue: 12 Pages: 3190-3198

    • DOI

      10.1587/transinf.2018EDP7125

    • NAID

      130007539288

    • ISSN
      0916-8532, 1745-1361
    • Year and Date
      2018-12-01
    • Related Report
      2018 Annual Research Report
  • [Journal Article] Court-Divisional Team Motion and Player Performance Curve Based Automatic Game Strategy Data Acquisition for Volleyball Analysis2018

    • Author(s)
      CHENG Xina、IKENAGA Takeshi
    • Journal Title

      IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences

      Volume: E101.A Issue: 11 Pages: 1756-1765

    • DOI

      10.1587/transfun.E101.A.1756

    • NAID

      130007502853

    • ISSN
      0916-8508, 1745-1337
    • Year and Date
      2018-11-01
    • Related Report
      2018 Annual Research Report
  • [Journal Article] Hierarchical Progressive Trust Model for Mismatch Removal under Both Rigid and Non-Rigid Transformations2018

    • Author(s)
      DU Songlin、IKENAGA Takeshi
    • Journal Title

      IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences

      Volume: E101.A Issue: 11 Pages: 1786-1794

    • DOI

      10.1587/transfun.E101.A.1786

    • NAID

      130007503059

    • ISSN
      0916-8508, 1745-1337
    • Year and Date
      2018-11-01
    • Related Report
      2018 Annual Research Report
  • [Journal Article] Pixel Selection and Intensity Directed Symmetry for High Frame Rate and Ultra-Low Delay Matching System2018

    • Author(s)
      HU Tingting、IKENAGA Takeshi
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E101.D Issue: 5 Pages: 1260-1269

    • DOI

      10.1587/transinf.2017MVP0012

    • NAID

      130006729775

    • ISSN
      0916-8532, 1745-1361
    • Year and Date
      2018-05-01
    • Related Report
      2018 Annual Research Report
  • [Journal Article] Multi-Peak Estimation for Real-Time 3D Ping-Pong Ball Tracking with Double-Queue Based GPU Acceleration2018

    • Author(s)
      DENG Ziwei、HOU Yilin、CHENG Xina、IKENAGA Takeshi
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E101.D Issue: 5 Pages: 1251-1259

    • DOI

      10.1587/transinf.2017MVP0010

    • NAID

      130006729776

    • ISSN
      0916-8532, 1745-1361
    • Year and Date
      2018-05-01
    • Related Report
      2018 Annual Research Report
  • [Journal Article] Multi-View 3D Ball Tracking with Abrupt Motion Adaptive System Model, Anti-Occlusion Observation and Spatial Density Based Recovery in Sports Analysis2017

    • Author(s)
      Xina Cheng, Norikazu Ikoma, Masaaki Honda, Takeshi Ikenaga
    • Journal Title

      IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences

      Volume: E100.A Issue: 5 Pages: 1215-1225

    • DOI

      10.1587/transfun.E100.A.1215

    • NAID

      130005631410

    • ISSN
      0916-8508, 1745-1337
    • Related Report
      2017 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] AIGIF: Adaptively Integrated Gradient and Intensity Feature for Robust and Low-Dimensional Description of Local Keypoint2017

    • Author(s)
      Songlin Du, Takeshi Ikenaga
    • Journal Title

      IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences

      Volume: E100.A Issue: 11 Pages: 2275-2284

    • DOI

      10.1587/transfun.E100.A.2275

    • NAID

      130006191370

    • ISSN
      0916-8508, 1745-1337
    • Related Report
      2017 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Robust Ghost-Free High-Dynamic-Range Imaging by Visual Salience Based Bilateral Motion Detection and Stack Extension Based Exposure Fusion2017

    • Author(s)
      Zijie Wang, Qin Liu, Takeshi Ikenaga
    • Journal Title

      IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences

      Volume: E100.A Issue: 11 Pages: 2266-2274

    • DOI

      10.1587/transfun.E100.A.2266

    • NAID

      130006191369

    • ISSN
      0916-8508, 1745-1337
    • Related Report
      2017 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Player Feature Based Multi-Likelihood and Spatial Relationship Based Multi-View Elimination with Least Square Fitting Prediction for Volleyball Players Tracking in 3D Space2016

    • Author(s)
      Shuyi Huang, Xizhou Zhuang, Xina Cheng, Norikazu Ikoma, Masaaki Honda and Takeshi Ikenaga
    • Journal Title

      IIEEJ Trans. on Image Electronics and Visual Computing

      Volume: Vol. 4, No. 2 Pages: 145-155

    • NAID

      40021142764

    • Related Report
      2016 Research-status Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] センシング技術を用いたスポーツ情報解析2016

    • Author(s)
      誉田雅彰、池永 剛
    • Journal Title

      情報処理

      Volume: Vol. 57, No. 8 Pages: 1937-1946

    • NAID

      40020914146

    • Related Report
      2016 Research-status Report
    • Open Access
  • [Journal Article] 身体の動作軌跡のクラスタ化に基づく特徴量を用いたバレーボールの動作検出2016

    • Author(s)
      久保田栄次郎、鈴木貴大、誉田雅彰、池永 剛
    • Journal Title

      画像電子学会誌

      Volume: Vol. 45, No. 3 Pages: 373-381

    • NAID

      130007793119

    • Related Report
      2016 Research-status Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Presentation] Model Selection Based Parallel Prediction and Image-Trajectory-Independent Estimation for Real-Time Ball Data Acquisition in Volleyball2018

    • Author(s)
      Xina Cheng, Takeshi Ikenaga
    • Organizer
      IEEE International Symposium on Intelligent Signal Processing and Communication Systems 2018 (ISPACS2018)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Mutual-Information-Graph Regularized Sparse Transform for Unsupervised Feature Learning2018

    • Author(s)
      Songlin Du, Takeshi Ikenaga
    • Organizer
      IEEE International Symposium on Intelligent Signal Processing and Communication Systems 2018 (ISPACS2018)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Spatial Pixels Selection and Inter-frame Combined Likelihood Based Observation for 60fps 3D Tracking of Twelve Volleyball Players on GPU2018

    • Author(s)
      Yiming Zhao, Xina Cheng, Takeshi Ikenaga
    • Organizer
      Pacific-Rim Conference on Multimedia (PCM2018)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 3D Global Trajectory and Multi-view Local Motion Combined Player Action Recognition in Volleyball Analysis2018

    • Author(s)
      Yang Liu, Shuyi Huang, Xina Cheng, Takeshi Ikenaga
    • Organizer
      Pacific-Rim Conference on Multimedia (PCM2018)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Ball Motion State and Abrupt Pose Features based Player Qualitative Action Recognition for Volleyball Game Analysis2018

    • Author(s)
      Yang Liu, Xina Cheng, Takeshi Ikenaga
    • Organizer
      The 6th IIAE International Conference on Intelligent Systems and Image Processing (ICISIP2018)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Search-Free Gridding and Temporal Local Matching Based Observation for High Frame Rate and Ultra-Low Delay SLAM System2018

    • Author(s)
      Yuchen Yang, Songlin Du, Takeshi Ikenaga
    • Organizer
      The 6th IIAE International Conference on Intelligent Systems and Image Processing (ICISIP2018)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 3D Ball Motion and Relative Position Feature Based Real-time Start Scene Detection for Volleyball Game Analysis on GPU2018

    • Author(s)
      Guixing Liang, Xina Cheng, Takeshi Ikenaga
    • Organizer
      The 6th IIAE International Conference on Intelligent Systems and Image Processing (ICISIP2018)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Partial Descriptor Update and Isolated Point Avoidance Based Template Update for High Frame Rate and Ultra-Low Delay Deformation Matching2018

    • Author(s)
      Yuhao Xu, Tinting Hu, Songlin Du, Takeshi Ikenaga
    • Organizer
      24th International Conference on Pattern Recognition (ICPR 2018)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 3D Space Motion Dense Based Team Tactical Status Detection in Volleyball Game Analysis2018

    • Author(s)
      Xina Cheng, Takeshi Ikenaga
    • Organizer
      The 2nd International Conference on Digital Signal Processing (ICDSP 2018)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Real-time 3D Ball Tracking with CPU-GPU Acceleration Using Particle Filter with Multi-command queues and Stepped Parallelism Iteration2017

    • Author(s)
      Yilin Hou, Xina Cheng, Takeshi Ikenaga
    • Organizer
      Second International Conference on Multimedia and Image Processing (ICMIP 2017)
    • Place of Presentation
      Wuhan
    • Year and Date
      2017-03-17
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] Simultaneous Physical and Conceptual Ball State Estimation in Volleyball Game Analysis2017

    • Author(s)
      Xina Cheng, Norikazu Ikoma, Masaaki Honda and Takeshi Ikenaga
    • Organizer
      Visual Communications and Image Processing (VCIP2017)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Vectorized Data Combination and Binary Search Oriented Reweight for CPU-GPU Based Real-time 3D Ball Tracking2017

    • Author(s)
      Ziwei Deng, Yilin Hou, Xina Cheng, Takeshi Ikenaga
    • Organizer
      Pacific-Rim Conference on Multimedia (PCM2017)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Motion State Detection based Prediction Model for Body Parts Tracking of Volleyball Players2017

    • Author(s)
      Fanglu Xie, Xina Cheng, Takeshi Ikenaga
    • Organizer
      Pacific-Rim Conference on Multimedia (PCM2017)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Event State Based Particle Filter for Ball Event Detection in Volleyball Game Analysis2017

    • Author(s)
      Xina Cheng, Norikazu Ikoma, Masaaki Honda and Takeshi Ikenaga
    • Organizer
      20th International Conference on Information Fusion (Fusion 2017)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Racket Color Judgment Based Template Selection and Ellipse Shape Likelihood for 3D Racket Tracking in Ping-Pong2017

    • Author(s)
      Guannan Wu, Xina Cheng, Takeshi Ikenaga
    • Organizer
      The 32nd International Technical Conference on Circuits/Systems, Computers and Communications (ITC-CSCC2017)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Mixture Particle Filter with Block Jump Biomechanics Constraint for Volleyball Players Lower Body Parts Tracking2017

    • Author(s)
      Fanglu Xie, Xina Cheng, Takeshi Ikenaga
    • Organizer
      IAPR International Conference on Machine Vision Applications (MVA2017)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Ball-like Observation Model and Multi-peak Distribution Estimation Based Particle Filter for 3D Ping-pong Ball Tracking2017

    • Author(s)
      Ziwei Deng, Xina Cheng, Takeshi Ikenaga
    • Organizer
      IAPR International Conference on Machine Vision Applications (MVA2017)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Motion Prejudgment Dependent Mixture System Noise in System Model for Tennis Ball 3D Position Tracking by Particle Filter2016

    • Author(s)
      Yuan Wang, Xina Cheng, Norikazu Ikoma, Masaaki Honda, and Takeshi Ikenaga
    • Organizer
      Joint 8th International Conference on Soft Computing and Intelligent Systems and 17th International Symposium on Advanced Intelligent Systems (SCIS&ISIS2016)
    • Place of Presentation
      北海道
    • Year and Date
      2016-08-25
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] Relative Position Feature based Dense Trajectories with Density Adapted Noise Reduction for Tennis Player Action Recognition2016

    • Author(s)
      Zihan Ma, Shuyi Huang, Masaaki Honda, Takeshi Ikenaga
    • Organizer
      The 31st International Technical Conference on Circuits/Systems, Computers and Communications (ITC-CSCC2016)
    • Place of Presentation
      沖縄
    • Year and Date
      2016-07-10
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Remarks] Ikenaga laboratory research themes

    • URL

      http://www.waseda.jp/sem-ikenaga/content/research/research-E.htm

    • Related Report
      2018 Annual Research Report 2017 Research-status Report
  • [Remarks] Ikenaga laboratory publications

    • URL

      http://www.waseda.jp/sem-ikenaga/content/research/publications-E.htm

    • Related Report
      2018 Annual Research Report 2017 Research-status Report

URL: 

Published: 2016-04-21   Modified: 2020-03-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi