• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Establishment of a hierarchical behavior analysis method adapted to individuals by fusing big data and small data

Research Project

Project/Area Number 20K19568
Research Category

Grant-in-Aid for Early-Career Scientists

Allocation TypeMulti-year Fund
Review Section Basic Section 59020:Sports sciences-related
Research InstitutionUniversity of Fukui

Principal Investigator

Zhang Chao  福井大学, 学術研究院工学系部門, 講師 (70803419)

Project Period (FY) 2020-04-01 – 2023-03-31
Project Status Completed (Fiscal Year 2022)
Budget Amount *help
¥4,290,000 (Direct Cost: ¥3,300,000、Indirect Cost: ¥990,000)
Fiscal Year 2022: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2021: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2020: ¥1,950,000 (Direct Cost: ¥1,500,000、Indirect Cost: ¥450,000)
Keywords人物姿勢推定 / 深層学習 / ニューラルネットワーク / 人物動作分析 / 最適化 / 進化的計算 / 動作分析 / 機械学習
Outline of Research at the Start

近年,人工知能によるビッグデータの活用が急速に広まっている.しかし深層学習(人工ニューラルネットワークによる機械学習手法)では,情報量が僅かであるスモールデータを深く考察していく能力が欠けている.深層学習はビッグデータから人間の姿勢らしさや共通している姿勢パターンの情報を学習することで検出アルゴリズムの汎用性を高められるが,個人がもつ身長,体重,体型サイズ,視線など量が限られているスモールデータを学習することが困難である.この問題に対して,本研究では,最適化アルゴリズムを用いて,深層学習による骨格検出結果をスモールデータで最適化することで,それぞれのデータが持つ価値を融合することを目指す.

Outline of Final Research Achievements

Motion analysis by skeleton detection is an essential process for postural correction and motor function improvement in the field of sports science. Most existing image-based methods output two-dimensional results. However, when analyzing human 3D movements, it is considered that deep learning estimation results in images can not be directly applied. In the first year, we proposed a method for segmenting human body parts; in the second year, we proposed a method for predicting 3D human body motion from a single image; and in the third year, we mainly studied the prediction of future actions based on the 3D movements of individuals.

Academic Significance and Societal Importance of the Research Achievements

本研究では、ビッグ/スモールデータを融合することで「汎用性」と「専門性」が併存する動作解析手法の実現が可能になっている。特に、混合ニューラルネットワークを用いたデータ解析方法を3次元動作解析に適用することは学術的意義があるといえる。コンピュータビジョン分野の観点からみても、点群の利活用に意義がある。また、社会的意義として、本研究成果に基づくアドバイスシステムの構築により、高度な技術を有するスポーツ選手の育成プログラムの充実化が図れ、健康科学分野における運動機能の改善にも適用できると考えれられる。また、スポーツ科学のみならず、他分野における今後の動作分析・推定の足掛かりになると考える。

Report

(4 results)
  • 2022 Annual Research Report   Final Research Report ( PDF )
  • 2021 Research-status Report
  • 2020 Research-status Report
  • Research Products

    (39 results)

All 2023 2022 2021 2020 Other

All Int'l Joint Research (1 results) Journal Article (14 results) (of which Int'l Joint Research: 7 results,  Peer Reviewed: 14 results,  Open Access: 6 results) Presentation (23 results) (of which Int'l Joint Research: 15 results) Remarks (1 results)

  • [Int'l Joint Research] Deakin university(オーストラリア)

    • Related Report
      2020 Research-status Report
  • [Journal Article] PMSSC: Parallelizable multi-subset based self-expressive model for subspace clustering2023

    • Author(s)
      Hotta Katsuya、Akashi Takuya、Tokai Shogo、Zhang Chao
    • Journal Title

      Computational Visual Media

      Volume: 5 Issue: 3 Pages: 1-16

    • DOI

      10.1007/s41095-022-0293-5

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Learning to predict diverse human motions from a single image via mixture density networks2022

    • Author(s)
      Chunzhi Gu、Yan Zhao、Chao Zhang
    • Journal Title

      Knowledge-Based Systems

      Volume: 253 Pages: 109549-109549

    • DOI

      10.1016/j.knosys.2022.109549

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Example-based color transfer with Gaussian mixture modeling2022

    • Author(s)
      Gu Chunzhi、Lu Xuequan、Zhang Chao
    • Journal Title

      Pattern Recognition

      Volume: 129 Pages: 108716-108716

    • DOI

      10.1016/j.patcog.2022.108716

    • Related Report
      2021 Research-status Report
    • Peer Reviewed
  • [Journal Article] DS-SRI: Diversity Similarity Measure against Scaling, Rotation and Illumination Change for Robust Template Matching2022

    • Author(s)
      Yi Zhang, Chao Zhang, Takuya Akashi
    • Journal Title

      IET Image Processing

      Volume: -

    • Related Report
      2021 Research-status Report
    • Peer Reviewed
  • [Journal Article] Component‐based nearest neighbour subspace clustering2022

    • Author(s)
      Hotta Katsuya、Xie Haoran、Zhang Chao
    • Journal Title

      IET Image Processing

      Volume: - Issue: 10 Pages: 2697-2708

    • DOI

      10.1049/ipr2.12518

    • Related Report
      2021 Research-status Report
    • Peer Reviewed
  • [Journal Article] Image Deformation Estimation via Multi-Objective Optimization2022

    • Author(s)
      Takumi Nakane、Haoran Xie、Chao Zhang
    • Journal Title

      IEEE ACCESS

      Volume: -

    • Related Report
      2021 Research-status Report
    • Peer Reviewed
  • [Journal Article] PMSSC: Parallelizable Multi-Subset based Self-Expressive Model for Subspace Clustering2022

    • Author(s)
      Katsuya Hotta、Takuya Akashi、Shogo Tokai、Chao Zhang
    • Journal Title

      Computational Visual Media

      Volume: -

    • Related Report
      2021 Research-status Report
    • Peer Reviewed
  • [Journal Article] Non-Local Search via Energy Minimization for Visual Tracking2021

    • Author(s)
      堀田 克哉、東海 彰吾、張 潮
    • Journal Title

      電子情報通信学会論文誌D 情報・システム

      Volume: J104-D Issue: 5 Pages: 508-520

    • DOI

      10.14923/transinfj.2020JDP7067

    • ISSN
      1880-4535, 1881-0225
    • Year and Date
      2021-05-01
    • Related Report
      2020 Research-status Report
    • Peer Reviewed
  • [Journal Article] Blur Removal Via Blurred-Noisy Image Pair2021

    • Author(s)
      Gu Chunzhi、Lu Xuequan、He Ying、Zhang Chao
    • Journal Title

      IEEE Transactions on Image Processing

      Volume: 30 Pages: 345-359

    • DOI

      10.1109/tip.2020.3036745

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] CGMVAE: Coupling GMM Prior and GMM Estimator for Unsupervised Clustering and Disentanglement2021

    • Author(s)
      Chunzhi Gu、Haoran Xie、Xuequan Lu、Chao Zhang
    • Journal Title

      IEEE Access

      Volume: -

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Application of evolutionary and swarm optimization in computer vision: a literature survey2020

    • Author(s)
      Nakane Takumi、Bold Naranchimeg、Sun Haitian、Lu Xuequan、Akashi Takuya、Zhang Chao
    • Journal Title

      IPSJ Transactions on Computer Vision and Applications

      Volume: 12 Issue: 1 Pages: 1-34

    • DOI

      10.1186/s41074-020-00065-9

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] A Search History-Driven Offspring Generation Method for the Real-Coded Genetic Algorithm2020

    • Author(s)
      Nakane Takumi、Lu Xuequan、Zhang Chao
    • Journal Title

      Computational Intelligence and Neuroscience

      Volume: 2020 Pages: 1-20

    • DOI

      10.1155/2020/8835852

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Blur-Countering Keypoint Detection via Eigenvalue Asymmetry2020

    • Author(s)
      Zhang Chao、Lu Xuequan、Akashi Takuya
    • Journal Title

      IEEE Access

      Volume: 8 Pages: 159077-159088

    • DOI

      10.1109/access.2020.3020561

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] G2MF-WA: Geometric Multi-Model Fitting with Weakly Annotated Data2020

    • Author(s)
      Chao Zhang, Xuequan Lu, Katsuya Hotta, Xi Yang
    • Journal Title

      Computational Visual Media

      Volume: 2 Issue: 2 Pages: 1-11

    • DOI

      10.1007/s41095-020-0166-8

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Presentation] Improving Helmet-Wearing Detection with Human Detection2023

    • Author(s)
      Chao Zhang, Hiroshi Kawashima, Jun Yu, Chunzhi Gu
    • Organizer
      NICOGRAPH International 2023
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A Lightness-Aware Nearest Neighbor Search Method for Exampled-Based Color Transfer2022

    • Author(s)
      Chunzhi Gu, Chao Zhang
    • Organizer
      IEEE 11th Global Conference on Consumer Electronics (GCCE)
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Learning Self-Expressive Representations via Nearest Subspace Model for Motion Segmentation2022

    • Author(s)
      Ryusuke Takada, Katsuya Hotta, Chao Zhang
    • Organizer
      IEEE 11th Global Conference on Consumer Electronics (GCCE)
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Student-Teacher Anomaly Detection Considering Knowledge Consistency Between Layer Groups2022

    • Author(s)
      Kohei Nakazawa, Katsuya Hotta, Jun Yu, Chao Zhang
    • Organizer
      IEEE 11th Global Conference on Consumer Electronics (GCCE)
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] データ拡張に基づく知識蒸留を用いた人体点群セグメンテーション2022

    • Author(s)
      上島拓真,堀田克哉,余俊,張潮
    • Organizer
      Vision Engineering Workshop (ViEW)
    • Related Report
      2022 Annual Research Report
  • [Presentation] Raspberry PiにおけるTeacher-Student Networkを用いた画像異常検知の性能調査2022

    • Author(s)
      金子萌,堀田克哉,中澤航平,張潮
    • Organizer
      Vision Engineering Workshop (ViEW)
    • Related Report
      2022 Annual Research Report
  • [Presentation] 人物検出によるヘルメット位置の再特定2022

    • Author(s)
      川島博,顧淳祉,余俊,張潮
    • Organizer
      Vision Engineering Workshop (ViEW)
    • Related Report
      2022 Annual Research Report
  • [Presentation] Diversity-Promoting Human Motion Interpolation via Conditional Variational Auto-Encoder2022

    • Author(s)
      Chunzhi Gu, Shuofeng Zhao, Chao Zhang
    • Organizer
      International Workshop on Advanced Image Technology (IWAIT)
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Measuring Speaking Time from Privacy-Preserving Videos2022

    • Author(s)
      Shun Maeda, Chunzhi Gu, Chao Zhang
    • Organizer
      International Workshop on Advanced Image Technology (IWAIT)
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Template Matching via Search History Driven Genetic Algorithm2022

    • Author(s)
      Takumi Nakane, Takuya Akashi, Chao Zhang
    • Organizer
      International Workshop on Advanced Image Technology (IWAIT)
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] 多目的進化的最適化における動的代理モデルの導入に関する検討2022

    • Author(s)
      宮村 大輝,中根 拓未,余 俊,張潮
    • Organizer
      第21回進化計算研究会
    • Related Report
      2021 Research-status Report
  • [Presentation] 視聴覚情報に基づくクラスタリングにおける初期値設定法の違いによる性能比較2022

    • Author(s)
      前田 駿,顧 淳祉,張 潮
    • Organizer
      動的画像処理実利用化ワークショップ(DIA2022)
    • Related Report
      2021 Research-status Report
  • [Presentation] 局所部分空間モデルを伴う疎な部分空間クラスタリング2022

    • Author(s)
      高田隆佑,堀田克哉 ,張 潮
    • Organizer
      動的画像処理実利用化ワークショップ(DIA2022)
    • Related Report
      2021 Research-status Report
  • [Presentation] Affine Subspace Clustering with Nearest Subspace Neighbor2021

    • Author(s)
      Katsuya Hotta, Haoran Xie, Chao Zhang
    • Organizer
      International Workshop on Advanced Image Technology (IWAIT)
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] Illumination Robust Template Matching based on Nearest-Neighbor2021

    • Author(s)
      Yi Zhang, Chao Zhang, Takuya Akashi
    • Organizer
      International Workshop on Advanced Image Technology (IWAIT)
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] Training PointNet for human point cloud segmentation with 3D meshes2021

    • Author(s)
      Takuma Ueshima, Katsuya Hotta, Shogo Tokai, Chao Zhang
    • Organizer
      International Conference on Quality Control by Artificial Vision (QCAV)
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] SHX: Search History Driven Crossover for Real-Coded Genetic Algorithm2020

    • Author(s)
      Takumi Nakane, Xuequan Lu, Chao Zhang
    • Organizer
      Genetic and Evolutionary Computation Conference 2020 (GECCO)
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] Subspace-Dependent Adjacency Matrix Design via Discrete-Continuous Optimization2020

    • Author(s)
      Katsuya Hotta, Shenglin Mu, Yan Zhao, Chao Zhang
    • Organizer
      IEEE 9th Global Conference on Consumer Electronics (GCCE)
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] Hierarchical Charged Particle Swarm Optimizationを用いたテンプレートマッチング手法の提案2020

    • Author(s)
      五十嵐泰智,中根拓未,明石卓也,張潮
    • Organizer
      Vision Engineering Workshop (ViEW)
    • Related Report
      2020 Research-status Report
  • [Presentation] Apparel Generation via Cluster-Indexed Global and Local Feature Representations2020

    • Author(s)
      Chunzhi Gu, Zhengyu Huang, Sicheng Li, Haoran Xie, Xi Yang, Chao Zhang
    • Organizer
      IEEE 9th Global Conference on Consumer Electronics (GCCE)
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] Candidate Subspace Screening for Linear Subspace Clustering with Energy Minimization2020

    • Author(s)
      Katsuya Hotta, Haoran Xie, Chao Zhang
    • Organizer
      Irish Machine Vision and Image Processing Conference (IMVIP)
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] Deep Patch-based Human Segmentation2020

    • Author(s)
      Dongbo Zhang, Zheng Fang, Xuequan Lu, Hong Qin, Antonio Robles-Kelly, Chao Zhang, Ying He
    • Organizer
      27th International Conference on Neural Information Processing (ICONIP)
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] PointNetを用いた人体点群データのセマンティックセグメンテーション2020

    • Author(s)
      上島拓真,堀田克哉,東海彰吾,張潮
    • Organizer
      Vision Engineering Workshop (ViEW)
    • Related Report
      2020 Research-status Report
  • [Remarks] Reliable Pattern Analysis Lab.

    • URL

      http://www.labzhang.com/

    • Related Report
      2021 Research-status Report

URL: 

Published: 2020-04-28   Modified: 2024-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi