• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Proposal of gait model related to intellect, emotion, volition and physical and its application to suspicious person detection

Research Project

Project/Area Number 18H04115
Research Category

Grant-in-Aid for Scientific Research (A)

Allocation TypeSingle-year Grants
Section一般
Review Section Medium-sized Section 61:Human informatics and related fields
Research InstitutionOsaka University

Principal Investigator

Yagi Yasushi  大阪大学, 産業科学研究所, 教授 (60231643)

Project Period (FY) 2018-04-01 – 2021-03-31
Project Status Completed (Fiscal Year 2020)
Budget Amount *help
¥44,460,000 (Direct Cost: ¥34,200,000、Indirect Cost: ¥10,260,000)
Fiscal Year 2020: ¥13,910,000 (Direct Cost: ¥10,700,000、Indirect Cost: ¥3,210,000)
Fiscal Year 2019: ¥12,740,000 (Direct Cost: ¥9,800,000、Indirect Cost: ¥2,940,000)
Fiscal Year 2018: ¥17,810,000 (Direct Cost: ¥13,700,000、Indirect Cost: ¥4,110,000)
Keywordsコンピュータビジョン / パターン認識 / バイオメトリクス
Outline of Final Research Achievements

We developed a comprehensive gait model including four factors: skill (or experience, capability), emotion (or feeling), intention (or situation), body (or age, health condition, disease, impaired body function), under a hypothesis where any gaits can be represented by a composite of the four factors We constructed several gait databases including the factors, e.g., a gait dataset with a health indicator, i.e., body composition as a body label. We then design a deep neural network which is pre-trained and fine-tuned across multiple factors and showed its effectiveness in a task of body composition estimation from a gait video. We also introduced insight obtained through the comprehensive gait model construction into surveillance applications, and developed a gait recognition framework which employs disentangled representation learning of individuality and other covariate factors similarly to we disentangled a gait into the above-mentioned four factors.

Academic Significance and Societal Importance of the Research Achievements

本研究は、歩行解析の新しい枠組みの 提案であり、情報学的観点から歩行を科学する研究で学術的価値が大きい。
映像からの歩行解析では、個人認証の応用としての科学捜査支援が主流であったが、知情意体 のモデル化により、歩行映像から、個人認証だけでなく、感情、意図、健康度が同時推定できる。 このような技術は、日常歩行をカメラにより見守るだけで、異常の早期発見が可能となり、家庭、 学校、職場など人々が日常暮らす様々な場面で、防犯とメンタルケア、ヘルスケア、さらに、個 別サービスを同時に実現できる

Report

(4 results)
  • 2020 Annual Research Report   Final Research Report ( PDF )
  • 2019 Annual Research Report
  • 2018 Annual Research Report
  • Research Products

    (49 results)

All 2021 2020 2019 2018 Other

All Int'l Joint Research (2 results) Journal Article (18 results) (of which Int'l Joint Research: 8 results,  Peer Reviewed: 18 results,  Open Access: 14 results) Presentation (28 results) (of which Int'l Joint Research: 24 results) Patent(Industrial Property Rights) (1 results)

  • [Int'l Joint Research] 南京理工大学/南方科技大学(中国)

    • Related Report
      2020 Annual Research Report
  • [Int'l Joint Research] 日本エジプト科学技術大学(エジプト)

    • Related Report
      2020 Annual Research Report
  • [Journal Article] Learn to Walk Across Ages: Motion Augmented Multi-age Group Gait Video Translation2021

    • Author(s)
      Y. Zhang, Y. Makihara, D. Muramatsu, J. Zhang, L. Niu, L. Zhang, Y. Yagi
    • Journal Title

      IEEE Access

      Volume: 9 Pages: 40550-40559

    • DOI

      10.1109/access.2021.3061684

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Wearable Sensor-based Gait Analysis for Age and Gender Estimation2020

    • Author(s)
      M.A.R. Ahad, T.T. Ngo, A.D. Antar, M. Ahmed, T. Hossain, D. Muramatsu, Y. Makihara, S. Inoue, Y. Yagi
    • Journal Title

      Sensors, MDPI

      Volume: 20 Issue: 8 Pages: 1-24

    • DOI

      10.3390/s20082424

    • NAID

      120007145039

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Gait recognition invariant to carried objects using alpha blending generative adversarial networks2020

    • Author(s)
      Xiang Li, Yasushi Makihara, Chi Xu, Yasushi Yagi, Mingwu Ren
    • Journal Title

      Pattern Recognition

      Volume: 105 Pages: 1-12

    • DOI

      10.1016/j.patcog.2020.107376

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Performance Evaluation of Model-based Gait on Multi-view Very Large Population Database with Pose Sequences2020

    • Author(s)
      W. An, S. Yu, Y. Makihara, X. Wu, C. Xu, Y. Yu, R. Liao, Y. Yagi
    • Journal Title

      IEEE Trans. on Biometrics, Behavior, and Identity Science

      Volume: 2 Issue: 4 Pages: 421-430

    • DOI

      10.1109/tbiom.2020.3008862

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] A Video-Based Gait Disturbance Assessment Tool for Diagnosing Idiopathic Normal Pressure Hydrocephalus2020

    • Author(s)
      R. Liao, Y. Makihara, D. Muramatsu, I. Mitsugami, Y. Yagi, K. Yoshiyama, H. Kazui, M. Takeda
    • Journal Title

      IEEJ Transactions on Electrical and Electronic Engineering

      Volume: 15 Issue: 3 Pages: 433-441

    • DOI

      10.1002/tee.23072

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Joint Intensity Transformer Network for Gait Recognition Robust against Clothing and Carrying status2019

    • Author(s)
      X. Li, Y. Makihara, C. Xu, Y. Yagi, M. Ren
    • Journal Title

      IEEE Transactions on Information Forensics and Security

      Volume: 14 Issue: 12 Pages: 3102-3115

    • DOI

      10.1109/tifs.2019.2912577

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Statistical Analysis of Dual-task Gait Characteristics for Cognitive Score Estimation2019

    • Author(s)
      Taku Matsuura, Kazuhiro Sakashita, Andrey Grushnikov, Fumio Okura, Ikuhisa Mitsugami, Yasushi Yagi
    • Journal Title

      Scientific Reports

      Volume: 9 Issue: 1 Pages: 1-12

    • DOI

      10.1038/s41598-019-56485-w

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] patio-temporal silhouette sequence reconstruction for gait recognition against occlusion2019

    • Author(s)
      M.Z. Uddin, D. Muramatsu, N. Takemura, M.A.R. Ahad, Y. Yagi
    • Journal Title

      IPSJ Trans. on Computer Vision and Applications

      Volume: 11 Issue: 1 Pages: 1-18

    • DOI

      10.1186/s41074-019-0061-3

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Pedestrian segmentation based on a spatio-temporally consistent graph cut with optimal transport2019

    • Author(s)
      Y. Yu, Y. Makihara, Y. Yagi
    • Journal Title

      IPSJ Trans. on Computer Vision and Applications

      Volume: 11 Issue: 1 Pages: 1-17

    • DOI

      10.1186/s41074-019-0062-2

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Speed-Invariant Gait Recognition Using Single-Support Gait Energy Image2019

    • Author(s)
      C. Xu, Y. Makihara, X. Li, Y. Yagi, J. Lu
    • Journal Title

      Multimedia Tools and Applications

      Volume: 78 Issue: 18 Pages: 26509-26536

    • DOI

      10.1007/s11042-019-7712-3

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Gait-based age estimation using multi-stage convolutional neural network2019

    • Author(s)
      A. Sakata, N. Takemura, Y. Yagi
    • Journal Title

      IPSJ Trans. on Computer Vision and Applications

      Volume: 11 Issue: 1 Pages: 1-4

    • DOI

      10.1186/s41074-019-0054-2

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Gait-based Age Progression/Regression: A Baseline and Performance Evaluation by Age Group Classification and Cross-age Gait Identification2019

    • Author(s)
      C. Xu, Y. Makihara, Y. Yagi, J. Lu
    • Journal Title

      Machine Vision and Applications

      Volume: 30 Issue: 4 Pages: 629-644

    • DOI

      10.1007/s00138-019-01015-x

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Early Detection of Lower MMSE Scores in Elderly Based on Dual-Task Gait2019

    • Author(s)
      Aoki Kota、Ngo Trung Thanh、Mitsugami Ikuhisa、Okura Fumio、Niwa Masataka、Makihara Yasushi、Yagi Yasushi、Kazui Hiroaki
    • Journal Title

      IEEE Access

      Volume: 7 Pages: 40085-40096

    • DOI

      10.1109/access.2019.2906908

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Gait-based Human Age Estimation using Age Group-dependent Manifold Learning and Regression2018

    • Author(s)
      X. Li, Y. Makihara, C. Xu, Y. Yagi, M. Ren
    • Journal Title

      Multimedia Tools and Applications

      Volume: 77 Issue: 21 Pages: 28333-28354

    • DOI

      10.1007/s11042-018-6049-7

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] [Papers] Growth Assessment of School-age Children using Dualtask Observation2018

    • Author(s)
      Zhou Chengju、Mitsugami Ikuhisa、Okura Fumio、Aoki Kota、Yagi Yasushi
    • Journal Title

      ITE Transactions on Media Technology and Applications

      Volume: 6 Issue: 4 Pages: 286-296

    • DOI

      10.3169/mta.6.286

    • NAID

      130007493366

    • ISSN
      2186-7364
    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Gait Energy Response Functions for Gait Recognition against Various Clothing and Carrying Status2018

    • Author(s)
      X. Li, Y. Makihara, C. Xu, D. Muramatsu, Y. Yagi, M. Ren
    • Journal Title

      Applied Science

      Volume: 8 Issue: 8 Pages: 1-22

    • DOI

      10.3390/app8081380

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] The OU-ISIR Large Population Gait Database with Real-Life Carried Object and its performance evaluation2018

    • Author(s)
      M.Z. Uddin, T.T. Ngo, Y. Makihara, N. Takemura, X. Li, D. Muramatsu, Y. Yagi
    • Journal Title

      IPSJ Transactions on Computer Vision and Applications

      Volume: 10 Issue: 1 Pages: 1-11

    • DOI

      10.1186/s41074-018-0041-z

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] [Paper] Automatic Collection of Dual-task Human Behavior for Analysis of Cognitive Function2018

    • Author(s)
      Fumio Okura, Ikuhisa Mitsugami, Masataka Niwa, Kota Aoki, Chengju Zhou, Yasushi Yagi
    • Journal Title

      ITE Transactions on Media Technology and Applications

      Volume: 6 Issue: 2 Pages: 138-150

    • DOI

      10.3169/mta.6.138

    • NAID

      130006603032

    • ISSN
      2186-7364
    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access
  • [Presentation] Deep Gait Relative Attributeusing a Signed Quadratic Contrastive Loss2021

    • Author(s)
      Y. Hayashi, A. Shehata, Y. Makihara, D. Muramatsu,Y. Yagi
    • Organizer
      Proc. of the 25th International Conference on Pattern Recognition (ICPR 2020)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Real-Time Gait-Based Age Estimation and Gender Classification from a Single Image2021

    • Author(s)
      C. Xu, Y. Makihara, R. Liao, H. Niitsuma, X. Li, Y. Yagi, J. Lu
    • Organizer
      Proc. of the IEEE Winter Conf. on Applications of Computer Vision 2021 (WACV 2021)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Gait Recognition via Semi-supervised Disentangled Representation Learning to Identity and Covariate Features2020

    • Author(s)
      Xiang Li, Yasushi Makihara, Chi Xu, Yasushi Yagi, Mingwu Ren
    • Organizer
      Proc. the 33rd IEEE Conf. on Computer Vision and Pattern Recognition (CVPR 2020)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Gait Recognition from a Single Image using a Phase-Aware Gait Cycle Reconstruction Network2020

    • Author(s)
      C. Xu, Y. Makihara, X. Li, Y. Yagi, J. Lu
    • Organizer
      Proc. of the 16th European Conf. on Computer Vision (ECCV 2020)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] How Confident Are You in Your Estimate of a Human Age? Uncertainty-aware Gait-based Age Estimation by Label Distribution Learning2020

    • Author(s)
      A. Sakata, Y. Makihara, N. Takemura, D. Muramatsu, Y. Yagi
    • Organizer
      Proc. of the 4th Int. Joint Conference on Biometrics (IJCB 2020)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] DeformGait: Gait Recognition under Posture Changes using Deformation Patterns between Gait Feature Pairs2020

    • Author(s)
      C. Xu, D. Adachi, Y. Makihara, Y. Yagi, J. Lu
    • Organizer
      Proc. of the 4th Int. Joint Conference on Biometrics (IJCB 2020)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] End-to-end Model-based Gait Recognition2020

    • Author(s)
      X. Li, Y. Makihara, C. Xu, Y. Yagi, S. Yu, M. Ren
    • Organizer
      Proc. of the 15th Asian Conf. on Computer Vision
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Spatio-temporal silhouette sequence reconstruction for gait recognition against occlusion2020

    • Author(s)
      MZ Uddin, D Muramatsu, N Takemura, Md Atiqur Rahman Ahad, and Y Yagi
    • Organizer
      23rd SANKEN International Symposium on Scientific and Industrial Research for Space Age
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Statistical analysis of dual-task gait characteristics for cognitive score estimation2020

    • Author(s)
      Taku Matsuura, Kazuhiro Sakashita, Andrey Grushnikov, Fumio Okura, Ikuhisa Mitsugami, Yasushi Yagi
    • Organizer
      The 2nd International Symposium on Symbiotic Intelligent Systems
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] oes My Gait Look Nice? Human Perception-Based Gait Relative Attribute Estimation Using Dense Trajectory Analysis2020

    • Author(s)
      A.S. Hassanein, Y. Hayashi, Y. Makihara, D. Muramatsu, Y. Yagi
    • Organizer
      The 2nd International Symposium on Symbiotic Intelligent Systems
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Does My Gait Look Nice? Human Perception-Based Gait Relative Attribute Estimation Using Dense Trajectory Analysis2020

    • Author(s)
      A.S. Hassanein, Y. Hayashi, Y. Makihara, D. Muramatsu, Y. Yagi
    • Organizer
      The 23rd SANKEN International Symposium
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] OU-ISIR Wearable Sensor-based Gait Challenge: Age and Gender2020

    • Author(s)
      T.T. Ngo, M.A.R. Ahad, A.D. Antar, M. Ahmed, D. Muramatsu, Y. Makihara, Y. Yagi, S. Inoue, T. Hossain, Y. Hattori
    • Organizer
      The 23rd SANKEN International Symposium
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] デュアルタスク歩行解析に基づく高齢者の認知機能スコア推定2020

    • Author(s)
      松浦 拓, 大倉 史生, 槇原 靖, 周 成菊, 青木 工太, 満上 育久, 八木 康史
    • Organizer
      電子情報通信学会 技術研究報告
    • Related Report
      2019 Annual Research Report
  • [Presentation] Does My Gait Look Nice? Human Perception-based Gait Relative Attributes Estimation by Dense Trajectory Analysis2019

    • Author(s)
      A.S. Hassanein, Y. Hayashi, Y. Makihara, D. Muramatsu, Y. Yagi
    • Organizer
      5th Asian Conference on Pattern Recognition
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Make the Bag Disappear: Carrying Status-invariant Gait-based Human Age Estimation using Parallel Generative Adversarial Networks2019

    • Author(s)
      X. Li, Y. Makihara, C. Xu, Y. Yagi, M. Ren
    • Organizer
      the IEEE 10th Int. Conf. on Biometrics: Theory, Applications and Systems
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] OU-ISIR Wearable Sensor-based Gait Challenge: Age and Gender2019

    • Author(s)
      T.T. Ngo, M.A.R. Ahad, A.D. Antar, M. Ahmed, D. Muramatsu, Y. Makihara, Y. Yagi, S. Inoue, T. Hossain, Y. Hattori
    • Organizer
      12th IAPR International Conference On Biometrics
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Age estimation from dual-task behavior for comprehensive growth assessment of children2019

    • Author(s)
      C. Zhou, I. Mitsugami, K. Aoki, F. Okura, Y. Yagi
    • Organizer
      the 13th International Workshop on Robust Computer Vision
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Geometrically Consistent Pedestrian Trajectory Extraction for Gait Recognition2019

    • Author(s)
      Y. Makihara, G. Ogi, Y. Yagi
    • Organizer
      the 13th International Workshop on Robust Computer Vision
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Gait Energy Response Functions for Gait Recognition against Various Clothing and Carrying Status,2019

    • Author(s)
      X. Li, Y. Makihara, C. Xu, D. Muramatsu, Y. Yagi, M. Ren
    • Organizer
      the 13th International Workshop on Robust Computer Vision
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] The OU-ISIR Gait Database Comprising the Large Population Dataset with Age and Performance Evaluation of Age Estimation2019

    • Author(s)
      C. Xu, Y. Makihara, G. Ogi, X. Li, Y. Yagi, J. Lu
    • Organizer
      the 13th International Workshop on Robust Computer Vision
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Gait Recognition by Deformable Registration2019

    • Author(s)
      Y. Makihara, D. Adachi, C. Xu, Y. Yagi
    • Organizer
      the 13th International Workshop on Robust Computer Vision
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] The OU-ISIR Large Population Gait Database with Real-Life Carried Object and its performance evaluation2019

    • Author(s)
      M.Z. Uddin, T.T. Ngo, Y. Makihara, N. Takemura, X. Li, D. Muramatsu, Y. Yagi
    • Organizer
      the 13th International Workshop on Robust Computer Vision
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Gait-based Age Estimation using a DenseNet2019

    • Author(s)
      A. Sakata, Y. Makihara, N. Takemura, D. Muramatsu, Y. Yagin
    • Organizer
      the 13th International Workshop on Robust Computer Visio
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Construction and Performance Evaluation of the OU-ISIR Large Population Gait Database with Real-life Carried Object2019

    • Author(s)
      M.Z. Uddin, T.T. Ngo, Y. Makihara, N. Takemura, X. Li, D. Muramatsu, Y. Yagi
    • Organizer
      the 22nd SANKEN International Symposium
    • Related Report
      2018 Annual Research Report
  • [Presentation] The OU-ISIR Gait Database Comprising the Large Population Dataset with Age and Performance Evaluation of Age Estimation2019

    • Author(s)
      C. Xu, Y. Makihara, G. Ogi, X. Li, Y. Yagi, J. Lu
    • Organizer
      the 22nd SANKEN International Symposium
    • Related Report
      2018 Annual Research Report
  • [Presentation] Human Identification at a Distance by Gait Analysis2019

    • Author(s)
      S. Yu, Y. Huang, Y. Makihara, D. Muramatsu, L. Wang, Y. Yagi, T.T. Ngo
    • Organizer
      the 33rd AAAI Conf. on Artificial Intelligence
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Gait-based Age Estimation using a DenseNet2019

    • Author(s)
      A. Sakata, Y. Makihara, N. Takemura, D. Muramatsu, Y. Yagi
    • Organizer
      The 1st International Symposium on Symbiotic Intelligent Systems
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] STHOG特徴に基づく歩行者照合のCNNによる高精度化2019

    • Author(s)
      柏本 雄士朗, 村松 大吾, 武村 紀子, 八木 康史
    • Organizer
      第215回コンピュータビジョンとイメージメディア研究会
    • Related Report
      2018 Annual Research Report
  • [Patent(Industrial Property Rights)] 周期画像復元装置及び方法、識別装置及び方法、検証装置及び方法、特徴抽出装置、訓練方法、並びに位相推定装置2020

    • Inventor(s)
      八木 康史、槇原 靖、XU CHI、LI XIANG
    • Industrial Property Rights Holder
      大阪大学
    • Industrial Property Rights Type
      特許
    • Industrial Property Number
      2020-132951
    • Filing Date
      2020
    • Related Report
      2020 Annual Research Report

URL: 

Published: 2018-04-23   Modified: 2022-01-27  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi