• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to project page

2018 Fiscal Year Final Research Report

Real World Heart Rate Estimation from Video

Research Project

  • PDF
Project/Area Number 17K12709
Research Category

Grant-in-Aid for Young Scientists (B)

Allocation TypeMulti-year Fund
Research Field Perceptual information processing
Research InstitutionSaitama University

Principal Investigator

Lam Antony  埼玉大学, 理工学研究科, 助教 (50744124)

Project Period (FY) 2017-04-01 – 2019-03-31
Keywordsvideo ppg / computer vision / heart rate / cardiac estimation / remote measurement
Outline of Final Research Achievements

Our aim in this project was to develop an algorithm that can take a video feed of someone's face and through reading subtle changes in skin color (imperceptible to the human eye), estimate the person's heart rate. We took our previous work that was robust to lighting changes in real-world environments and improved it by adding robustness to out-of-pose head rotations. This was achieved by tracking triangular local regions of the face where the regions could adaptively change shape to fit many 3D rotations of the head. The tracked triangular local regions of the face were then used to perform a robust estimate of cardiac activity from the subtle color changes of the skin. We found this technique works even with RGB webcams. We also developed a variant of the algorithm that is faster but less accurate so it could be used for different applications. This variant worked by considering specific face regions with strong cardiac-caused color changes in skin.

Free Research Field

Computer Vision

Academic Significance and Societal Importance of the Research Achievements

Our work is one of the few in the literature that addressed the difficult challenges of estimating cardiac activity from videos with changing illumination and motion in the real-world. This algorithm can also be used for applications such as emotion recognition and human computer interaction.

URL: 

Published: 2020-03-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi