• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Elucidation of the relationship between pain and facial expression and its application to a joint rehabilitation education support robot

Research Project

Project/Area Number 20K12015
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Review Section Basic Section 61050:Intelligent robotics-related
Research InstitutionRitsumeikan University

Principal Investigator

LEE JOOHO  立命館大学, 情報理工学部, 教授 (80366434)

Co-Investigator(Kenkyū-buntansha) 島田 伸敬  立命館大学, 情報理工学部, 教授 (10294034)
Project Period (FY) 2020-04-01 – 2023-03-31
Project Status Completed (Fiscal Year 2022)
Budget Amount *help
¥4,290,000 (Direct Cost: ¥3,300,000、Indirect Cost: ¥990,000)
Fiscal Year 2022: ¥780,000 (Direct Cost: ¥600,000、Indirect Cost: ¥180,000)
Fiscal Year 2021: ¥1,820,000 (Direct Cost: ¥1,400,000、Indirect Cost: ¥420,000)
Fiscal Year 2020: ¥1,690,000 (Direct Cost: ¥1,300,000、Indirect Cost: ¥390,000)
Keywords痛み / 表情 / ロボット / シミュレーションロボット / 医療訓練
Outline of Research at the Start

効率的なリハビリテーション教育手段として様々な関節症状を再現することのできるシミュレーションロボットを用いる手法がある。本研究では、痛みと表情の関係性を解明すると同時に痛みと顔表情間の統計的なモデルを作成する。また、作成したモデルに基づいて痛みを表現する関節ケア訓練用シミュレーションロボット(以下、関節ケアロボット)の表情表現手法を明らかにする。さらに、痛み表現が可能なロボットによる関節ケア訓練の効果について調査を行い、人間とロボットそれぞれの表情による痛み表現が人に与える影響の差とその原因の解明を行う。

Outline of Final Research Achievements

We conducted a study to model the relationship between pain and facial expressions and evaluate its effectiveness in a joint care simulation robot. We recruited participants and recorded their facial expressions, gestures, etc while applying different levels of pain using a commercially available low-frequency massage device. We manually annotated and scored the collected data. Based on the annotated information, we used a fuzzy model to model the relationship between pain and facial expressions. We also developed a program that generates CG representations of facial expressions based on the type and level of pain input. The generated CG was projected onto a display to provide visual FB. We also developed an emotion transition model to enable the robot to express diverse pain expressions by adding personality to it. Our study contributes to the development of robots that can provide effective pain management using facial expression recognition technology.

Academic Significance and Societal Importance of the Research Achievements

この研究では、痛みと顔表情の関係性をモデル化する方法を提供し、関節ケアロボットにおいて痛み表現を可能にする技術の開発に貢献した。これにより、医療現場での痛みの理解や評価、治療の改善に役立ち、より実用的な関節ケアロボットの開発につながる可能性がある。

Report

(4 results)
  • 2022 Annual Research Report   Final Research Report ( PDF )
  • 2021 Research-status Report
  • 2020 Research-status Report
  • Research Products

    (16 results)

All 2022 2021 2020 Other

All Int'l Joint Research (1 results) Journal Article (4 results) (of which Int'l Joint Research: 1 results,  Peer Reviewed: 4 results,  Open Access: 2 results) Presentation (7 results) (of which Int'l Joint Research: 5 results) Remarks (4 results)

  • [Int'l Joint Research] Daegu University/Inha University(韓国)

    • Related Report
      2022 Annual Research Report
  • [Journal Article] Gender recognition using optimal gait feature based on recursive feature elimination in normal walking2022

    • Author(s)
      Lee Miran、Lee Joo-Ho、Kim Deok-Hwan
    • Journal Title

      Expert Systems with Applications

      Volume: 189 Pages: 116040-116040

    • DOI

      10.1016/j.eswa.2021.116040

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] 3D Facial Pain Expression for a Care Training Assistant Robot in an Elderly Care Education Environment2021

    • Author(s)
      Lee Miran、Tran Dinh Tuan、Lee Joo-Ho
    • Journal Title

      Frontiers in Robotics and AI

      Volume: 8 Pages: 1-15

    • DOI

      10.3389/frobt.2021.632015

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] A robust fusion algorithm of LBP and IMF with recursive feature elimination-based ECG processing for QRS and arrhythmia detection2021

    • Author(s)
      Lee Miran、Lee Joo-Ho
    • Journal Title

      Applied Intelligence

      Volume: 52 Issue: 1 Pages: 939-953

    • DOI

      10.1007/s10489-021-02368-5

    • Related Report
      2021 Research-status Report
    • Peer Reviewed
  • [Journal Article] Recent use of deep learning techniques in clinical applications based on gait: a survey2021

    • Author(s)
      Matsushita Yume、Tran Dinh Tuan、Yamazoe Hirotake、Lee Joo-Ho
    • Journal Title

      Journal of Computational Design and Engineering

      Volume: 8 Issue: 6 Pages: 1499-1532

    • DOI

      10.1093/jcde/qwab054

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access
  • [Presentation] Development of Robotic Mood Transition for Human-Robot Interaction2022

    • Author(s)
      Joo-Ho Lee,Deok-Hwan Kim, Miran Lee
    • Organizer
      The 8th International Conference on Next Generation Computing 2022 (ICNGC 2022)
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Pain Expression-Based Visual Feedback Method for Care Training Assistant Robot with Musculoskeletal Symptoms2021

    • Author(s)
      Miran Lee, Tran Dinh Tuan, Joo-Ho Lee
    • Organizer
      2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2021)
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Care Training Assistant Robot and Visual-based Feedback for Elderly Care Education Environment2021

    • Author(s)
      Miran Lee, Dinh Tuan Tran, Hirotake Yamazoe, and Joo-Ho Lee
    • Organizer
      2021 IEEE/SICE International Symposium on System Integration (SII)
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] Fuzzy-Logic based Care Training Quantitative Assessment using Care Training Assistant Robot (CaTARo)2020

    • Author(s)
      Miran Lee, Hirotake Yamazoe, and Joo-Ho Lee
    • Organizer
      17th IEEE International Conference on Ubiquitous Robot (UR 2020)
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] A Robust sEMG Feature Selection based on Recursive Feature Elimination for Gait Recognition2020

    • Author(s)
      Miran Lee, Joo-Ho Lee, and Deok-Hwan Kim
    • Organizer
      The 6th International Conference on Next Generation Computing 2020 (ICNGC 2020)
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] 介護練習用ロボットの為の表情による痛み再現システム2020

    • Author(s)
      梶山 主税、李 美蘭、山添 大丈、李 周浩
    • Organizer
      ロボティクス・メカトロニクス講演会 2020
    • Related Report
      2020 Research-status Report
  • [Presentation] 介護練習用ロボットの自然な痛み表現手法2020

    • Author(s)
      梶山 主税, 李 美蘭, チャン ディン トゥアン, 李 周浩
    • Organizer
      第21回計測自動制御学会システムインテグレーション部門講演会
    • Related Report
      2020 Research-status Report
  • [Remarks] RU-PITENS-database

    • URL

      https://github.com/ais-lab/RU-PITENS-database

    • Related Report
      2022 Annual Research Report 2021 Research-status Report
  • [Remarks] RU-FEMOIN-database

    • URL

      https://github.com/ais-lab/RU-FEMOIN-database

    • Related Report
      2022 Annual Research Report 2021 Research-status Report
  • [Remarks] Elderly Simulated Robot for Ihe Care Education

    • URL

      https://sites.google.com/view/miran-research/cataro

    • Related Report
      2020 Research-status Report
  • [Remarks] Pain Expression-based Visual Feedback

    • URL

      https://sites.google.com/view/miran-research/pevf-for-cataro

    • Related Report
      2020 Research-status Report

URL: 

Published: 2020-04-28   Modified: 2024-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi