• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Research on caregiver / nursing support by paralinguistic recognition and analysis of small involuntary eye movements during fixation

Research Project

Project/Area Number 16K01566
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Research Field Rehabilitation science/Welfare engineering
Research InstitutionTokai University

Principal Investigator

Yamada Mitsuho  東海大学, 情報通信学部, 教授 (60366086)

Co-Investigator(Kenkyū-buntansha) 星野 祐子  東海大学, 情報通信学部, 講師 (80435271)
Project Period (FY) 2016-04-01 – 2020-03-31
Project Status Completed (Fiscal Year 2019)
Budget Amount *help
¥3,770,000 (Direct Cost: ¥2,900,000、Indirect Cost: ¥870,000)
Fiscal Year 2018: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2017: ¥780,000 (Direct Cost: ¥600,000、Indirect Cost: ¥180,000)
Fiscal Year 2016: ¥1,820,000 (Direct Cost: ¥1,400,000、Indirect Cost: ¥420,000)
Keywords口唇動作 / 固視微動 / 体調評価 / 介護支援 / 看護支援 / CFF / パラ言語 / ロボット / 疲労 / 眼球運動 / 介護・看護支援 / 疲労度 / 集中度 / 発話認識 / 発話トレーニング / 覚醒度
Outline of Final Research Achievements

With the aging of society, the shortage of manpower in nursing care and nursing is becoming chronic. If the situation of patients and care recipients can be judged from daily activities without human intervention, the burden on caregivers and nurses can be reduced, and the QOL of patients and care recipients can be improved. Therefore, we conducted a study with the aim of grasping the mood and health condition of patients and care recipients from the movements of the lips and eyes during casual conversation, and contributing to improving QOL and reducing the burden on caregivers and nurses. We paid attention to the changes associated with fatigue, and showed that fatigue caused changes in the opening area of the lips during utterance, as well as changes in small eye movements while gazing. That is, it was possible to show that the physical condition change can be measured from the movements of the lips and the eyes during casual conversation.

Academic Significance and Societal Importance of the Research Achievements

学術的な意義は、口唇動作と眼球運動という二つのパラ言語を用い、音声によらず発話時の口唇動作と発話者の固視微動により、発話者の体調、疲労度、覚醒度、集中度などを評価できることである。
高齢化社会を迎え、介護費用、看護費用は増加の一途をたどり、看護師・介護士の負担も増大し、現場での人手不足は深刻である。社会的意義は、ロボットやタブレットを介して行う自然な日常会話中の口唇動作と眼球運動から患者、被介護者の体調を評価できるようにすることにより、看護師・介護士など現場従事者の負担軽減だけでなく、患者、被介護者のQOLを飛躍的に向上できることである。

Report

(5 results)
  • 2019 Annual Research Report   Final Research Report ( PDF )
  • 2018 Research-status Report
  • 2017 Research-status Report
  • 2016 Research-status Report
  • Research Products

    (39 results)

All 2020 2019 2018 2017 2016

All Journal Article (4 results) (of which Peer Reviewed: 4 results,  Open Access: 3 results,  Acknowledgement Compliant: 1 results) Presentation (35 results) (of which Int'l Joint Research: 12 results)

  • [Journal Article] Measurement of fatigue based on changes in eye movement during gaze2020

    • Author(s)
      Yuki Kurosawa, Shinya Mochiduki, Yuko Hoshino, Mitsuho Yamada
    • Journal Title

      IEICE TRANSACTIONS on Fundamentals of Electronics, Communications and Computer Sciences

      Volume: Vol.E103-D,No.05 Pages: 1203-1207

    • NAID

      130007839087

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] 口唇動作と眼球運動を用いたパラランゲージによる疲労評価手法の検討2018

    • Author(s)
      菅沼美由起,黒澤勇樹,望月信哉,星野祐子,山田光穗
    • Journal Title

      パーソナルコンピュータ利用技術学会論文誌

      Volume: 12

    • NAID

      130007726417

    • Related Report
      2017 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Evaluation of fatigue from 90-min reading by paralanguage recognition and gazing-point analysis2017

    • Author(s)
      Miyuki Suganuma, Saaya Urakabe, Ryota Kuramochi, Shinya Mochiduki, Yuko Hoshino, Mitsuho Yamada
    • Journal Title

      International Journal of Computers and their applications

      Volume: 24 Pages: 52-60

    • Related Report
      2017 Research-status Report
    • Peer Reviewed
  • [Journal Article] How Effective is Using Lip Movement for Japanese Utterance Training2017

    • Author(s)
      Miyuki SUGANUMA,Tomoki YAMAMURA, Yuko HOSHINO,Mitsuho YAMADA
    • Journal Title

      Advances in Science, Technology and Engineering Systems Journal

      Volume: 2 Pages: 227-233

    • Related Report
      2016 Research-status Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Presentation] Real time fatigue evaluation with standard deviation of the gaze point during calculation task2019

    • Author(s)
      Yuki Kurosawa、Shinya Mochiduki、Yuko Hoshino、Mitsuho Yamada
    • Organizer
      APCV2019
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A Mental Fatigue Measurement System based on Face Images2019

    • Author(s)
      Yuki Kurosawa、Miho Shinohara、Shinya Mochiduki、Yuko Hoshino、Mitsho Yamada
    • Organizer
      IDW'19
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Fatigue estimation in the calculation task based on eye movements and lip movements2019

    • Author(s)
      Yuki Kurosawa、Miho Shinohara、Shinya Mochiduki、Yuko Hoshino、Mitsuho Yamada
    • Organizer
      Annual Conference on Engineering and Applied Science, ACEAT
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Development of a System Which Can Teach Users Gymnastics with Humanoid Robots2019

    • Author(s)
      Tsanming Ou, Mitsuho Yamada, Tomoki Miyamoto, Yuki Kurosawa, Yuko Hoshino, Takahide Otomo
    • Organizer
      2019 IEEE 8th Global Conference on Consumer Electronics (GCCE)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Proposal of the Interactive Robot Eyes to Realize Eye Contact Between Human and a Robot2019

    • Author(s)
      Tomoki Miyamoto, Yuki Kurosawa, Tsanming Ou, Yuko Hoshino, Mitsuho Yamada
    • Organizer
      2019 IEEE 8th Global Conference on Consumer Electronics (GCCE)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 眼球と口唇の動作に基づく精神疲労評価の検討2019

    • Author(s)
      黒澤勇樹、篠原未歩、望月信哉、星野裕子、山田光穗
    • Organizer
      2019年映像情報メディア学会年次大会
    • Related Report
      2019 Annual Research Report
  • [Presentation] 高精細映像が人にもたらす癒やし効果の分析2019

    • Author(s)
      篠原未歩、黒澤勇樹、大友隆秀、望月信哉、山田光穗
    • Organizer
      2019年映像情報メディア学会年次大会
    • Related Report
      2019 Annual Research Report
  • [Presentation] 運動支援を行うことができる介護ロボットの開発提案、体調評価や共同視聴など人の生活を支援できる対話型ロボットの開発2019

    • Author(s)
      宮元友紀、黒澤勇樹、歐サン銘、山田光穗、星野祐子
    • Organizer
      第14回パーソナルコンピュータ利用技術学会全国大会
    • Related Report
      2019 Annual Research Report
  • [Presentation] 新型深度センサを用いた運動支援システムの開発2019

    • Author(s)
      歐サン銘、宮元友紀、黒澤勇樹、大友隆秀星野祐子、山田光穗
    • Organizer
      第14回パーソナルコンピュータ利用技術学会全国大会
    • Related Report
      2019 Annual Research Report
  • [Presentation] 解像度の違いが人にもたらす癒やし効果の分析2019

    • Author(s)
      篠原未歩、黒澤勇樹、大友隆秀、望月信哉、星野祐子、山田光穗
    • Organizer
      映像情報メディア学会 冬季大会
    • Related Report
      2019 Annual Research Report
  • [Presentation] A STUDY OF EVALUATION SYSTEM FOR PHYSICAL CONDITION BY LIP MOVEMENT AND EYE MOVEMENT2018

    • Author(s)
      Yuki Kurosawa, Miyuki Suganuma, Shinya Mochiduki, Yuko Hoshino, Mitsuho Yamada
    • Organizer
      IMQA2018
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Proposal and Application of Evaluation Method in Health Condition Evaluation System by Eye Movement and Lips Movement2018

    • Author(s)
      Yuki Kurosawa, Shinya Mochiduki, Yuko Hoshino, Mitsuho Yamada
    • Organizer
      IDW'18
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] 介護支援のための体調評価システムの提案2018

    • Author(s)
      黒澤勇樹、宮元友紀、上原大和、望月信哉、星野 祐子、山田光穗
    • Organizer
      ヒューマンインタフェースシンポジウム2018
    • Related Report
      2018 Research-status Report
  • [Presentation] 固視微動変化による疲労の測定2018

    • Author(s)
      黒澤勇樹、望月信哉、星野祐子、山田光穗
    • Organizer
      パーソナルコンピュータ利用技術学会
    • Related Report
      2018 Research-status Report
  • [Presentation] 人の体調を測定できる対話型ロボットの提案2018

    • Author(s)
      宮元友紀、黒澤勇樹、山田光穗、星野祐子
    • Organizer
      パーソナルコンピュータ利用技術学会
    • Related Report
      2018 Research-status Report
  • [Presentation] 高齢者向け体操支援ロボットの開発2018

    • Author(s)
      工藤裕哉、大須賀悠、歐サン銘、黒澤勇樹、星野祐子、山田光穗
    • Organizer
      パーソナルコンピュータ利用技術学会
    • Related Report
      2018 Research-status Report
  • [Presentation] 高齢者のための発話支援装置の提案2018

    • Author(s)
      上原大和、黒澤勇樹、星野祐子、山田光穗
    • Organizer
      パーソナルコンピュータ利用技術学会
    • Related Report
      2018 Research-status Report
  • [Presentation] Study of Fatigue and Evaluation of Physical Condition by Paralanguage Recognition and Gazing Point Analysis2017

    • Author(s)
      Miyuki Suganuma, Saya Urakabe, Ryota Kuramochi,Shinya Mochiduki, Yuko Hoshino and Mitsuho Yamada
    • Organizer
      CATA2017
    • Place of Presentation
      Waikiki Beach Marriott Resort and Spa, Honolulu, USA
    • Year and Date
      2017-03-24
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] Development of a Recording Application Working on the Web for the Physical Condition Evaluation System Using the Lip Movement2017

    • Author(s)
      Yuko Hoshino Miyuki Suganuma Mitsuho Yamada
    • Organizer
      CATA2017
    • Place of Presentation
      Waikiki Beach Marriott Resort and Spa, Honolulu, USA
    • Year and Date
      2017-03-22
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] 注視時の眼球運動と口唇動作に注目した疲労の評価2017

    • Author(s)
      菅沼美由起、倉持亮太、浦壁沙綾、望月信哉、星野 祐子、山田 光穗
    • Organizer
      電子情報通信学会イメージ・クオリティ・研究会
    • Place of Presentation
      九州大学大橋キャンパス 福岡県福岡市
    • Year and Date
      2017-03-06
    • Related Report
      2016 Research-status Report
  • [Presentation] Fatigue Evaluation by Paralanguage Recognition and Gazing-Point Analysis2017

    • Author(s)
      Miyuki Suganuma, Yuki Kurosawa, Shinya Mochiduki, Yuko Hoshino, Mitsuho Yamada
    • Organizer
      The 25th International Display Workshop
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] 眼球運動と口唇動作に注目した疲労評価2017

    • Author(s)
      菅沼美由起,黒澤勇樹,望月信哉,星野祐子,山田光穗
    • Organizer
      電子情報通信学会イメージ・メディア・クオリティ研究会
    • Related Report
      2017 Research-status Report
  • [Presentation] 新たな口唇動作分析装置の開発と評価のパラメータの検討2017

    • Author(s)
      黒澤勇樹,菅沼美由起,望月信哉,星野祐子,山田光穗
    • Organizer
      電子情報通信学会イメージ・メディア・クオリティ研究会
    • Related Report
      2017 Research-status Report
  • [Presentation] 眼球運動と口唇動作に注目した疲労評価の検討2017

    • Author(s)
      菅沼美由起,黒澤勇樹,望月信哉,星野祐子,山田光穗
    • Organizer
      FIT2017(第16 回情報科学技術フォーラム)
    • Related Report
      2017 Research-status Report
  • [Presentation] 新しく開発した口唇動作分析装置による疲労度実験2017

    • Author(s)
      黒澤勇樹,菅沼美由起,望月信哉,星野祐子,山田光穗
    • Organizer
      2017年電子情報通信学会ソサイエティ大会
    • Related Report
      2017 Research-status Report
  • [Presentation] 新たな口唇動作分析装置の精度検証と応用方法の検討2017

    • Author(s)
      黒澤勇樹,菅沼美由起,望月信哉,星野祐子,山田光穗
    • Organizer
      パーソナルコンピュータ利用技術学会第12回全国大会
    • Related Report
      2017 Research-status Report
  • [Presentation] 新たな口唇動作分析装置の精度検証と応用方法の検討2017

    • Author(s)
      村山佑樹、星野祐子、山田光穗
    • Organizer
      パーソナルコンピュータ利用技術学会第12回全国大会
    • Related Report
      2017 Research-status Report
  • [Presentation] 口唇動作に注目した体調評価の検討2016

    • Author(s)
      浦壁沙綾、倉持亮太、菅沼美由起、望月信哉、山田 光穗
    • Organizer
      映像情報メディア学会冬季大会2016
    • Place of Presentation
      東京理科大学森戸記念館 東京都新宿区
    • Year and Date
      2016-12-22
    • Related Report
      2016 Research-status Report
  • [Presentation] 口唇動作分析装置に組み込む特徴量の検討2016

    • Author(s)
      黒澤勇樹、浦壁沙綾、菅沼美由起、望月信哉、星野 祐子、山田 光穗
    • Organizer
      第11回パーソナルコンピュータ利用技術学会全国大会
    • Place of Presentation
      東海大学高輪校舎 東京都港区
    • Year and Date
      2016-12-17
    • Related Report
      2016 Research-status Report
  • [Presentation] 運転中に注意喚起したときの注意度についての基礎的検討2016

    • Author(s)
      丸山大岳、斉藤雄太、山田 光穗
    • Organizer
      第11回パーソナルコンピュータ利用技術学会全国大会
    • Place of Presentation
      東海大学高輪校舎 東京都港区
    • Year and Date
      2016-12-17
    • Related Report
      2016 Research-status Report
  • [Presentation] 口唇動作を用いた発話トレーニングの効果2016

    • Author(s)
      菅沼美由起、山村知生、星野 祐子、山田 光穗
    • Organizer
      第11回パーソナルコンピュータ利用技術学会全国大会
    • Place of Presentation
      東海大学高輪校舎 東京都港区
    • Year and Date
      2016-12-17
    • Related Report
      2016 Research-status Report
  • [Presentation] 注視中の眼球運動の変化に注目した体調評価について2016

    • Author(s)
      小林康祥、中井尊氏、倉持亮太、菅沼美由起、望月信哉、星野 祐子、山田 光穗
    • Organizer
      第11回パーソナルコンピュータ利用技術学会全国大会
    • Place of Presentation
      東海大学高輪校舎 東京都港区
    • Year and Date
      2016-12-17
    • Related Report
      2016 Research-status Report
  • [Presentation] 注視中の固視微動の分散と注意度についての基礎的検討2016

    • Author(s)
      丸山大岳、斎藤雄太、山田 光穗
    • Organizer
      FIT2016(第15 回情報科学技術フォーラム)
    • Place of Presentation
      富山大学 富山県富山市
    • Year and Date
      2016-09-09
    • Related Report
      2016 Research-status Report
  • [Presentation] Effect of Japanese utterance training using lip movement2016

    • Author(s)
      Miyuki SUGANUMA,Tomoki YAMAMURA, Yuko HOSHINO,Mitsuho YAMADA
    • Organizer
      ICCSE2016
    • Place of Presentation
      名古屋大学 野依記念ホール 愛知県名古屋市
    • Year and Date
      2016-08-24
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] An analysis of changes in attention based on miniature eye movements2016

    • Author(s)
      Hirotaka MARUYAMA, and Yuta SAITO,Mitsuho Yamada
    • Organizer
      ICCSE2016
    • Place of Presentation
      名古屋大学 野依記念ホール 愛知県名古屋市
    • Year and Date
      2016-08-24
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research

URL: 

Published: 2016-04-21   Modified: 2021-02-19  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi