• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Expression and Recognition of Emotion through Blinking between Humans and Robots

Research Project

Project/Area Number 17K18850
Research Category

Grant-in-Aid for Challenging Research (Exploratory)

Allocation TypeMulti-year Fund
Research Field Mechanical dynamics, Robotics, and related fields
Research InstitutionSaitama University

Principal Investigator

KUNO Yoshinori  埼玉大学, 理工学研究科, 教授 (10252595)

Co-Investigator(Kenkyū-buntansha) 小林 貴訓  埼玉大学, 理工学研究科, 准教授 (20466692)
Lam Antony  埼玉大学, 理工学研究科, 助教 (50744124)
福田 悠人  埼玉大学, 理工学研究科, 助教 (70782291)
Project Period (FY) 2017-06-30 – 2020-03-31
Project Status Completed (Fiscal Year 2019)
Budget Amount *help
¥6,500,000 (Direct Cost: ¥5,000,000、Indirect Cost: ¥1,500,000)
Fiscal Year 2019: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Fiscal Year 2018: ¥2,340,000 (Direct Cost: ¥1,800,000、Indirect Cost: ¥540,000)
Fiscal Year 2017: ¥2,730,000 (Direct Cost: ¥2,100,000、Indirect Cost: ¥630,000)
Keywords知能ロボット / コンピュータビジョン / ヒューマンロボットインタラクション / 感情認識 / 認知症
Outline of Final Research Achievements

Eyeblinks happen almost unconsciously and have recently been found to be related to the communication process. In particular, eyeblinks are synchronized between listeners and speakers in face-to-face conversation. Thus, we studied the use of eyeblinks in robots to help them smoothly communicate with humans. Indeed, we have observed the same synchronous eyeblinks between human participants and robots when the robots talk to them. We have developed a robot that can recognize human eyeblinks from a camera and blink synchronously with human participants that talk to the robot. We have performed experiments using human participants to examine how such blinking may affect communication. However, we have not yet obtained any concrete results. This is left for future work.

Academic Significance and Societal Importance of the Research Achievements

人間同士の場合の重要性から、人間とロボットのコミュニケーションにも表情や身振りなどの非言語行動の利用が研究されている。しかし、主な対象は意識的に行う非言語行動であった。ここで取り上げたまばたきは、ほとんど無意識的に行われる行動である。しかし、認知や情動に関連することが分かってきている。無意識に生じるということは、その人の本当の認知や情動の状態を示すものであり、その利用は人間の本当の気持ちにそって行動できるロボットの実現に役立つと考えられる。今回は、無意識の行動ということで、定量的評価が難しい点はあったが、ロボットのまばたきについて基礎的な知見を得ることができた。

Report

(4 results)
  • 2019 Annual Research Report   Final Research Report ( PDF )
  • 2018 Research-status Report
  • 2017 Research-status Report
  • Research Products

    (15 results)

All 2020 2019 2018 2017

All Journal Article (1 results) Presentation (14 results) (of which Int'l Joint Research: 6 results,  Invited: 2 results)

  • [Journal Article] 映像解析に基づく頑健・高速な心拍数計測手法2019

    • Author(s)
      大津耕陽, 福田悠人, Antony Lam, 小林貴訓, 久野義徳
    • Journal Title

      画像ラボ

      Volume: 30 Pages: 20-26

    • Related Report
      2019 Annual Research Report
  • [Presentation] VR対話環境におけるアバターのふるまいが与える印象の調査2020

    • Author(s)
      並川優衣, 福田悠人, 小林貴訓, 久野義徳
    • Organizer
      2020年電子情報通信学会総合大会
    • Related Report
      2019 Annual Research Report
  • [Presentation] マルチモーダル情報に基づくユーザの興味度推定2020

    • Author(s)
      王燕京, 大津耕陽, 福田悠人, 小林貴訓, 久野義徳
    • Organizer
      2020年電子情報通信学会総合大会
    • Related Report
      2019 Annual Research Report
  • [Presentation] Robust and Fast Heart Rate Monitoring Based on Video Analysis and Its Application2020

    • Author(s)
      K. Otsu, Q. Zhong, D. Keya, H. Fukuda, A. Lam, Y. Kobayashi, and Y. Kuno
    • Organizer
      International Conference on Applied Human Factors and Ergonomics (AHFE2020)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Heart Rate Measurement from Video and Its Applications2020

    • Author(s)
      Yoshinori Kuno
    • Organizer
      IEEE TENSYMP2020
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Information Technology for Estimating and Inducing Emotions2019

    • Author(s)
      Yoshinori Kuno
    • Organizer
      International Conference on Electrical, Computer and Communication Engineering (ECCE 2019)
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] エンゲージメント推定に基づくビデオ通話支援ロボット2019

    • Author(s)
      傳 思成, 福田悠人, 小林貴訓, 久野義徳
    • Organizer
      2019年電子情報通信学会総合大会
    • Related Report
      2018 Research-status Report
  • [Presentation] 瞬きの引き込み現象を援用した対話エージェント2018

    • Author(s)
      李 明輝, 福田 悠人, 小林 貴訓, 久野 義徳
    • Organizer
      情報処理学会コンピュータビジョンとイメージメディア研究会
    • Related Report
      2018 Research-status Report
  • [Presentation] 映像解析に基づく頑健・高速な心拍数計測手法2018

    • Author(s)
      大津耕陽, Tilottoma Das, 福田悠人, Lam Antony, 小林貴訓, 久野義徳
    • Organizer
      第24回画像センシングシンポジウム(SSII2018)
    • Related Report
      2018 Research-status Report
  • [Presentation] Classification of Emotions from Video Based Cardiac Pulse Estimation2018

    • Author(s)
      K. Das, A. Lam, H. Fukuda, Y. Kobayashi, and Y. Kuno
    • Organizer
      International Conference on Intelligent Computing (ICIC2018)
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Towards Taking Pulses Over YuTube to Determine Interest in Video Content2018

    • Author(s)
      A. Lam, K. Otsu, K. Das, and Y. Kuno
    • Organizer
      International Workshop on Frontiers of Computer Vision (IW-FCV2018)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] DNNに基づく感情推定手法の対話ロボットへの応用2018

    • Author(s)
      山本 祐介, 福田 悠人, 小林 貴訓, 久野 義徳
    • Organizer
      パターン計測シンポジウム
    • Related Report
      2017 Research-status Report
  • [Presentation] 人間の瞬きを再現した会話エージェント2018

    • Author(s)
      李明輝,福田悠人,小林貴訓,久野義徳
    • Organizer
      2018年電子情報通信学会総合大会
    • Related Report
      2017 Research-status Report
  • [Presentation] 発話状況認識に基づく遠隔対話支援エージェント2018

    • Author(s)
      及川開斗,福田悠人,久野義徳,小林貴訓
    • Organizer
      2018年電子情報通信学会総合大会学生ポスターセッション
    • Related Report
      2017 Research-status Report
  • [Presentation] Detecting Inner Emotions from Video Based Heart Rate Sensing2017

    • Author(s)
      K. Das, S. Ali, K. Otsu, H. Fukuda, A. Lam, Y. Kobayashi, and Y. Kuno
    • Organizer
      International Conference on Intelligent Computing (ICIC2017)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research

URL: 

Published: 2017-07-21   Modified: 2021-02-19  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi