• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Facial Expression Reading for Describing and Augmenting Interaction

Research Project

Project/Area Number 23680009
Research Category

Grant-in-Aid for Young Scientists (A)

Allocation TypeSingle-year Grants
Research Field Media informatics/Database
Research InstitutionUniversity of Tsukuba

Principal Investigator

SUZUKI Kenji  筑波大学, システム情報系, 准教授 (30350474)

Project Period (FY) 2011-04-01 – 2014-03-31
Project Status Completed (Fiscal Year 2013)
Budget Amount *help
¥26,910,000 (Direct Cost: ¥20,700,000、Indirect Cost: ¥6,210,000)
Fiscal Year 2013: ¥6,240,000 (Direct Cost: ¥4,800,000、Indirect Cost: ¥1,440,000)
Fiscal Year 2012: ¥8,970,000 (Direct Cost: ¥6,900,000、Indirect Cost: ¥2,070,000)
Fiscal Year 2011: ¥11,700,000 (Direct Cost: ¥9,000,000、Indirect Cost: ¥2,700,000)
Keywords表情計測 / 人支援技術 / 拡張生体技術 / 装着型インタフェース / 感性情報処理 / 表情計測技術 / ウェアラブルインタフェース / 表情筋活動 / ソーシャルロボット / 表情識別 / 生体電位信号 / 広汎性発達障害 / 人間型ロボット
Research Abstract

In this study, we investigated the design of a wearable device that reads positive facial expressions using physiological signals. We can detect EMG signals with high amplitude on areas of low facial mobility on the side of the face, which are correlated to ones obtained from electrodes on traditional surface EMG capturing positions on top of facial muscles on the front of the face. Based on this analysis, we design and implement an ergonomic wearable device with high reliability. Because the signals are recorded distally, the proposed device uses Independent Component Analysis and an Artificial Neural Network to analyze them and achieve a high facial expression recognition rate on the side of the face. The recognized emotional facial expressions through the wearable interface device can be recorded during therapeutic interventions and can be used for a novel method of human robot interaction.

Report

(4 results)
  • 2013 Annual Research Report   Final Research Report ( PDF )
  • 2012 Annual Research Report
  • 2011 Annual Research Report
  • Research Products

    (33 results)

All 2014 2013 2012 2011 Other

All Journal Article (12 results) (of which Peer Reviewed: 12 results) Presentation (17 results) (of which Invited: 2 results) Book (2 results) Remarks (2 results)

  • [Journal Article] Design of a Wearable Device for Reading Positive Expressions from Facial EMG Signals2014

    • Author(s)
      Gruebler, A., and Suzuki, K.
    • Journal Title

      IEEE Transactions on Affective Computing

      Volume: (印刷中)

    • Related Report
      2013 Annual Research Report 2013 Final Research Report
    • Peer Reviewed
  • [Journal Article] Targets-Drives-Means : A Declarative Approach to Dynamic Behavior Specification with Higher Usability2014

    • Author(s)
      Berenz V., Suzuki K.
    • Journal Title

      Robotics and Autonomous Systems

      Volume: 62(4) Pages: 545-555

    • Related Report
      2013 Final Research Report
    • Peer Reviewed
  • [Journal Article] The Smiles of a Child with Autism Spectrum Disorder During an Animal-assisted Activity May Facilitate Social Positive Behaviors - Quantitative Analysis with Smile-detecting Interface2014

    • Author(s)
      Funahashi, A., Gruebler, A., Aoki, T., Kadone, H., Suzuki, K.
    • Journal Title

      Journal of Autism and Developmental Disorders

      Volume: 44(3) Pages: 685-693

    • Related Report
      2013 Annual Research Report 2013 Final Research Report
    • Peer Reviewed
  • [Journal Article] An Approach to Subjective Computing : a Robot that Learns from Interaction with Humans2014

    • Author(s)
      Grüneberg, P. and Suzuki, K.
    • Journal Title

      IEEE Transactions on Autonomous Mental Development

      Volume: 6(1) Pages: 5-18

    • Related Report
      2013 Final Research Report
    • Peer Reviewed
  • [Journal Article] An Approach to Subjective Computing: a Robot that Learns from Interaction with Humans2014

    • Author(s)
      Gruneberg, P. and Suzuki, K.
    • Journal Title

      IEEE Transactions on Autonomous Mental Development

      Volume: 6 Issue: 1 Pages: 5-18

    • DOI

      10.1109/tamd.2013.2271739

    • Related Report
      2013 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Coaching robots with biosignals based on human affective social behaviors2013

    • Author(s)
      Suzuki, K., Gruebler, A., Berenz, V.
    • Journal Title

      Proc. 8th ACM/IEEE International Conference on Human-Robot Interaction

      Volume: なし Pages: 419-419

    • DOI

      10.1109/hri.2013.6483626

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Emotionally Assisted Human-Robot Interaction using a Wearable Device for Reading Facial Expressions2012

    • Author(s)
      Gruebler, A., Berenz, V., and Suzuki, K.
    • Journal Title

      Advanced Robotics

      Volume: 26(10) Pages: 1143-1159

    • Related Report
      2013 Final Research Report
    • Peer Reviewed
  • [Journal Article] Emotionally Assisted Human-Robot Interaction Using a Wearable Device for Reading Facial Expressions2012

    • Author(s)
      Gruebler, A., Berenz, V., and Suzuki, K.,
    • Journal Title

      Advanced Robotics

      Volume: 26(10) Issue: 10 Pages: 1143-1159

    • DOI

      10.1080/01691864.2012.686349

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Analysis of social smile sharing using a wearable device that captures distal electromyographic signals2012

    • Author(s)
      Gruebler, A., Suzuki, K.
    • Journal Title

      Proc. of 3rd Int. Conf. on Emerging Security Technologies

      Volume: なし Pages: 178-181

    • DOI

      10.1109/est.2012.38

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Emotionally Assisted Human-Robot Interaction Using a Wearable Device for Reading Facial Expressions2012

    • Author(s)
      Gruebler, A., Berenz, V., Suzuki, K.,
    • Journal Title

      Advanced Robotics

      Volume: 26(10)(印刷中)

    • Related Report
      2011 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Coaching Robot Behavior Using Continuous Physiological Affective Feedback2011

    • Author(s)
      Gruebler, A., Berenz, V., Suzuki, K.
    • Journal Title

      Proc.of IEEE-RAS International Conference on Humanoid Robots

      Pages: 466-471

    • DOI

      10.1109/humanoids.2011.6100888

    • Related Report
      2011 Annual Research Report
    • Peer Reviewed
  • [Journal Article] TDM : A Software Framework for Elegant and Rapid Development of Autonomous Behaviors for Humanoid Robots2011

    • Author(s)
      Berenz, V., Suzuki, K.
    • Journal Title

      Proc.of IEEE-RAS International Conference on Humanoid Robots

      Pages: 179-186

    • DOI

      10.1109/humanoids.2011.6100887

    • Related Report
      2011 Annual Research Report
    • Peer Reviewed
  • [Presentation] A Doll-type Interface for Real-Time Humanoid Teleoperation in Robot-Assisted Activity: A Case Study2014

    • Author(s)
      Hirokawa, M., Funahashi, A., Suzuki, K.
    • Organizer
      9th ACM/IEEE International Conference on Human-Robot Interaction
    • Place of Presentation
      Bielefeld, Germany
    • Related Report
      2013 Annual Research Report
  • [Presentation] Smiles May Facilitate Social Positive Behaviors2013

    • Author(s)
      鈴木健嗣
    • Organizer
      Humascend 2013 Workshop
    • Place of Presentation
      英国・マンチェスター
    • Year and Date
      2013-10-10
    • Related Report
      2013 Final Research Report
    • Invited
  • [Presentation] Smiles May Facilitate Social Positive Behaviors2013

    • Author(s)
      鈴木健嗣
    • Organizer
      First Symposium on Computational Behavioral Science
    • Place of Presentation
      湘南国際村センター、神奈川
    • Year and Date
      2013-09-26
    • Related Report
      2013 Final Research Report
    • Invited
  • [Presentation] 行動と情動の理解を目指す行動科学とリハビリテーション応用2013

    • Author(s)
      鈴木健嗣
    • Organizer
      行動リハビリテーション研究会
    • Place of Presentation
      慶応義塾大学三田キャンパス、東京
    • Year and Date
      2013-06-16
    • Related Report
      2013 Final Research Report
  • [Presentation] Coaching robots with biosignals based on human affective social behaviors2013

    • Author(s)
      Suzuki, K., Gruebler, A., Berenz, V.
    • Organizer
      Proc. ACM/IEEE Intl. Conf. on Human-Robot Interaction
    • Place of Presentation
      日本科学未来館、東京, (pp. 419)
    • Related Report
      2013 Final Research Report
  • [Presentation] Analysis of Social Smile Sharing Using a Wearable Device that Captures Distal Electromyographic Signals2012

    • Author(s)
      Gruebler, A., and Suzuki, K.
    • Organizer
      Proc. of Third International Conference on Emerging Security Technologies
    • Place of Presentation
      英国・マンチェスター, (pp. 178-181)
    • Related Report
      2013 Final Research Report
  • [Presentation] Usability Benchmarks of the Targets-Drives -Means Robotic Architecture2012

    • Author(s)
      Berenz, V. and Suzuki, K.
    • Organizer
      Prof. of 2012 12th IEEE-RAS International Conference on Humanoid Robots
    • Place of Presentation
      大阪産業創造館、大阪, (pp. 514–519)
    • Related Report
      2013 Final Research Report
  • [Presentation] Coaching Robot Behavior Using Continuous Physiological Affective Feedback2011

    • Author(s)
      Gruebler, A., Suzuki, K.
    • Organizer
      IEEE-RAS International Conference on Humanoid Robots
    • Place of Presentation
      Golf Hotel, Bled, Slovenia
    • Year and Date
      2011-10-27
    • Related Report
      2011 Annual Research Report
  • [Presentation] TDM : A Software Framework for Elegant and Rapid Development of Autonomous Behaviors for Humanoid Robots2011

    • Author(s)
      Berenz, V., Suzuki, K.
    • Organizer
      IEEE-RAS International Conference on Humanoid Robots
    • Place of Presentation
      Golf Hotel, Bled, Slovenia
    • Year and Date
      2011-10-27
    • Related Report
      2011 Annual Research Report
  • [Presentation] 人支援技術~こころとからだをつなぐテクノロジー2011

    • Author(s)
      鈴木健嗣
    • Organizer
      脳から読み解く行動のメカニズム~発達・視覚・工学の視点から
    • Place of Presentation
      工学院大学(東京都)(招待講演)
    • Year and Date
      2011-06-10
    • Related Report
      2011 Annual Research Report
  • [Presentation] DM : A Software Framework for Elegant and Rapid Development of Autonomous Behaviors for Humanoid Robots2011

    • Author(s)
      Berenz, V., Suzuki, K.
    • Organizer
      Proc. of IEEE-RAS International Conference on Humanoid Robots
    • Place of Presentation
      スロベニア・ブレド, (pp. 179-186)
    • Related Report
      2013 Final Research Report
  • [Presentation] Coaching robot behavior using continuous physiological affective feedback2011

    • Author(s)
      Gruebler, A., Berenz, V., Suzuki, K.
    • Organizer
      Proc. of IEEE-RAS International Conference on Humanoid Robots
    • Place of Presentation
      スロベニア・ブレド, (pp. 466-471)
    • Related Report
      2013 Final Research Report
  • [Presentation] Depth Image based Analysis of Facial Expressions and Head Orientation2011

    • Author(s)
      Isezaki, T., Suzuki, K.
    • Organizer
      Proc. of IEEE International Conference on System, Man and Cybernetics
    • Place of Presentation
      米国・アンカレッジ, (pp. 2537-2542)
    • Related Report
      2013 Final Research Report
  • [Presentation] Kinematic and Physiological Cues for Human System Interaction2011

    • Author(s)
      Suzuki, K., Kadone, H., and Gruebler, A.
    • Organizer
      Proc. of 4th International Conference on Human System Interactions
    • Place of Presentation
      慶応義塾大学、神奈川, (pp. 415–418)
    • Related Report
      2013 Final Research Report
  • [Presentation] Social Smile sharing analysis from physiological signals using a wearable device

    • Author(s)
      Gruebler, A. and Suzuki, K.
    • Organizer
      International Conference on Human-Machine Systems, Cyborgs and Enhancing Devices
    • Place of Presentation
      Iasi, Romania
    • Related Report
      2012 Annual Research Report
  • [Presentation] Quantitative Analysis of Positive Facial Expressions of Children with Autism Spectrum Disorder using a Wearable Device that Captures Distal EMG

    • Author(s)
      Gruebler, A., Funahashi A., Kadone, H., Aoki, T., Suzuki, K.
    • Organizer
      Proc. 35th Annual Meeting of the Japan Neuroscience Society
    • Place of Presentation
      Kyoto, Japan
    • Related Report
      2012 Annual Research Report
  • [Presentation] On the Analysis of Eye-Contact of Children with Autism Spectrum Disorders in Robot-Assisted Activities

    • Author(s)
      Hirokawa, M., Funahashi, A., Suzuki, K.
    • Organizer
      8th ACM/IEEE International Conference on Human-Robot Interaction, HRI Face-to-Face: Gaze and Speech Communication Workshop
    • Place of Presentation
      Tokyo, Japan
    • Related Report
      2012 Annual Research Report
  • [Book] Cybernics, (ISBN : 978-4431541585)2014

    • Author(s)
      Sankai, Y., Suzuki, K., and Hasegawa, Y. (eds.)
    • Related Report
      2013 Final Research Report
  • [Book] 顔を科学する:適応と障害の脳科学, 表情を測る技術と装う技術2013

    • Author(s)
      鈴木健嗣,高野ルリ子, (山口真美,柿木隆介編)
    • Publisher
      東京大学出版会
    • Related Report
      2013 Final Research Report
  • [Remarks] ホームページ

    • URL

      http://www.ai.iit.tsukuba.ac.jp/research-j.html

    • Related Report
      2013 Final Research Report
  • [Remarks] Emotion Reader:装着型表情識別インタフェース

    • URL

      http://www.ai.iit.tsukuba.ac.jp/research/014-j.html

    • Related Report
      2013 Annual Research Report

URL: 

Published: 2011-04-06   Modified: 2019-07-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi