• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Emotion Recognition from Multimodal Information Based on Synesthesia

Research Project

Project/Area Number 24650083
Research Category

Grant-in-Aid for Challenging Exploratory Research

Allocation TypeSingle-year Grants
Research Field Perception information processing/Intelligent robotics
Research InstitutionOsaka University

Principal Investigator

NAGAI Yukie  大阪大学, 工学研究科, 特任准教授(常勤) (30571632)

Project Period (FY) 2012-04-01 – 2014-03-31
Project Status Completed (Fiscal Year 2013)
Budget Amount *help
¥3,900,000 (Direct Cost: ¥3,000,000、Indirect Cost: ¥900,000)
Fiscal Year 2013: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2012: ¥2,730,000 (Direct Cost: ¥2,100,000、Indirect Cost: ¥630,000)
Keywords認知発達ロボティクス / 知能ロボティクス / 認知発達 / 情動 / 共感覚 / 人―ロボットインタラクション / マルチモーダル / 人ーロボットインタラクション / 発達 / 人-ロボットインタラクション
Research Abstract

Inspired by neuroscience and developmental studies, we have proposed a computational model for emotional development based on multimodal perceptual information. A synesthetic mechanism enables a robot first to detect invariant features among multiple modalities and then to extract emotion such as pleasure/unpleasure and moreover six basic emotions (i.e., happy, surprise, anger, etc.) by abstracting the features using a probabilistic neural network. Our hypothesis that among multiple modalities, tactile information leads to emotional development has been verified through our comparative experiments. These results yield new insights about neural mechanisms of emotional development and promising ideas for the design of computational models for emotion recognition.

Report

(3 results)
  • 2013 Annual Research Report   Final Research Report ( PDF )
  • 2012 Research-status Report

Research Products

(21 results)

All 2014 2013 Other

All Presentation (18 results) Remarks (3 results)

  • [Presentation] A Probabilistic Approach to Analyze Temporal Change of Emotion2014

    • Author(s)
      T. Horii, Y. Nagai, and M. Asada
    • Organizer
      in Proceedings of the ICIS2014 Pre-Conference on Computational Models of Infant Development
    • Place of Presentation
      Berlin, Germany (to appear)
    • Year and Date
      2014-07-02
    • Related Report
      2013 Final Research Report
  • [Presentation] ノンパラメトリックベイズモデルを用いた時系列生理指標解析に基づく情動推定の試み—乳児の情動発達過程の解明を目指して—2014

    • Author(s)
      堀井隆斗, 長井志江, 浅田稔
    • Organizer
      日本赤ちゃん学会第14回学術集会
    • Place of Presentation
      神奈川 (to appear)
    • Related Report
      2013 Final Research Report
  • [Presentation] 磁性エラストマーを利用した磁気式触覚センサ2014

    • Author(s)
      堀井隆斗, 長井志江, 浅田稔
    • Organizer
      日本機械学会ロボティクス・メカトロニクス講演会講演論文集
    • Place of Presentation
      富山 (1P1-X08)
    • Related Report
      2013 Final Research Report
  • [Presentation] 情動発達における接触コミュニケーションの役割 : 計算論的アプローチからの提言2014

    • Author(s)
      長井志江
    • Organizer
      日本発達心理学会第25回大会発表論文集
    • Place of Presentation
      京都
    • Related Report
      2013 Final Research Report
  • [Presentation] Toward analysis of emotional development using physiological and behavioral data2014

    • Author(s)
      T. Horii, Y. Nagai, and M. Asada
    • Organizer
      The HRI 2014 Workshop on HRI: A Bridge between Robotics and Neuroscience
    • Place of Presentation
      Bielefeld, Germany
    • Related Report
      2013 Annual Research Report
  • [Presentation] 情動発達における接触コミュニケーションの役割:計算論的アプローチからの提言2014

    • Author(s)
      長井志江
    • Organizer
      日本発達心理学会第25回大会
    • Place of Presentation
      京都
    • Related Report
      2013 Annual Research Report
  • [Presentation] A Probabilistic Approach to Analyze Temporal Change of Emotion2014

    • Author(s)
      T. Horii, Y. Nagai, and M. Asada
    • Organizer
      The ICIS2014 Pre-Conference on Computational Models of Infant Development
    • Place of Presentation
      Berlin, Germany
    • Related Report
      2013 Annual Research Report
  • [Presentation] ノンパラメトリックベイズモデルを用いた時系列生理指標解析に基づく情動推定の試み ―乳児の情動発達過程の解明を目指して―2014

    • Author(s)
      堀井隆斗, 長井志江, 浅田稔
    • Organizer
      日本赤ちゃん学会第14回学術集会
    • Place of Presentation
      神奈川
    • Related Report
      2013 Annual Research Report
  • [Presentation] 磁性エラストマーを利用した磁気式触覚センサ2014

    • Author(s)
      堀井隆斗, 長井志江, 浅田稔
    • Organizer
      日本機械学会ロボティクス・メカトロニクス講演会
    • Place of Presentation
      富山
    • Related Report
      2013 Annual Research Report
  • [Presentation] Toward analysis of emotional development using physiological and behavioral data2013

    • Author(s)
      T. Horii, Y. Nagai, and M. Asada
    • Organizer
      in Proceedings of the HRI 2014 Workshop on HRI : A Bridge between Robotics and Neuroscience
    • Place of Presentation
      Bielefeld, Germany
    • Year and Date
      2013-03-03
    • Related Report
      2013 Final Research Report
  • [Presentation] 乳児期の触覚優位性を利用した複数感覚情報の統合による情動分化モデル2013

    • Author(s)
      堀井隆斗, 長井志江, 浅田稔
    • Organizer
      第31回日本ロボット学会学術講演会予稿集
    • Place of Presentation
      東京 (1P3-04)
    • Related Report
      2013 Final Research Report
  • [Presentation] Touch and Emotion : Modeling of developmental differentiation of emotion lead by tactile dominance2013

    • Author(s)
      T. Horii, Y. Nagai, and M. Asada
    • Organizer
      in Proceedings of the 3rd IEEE International Conference on Development and Learning and on Epigenetic Robotics
    • Place of Presentation
      Osaka, Japan
    • Related Report
      2013 Final Research Report
  • [Presentation] 乳児期の触覚優位性に基づく情動分化モデル2013

    • Author(s)
      堀井隆斗, 長井志江, 浅田稔
    • Organizer
      日本赤ちゃん学会第13回学術集会
    • Place of Presentation
      福岡
    • Related Report
      2013 Annual Research Report 2013 Final Research Report
  • [Presentation] Cross-Cultural Recognition of Auditive Feedback Using Echo State Networks2013

    • Author(s)
      A. K. Philippsen, K. A. Mismahl, B. Wrede, and Y. Nagai
    • Organizer
      in Proceedings of 24. Konferenz zur Elektronischen Sprachsignalverarbeitung
    • Place of Presentation
      Bielefeld, Germany
    • Related Report
      2013 Final Research Report
  • [Presentation] Touch and Emotion: Modeling of developmental differentiation of emotion lead by tactile dominance2013

    • Author(s)
      T. Horii, Y. Nagai, and M. Asada
    • Organizer
      The 3rd IEEE International Conference on Development and Learning and on Epigenetic Robotics
    • Place of Presentation
      Osaka, Japan
    • Related Report
      2013 Annual Research Report
  • [Presentation] 乳児期の触覚優位性を利用した複数感覚情報の統合による情動分化モデル2013

    • Author(s)
      堀井隆斗, 長井志江, 浅田稔
    • Organizer
      第31回日本ロボット学会学術講演会
    • Place of Presentation
      東京
    • Related Report
      2013 Annual Research Report
  • [Presentation] Cross-Cultural Recognition of Auditive Feedback Using Echo State Networks2013

    • Author(s)
      A. K. Philippsen, K. A. Mismahl, B. Wrede, and Y. Nagai
    • Organizer
      24. Konferenz zur Elektronischen Sprachsignalverarbeitung
    • Place of Presentation
      Bielefeld, Germany
    • Related Report
      2012 Research-status Report
  • [Presentation] 乳児期の触覚優位性に基づく情動分化モデル2013

    • Author(s)
      堀井隆斗, 長井志江, 浅田稔
    • Organizer
      日本赤ちゃん学会第13回学術集会
    • Place of Presentation
      アクロス福岡
    • Related Report
      2012 Research-status Report
  • [Remarks] Yukie Nagai–Publications

    • URL

      http://cnr.ams.eng.osaka-u.ac.jp/~yukie/publications-jp.html

    • Related Report
      2013 Final Research Report
  • [Remarks] Yukie Nagai - Publications

    • URL

      http://cnr.ams.eng.osaka-u.ac.jp/~yukie/publications-jp.html

    • Related Report
      2013 Annual Research Report
  • [Remarks] Yukie Nagai - Publications

    • URL

      http://cnr.ams.eng.osaka-u.ac.jp/~yukie/publications-jp.html

    • Related Report
      2012 Research-status Report

URL: 

Published: 2013-05-31   Modified: 2019-07-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi