• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

A study on an emotion model for prosody control and dialog management in speech communication

Research Project

Project/Area Number 17500079
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field Media informatics/Database
Research InstitutionTokyo University of Technology

Principal Investigator

OHNO Sumio  Tokyo University of Technology, School of Computer Science, Associate Professor, コンピュータサイエンス学部, 助教授 (80256677)

Co-Investigator(Kenkyū-buntansha) KAMEDA Hiroyuki  Tokyo University of Technology, School of Computer Science, Associate Professor, コンピュータサイエンス学部, 助教授 (00194994)
Project Period (FY) 2005 – 2006
Project Status Completed (Fiscal Year 2006)
Budget Amount *help
¥3,100,000 (Direct Cost: ¥3,100,000)
Fiscal Year 2006: ¥1,400,000 (Direct Cost: ¥1,400,000)
Fiscal Year 2005: ¥1,700,000 (Direct Cost: ¥1,700,000)
Keywordsspoken utterance / emotion / spoken language model / prosody / mind model / 音声情報処理 / 感情表現 / 基本周波数パターン
Research Abstract

In this scientific research project, it was achieved that a conversational system can process the emotion, and the object was 1) concerning the spoken expression of the emotional utterances and 2) concerning the modeling emotions in a dialog management. The following results were obtained in this project.
1) Emotional expression of synthetic speech
Not only the kind of emotions but also the levels of their strength were our research targets. Four emotions, i.e., "Joy", "Sadness", "Anger", and "Fear" were taken up as a kind of feelings, and prosodic features of the emotional utterances were examined by collecting and analyzing it for synthesizing expressive speech with controlling the level of the emotion. The controlling rule war formulated on the basis of a linear modeling of obtained prosodic parameters. The evaluation experiment was conducted by a synthetic speech. As a result, emotional strength control can be realized with a limitation of the kinds of emotions. A relatively good performance was obtained for "sadness" and "fear" in case of controlling the pitch features.
2) Modeling of emotions in dialog management
When the processing of the expression of emotion is taken to the conversation between human and machine, advanced communications function is achieved by guessing other's emotions. It proposed an engineering model of the mind. The knowledge representation in the model of the mind was defined from the viewpoint of "Own inner environment", "Own inner environment from others" and "Own external environment from others", and emotions located it with one parameter of an inner environment. Moreover, the guess method by the inference-by-synthesis technique was designed as a processing technique for the others recognition in the model of the mind.

Report

(3 results)
  • 2006 Annual Research Report   Final Research Report Summary
  • 2005 Annual Research Report
  • Research Products

    (26 results)

All 2007 2006 2005

All Journal Article (26 results)

  • [Journal Article] 程度の異なる感情音声に対する韻律的特徴の分析2007

    • Author(s)
      河津宏美
    • Journal Title

      日本音響学会2007年春季研究発表会講演論文集

      Pages: 233-234

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Analysis of the prosodic feature of the emotional utterances which express various degreed of the emotion2007

    • Author(s)
      Hiromi Kawatsu, Sumio Ohno
    • Journal Title

      Reports of 2007 spring meeting of Acoustical Society of Japan

      Pages: 233-234

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] 程度の異なる感情音声に対する韻律的特徴の分析2007

    • Author(s)
      河津宏美
    • Journal Title

      日本音響学会2007春季研究発表会講演論文集

      Pages: 233-234

    • Related Report
      2006 Annual Research Report
  • [Journal Article] 癒し系ロボットPDDINの分析および福祉と認知リハビリテーションへの応用に関する研究2007

    • Author(s)
      小澤朋之
    • Journal Title

      電子情報通信学会技術研究報告 TL2006-66(WIT2006-98)

      Pages: 55-60

    • Related Report
      2006 Annual Research Report
  • [Journal Article] 癒し系ロボットPDDIN2005~状況と対話者感情を考慮した発話と行動~2006

    • Author(s)
      小澤朋之
    • Journal Title

      電子情報通信学会技術研究報告 TL2005-96

      Pages: 171-176

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] 感情の程度に対する基本周波数パターンの特徴量の個人差2006

    • Author(s)
      長島大介
    • Journal Title

      日本音響学会2006年春季研究発表会講演論文集

      Pages: 217-218

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary 2005 Annual Research Report
  • [Journal Article] 生成過程モデルに基づく感情表現におけるF0パターン制御規則の導出と合成音声による評価2006

    • Author(s)
      河津宏美
    • Journal Title

      電子情報通信学会論文誌D J89-D・8

      Pages: 1811-1819

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] 心のモデルとそれに基づく感情・意図推測方法2006

    • Author(s)
      亀田弘之
    • Journal Title

      電子情報通信学会技術研究報告 TL2006-29

      Pages: 13-18

    • NAID

      110004851955

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Annual Research Report 2006 Final Research Report Summary
  • [Journal Article] Healing robot PDDIN2005--speech and action of a robot with abilities of considering its situations and interlocutor's feelings--2006

    • Author(s)
      Tomoyuki Ozawa, Toshinobu Harada, Kazuhito Yamaguchi, Yousuke Sasaki, Nobusuke Takai, Takuma Obata, Hiroyuki Kameda
    • Journal Title

      IEICE Technical Report TL2005-96

      Pages: 171-176

    • NAID

      110004662947

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Intra-speaker difference on fundamental frequency contours for several levels of emotional expressions2006

    • Author(s)
      Daisuke Nagashima, Hiromi Kawatsu, Sumio Ohno
    • Journal Title

      Reports of 2006 spring meeting of Acoustical Society of Japan

      Pages: 217-218

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Rules and evaluation for controlling the fundamental frequency contours with various degrees of emotion based on a model for the process of generation2006

    • Author(s)
      Hiromi Kawatsu, Daisuke Nagashima, Sumio Ohno
    • Journal Title

      The IEICE Transactions on Information and Systems Vol. J89-D, No. 8

      Pages: 1811-1819

    • NAID

      110007380519

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Model of mind and a method of guessing emotions and intentions based on them2006

    • Author(s)
      Hiroyuki Kameda, Tomoyuki Ozawa, Hajime Namba
    • Journal Title

      IEICE Technical Report TL2006-29

      Pages: 13-18

    • NAID

      110004851955

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] 生成過程モデルに基づく感情表現におけるFOパターン制御規則の導出と合成音声による評価2006

    • Author(s)
      河津 宏美
    • Journal Title

      電子情報通信学会論文誌D J89-D・8

      Pages: 1811-1819

    • Related Report
      2006 Annual Research Report
  • [Journal Article] 感情の強さを制御可能な音声合成のためのFOパターン生成2006

    • Author(s)
      河津 宏美
    • Journal Title

      日本音響学会2006年秋季研究発表会講演論文集

      Pages: 177-178

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Analysis of fundamental frequency contours for Japanese utterances that express several degrees four emotions-joy, sadness, anger, and fear2006

    • Author(s)
      Hiromi Kawatsu
    • Journal Title

      The Journal of the Axoustical Society of America 120・5(2)

      Pages: 3089-3089

    • Related Report
      2006 Annual Research Report
  • [Journal Article] 癒し系ロボットPDDIN2005〜状況と対話者感情を考慮した発話と行動〜2006

    • Author(s)
      小澤朋之
    • Journal Title

      電子情報通信学会技術報告 TL2005-96

      Pages: 171-176

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 感情音声に対する韻律制御指令の生起タイミングの検討2006

    • Author(s)
      河津宏美
    • Journal Title

      日本音響学会2006年春季研究発表会講演論文集

      Pages: 215-216

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 「怒り」の感情表現とその言語表現-音響的特徴2006

    • Author(s)
      有本泰子
    • Journal Title

      言語処理学会第12回年次大会ワークショップ「感情・評価・言語と態度」論文集

      Pages: 53-56

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 感情音声の収録と言語表現に現れる感情表現の分析2006

    • Author(s)
      有本泰子
    • Journal Title

      2006年電子情報通信学会総合大会講演論文集

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Analysis of the relationship between F0 contour parameters and perceived degree of emotion in Japanese utterances2005

    • Author(s)
      Hiromi Kawatsu
    • Journal Title

      Proceedings of the 10^<th> International Conference on Speech and Computer 2

      Pages: 445-448

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Analysis of the relationship between FO contour parameters and perceived degree of emotion in Japanese utterances2005

    • Author(s)
      Hiromi Kawatsu, Daisuke Nagashima, Sumio Ohno
    • Journal Title

      Proceedings of the 10^<th> International Conference on Speech and Computer (SPECOM 2005)

      Pages: 445-448

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] 韻律生成過程モデルに基づく4種の感情表現の特徴の分析2005

    • Author(s)
      長島大介
    • Journal Title

      日本音響学会2005年秋季研究発表会講演論文集

      Pages: 223-224

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 決定木による「怒り」識別のための音響的特徴の検討と評価2005

    • Author(s)
      有本泰子
    • Journal Title

      日本音響学会2005年秋季研究発表会講演論文集

      Pages: 225-226

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 生成過程モデルパラメータに基づく感情制御規則を適用した合成音声の評価2005

    • Author(s)
      河津宏美
    • Journal Title

      日本音響学会2005年秋季研究発表会講演論文集

      Pages: 229-230

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Analysis of the relationship between F0 contour parameters and perceived degree of emotion in Japanese utterances2005

    • Author(s)
      Hiromi Kawatsu
    • Journal Title

      Proceedings of the 10th International Conference on Speech and Computer 2

      Pages: 445-448

    • Related Report
      2005 Annual Research Report
  • [Journal Article] A method for discriminating anger utterances from other utterances using suitable acoustic features2005

    • Author(s)
      Yoshiko Arimoto
    • Journal Title

      Proceedings of the 10th International Conference on Speech and Computer 2

      Pages: 613-616

    • Related Report
      2005 Annual Research Report

URL: 

Published: 2005-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi