• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Relationship between paralinguistic information and head motion/facial expression

Research Project

Project/Area Number 20680011
Research Category

Grant-in-Aid for Young Scientists (A)

Allocation TypeSingle-year Grants
Research Field Perception information processing/Intelligent robotics
Research InstitutionAdvanced Telecommunications Research Institute International

Principal Investigator

ISHI CarlosToshinori  Advanced Telecommunications Research Institute International, 知能ロボティクス研究所, 研究員 (30418529)

Project Period (FY) 2008 – 2010
Project Status Completed (Fiscal Year 2010)
Budget Amount *help
¥21,450,000 (Direct Cost: ¥16,500,000、Indirect Cost: ¥4,950,000)
Fiscal Year 2010: ¥3,640,000 (Direct Cost: ¥2,800,000、Indirect Cost: ¥840,000)
Fiscal Year 2009: ¥8,060,000 (Direct Cost: ¥6,200,000、Indirect Cost: ¥1,860,000)
Fiscal Year 2008: ¥9,750,000 (Direct Cost: ¥7,500,000、Indirect Cost: ¥2,250,000)
Keywords音声情報処理 / 非言語情報 / 発話意図 / 頭部動作 / パラ言語情報 / 韻律 / 声質 / 表情 / 感情
Research Abstract

The present research aimed on clarifying the relationship between speaking styles including prosodic and voice quality features, paralinguistic information such as dialogue acts, intentions and emotions, and visual modalities like head motion and facial expression. As main results, we clarified the paralinguistic functions carried by breathy/whispery voices and "rikimi" voices, we clarified the relations between dialogue acts and head motion, and proposed and evaluated a model for generating nod and head tilt motion from the dialogue acts.

Report

(4 results)
  • 2010 Annual Research Report   Final Research Report ( PDF )
  • 2009 Annual Research Report
  • 2008 Annual Research Report
  • Research Products

    (17 results)

All 2011 2010 2009 2008

All Journal Article (3 results) (of which Peer Reviewed: 2 results) Presentation (14 results)

  • [Journal Article] Analysis of the roles and the dynamics of breathy and whispery voice qualities in dialogue speech.2010

    • Author(s)
      Ishi, C.T., Ishiguro, H., Hagita, N.
    • Journal Title

      EURASIP Journal on Audio, Speech, and Music Processing 2010 ID 528193

      Pages: 1-12

    • Related Report
      2010 Final Research Report
  • [Journal Article] Analysis of the roles and the dynamics of breathy and whispery voice qualities in dialogue speech2010

    • Author(s)
      Ishi, C.T., Ishiguro, H., Hagita, N.
    • Journal Title

      EURASIP Journal on Audio, Speech, and Music Processing 2010, ID 528193

      Pages: 1-12

    • Related Report
      2009 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Recognition of paralinguistic information using prosodic features related to intonation and voice quality2008

    • Author(s)
      Ishi, Carlos T.
    • Journal Title

      Speech Recognition, Technologies and Applications

      Pages: 377-394

    • Related Report
      2008 Annual Research Report
    • Peer Reviewed
  • [Presentation] 気息音発声の音響的表現の改善2011

    • Author(s)
      石井カルロス寿憲
    • Organizer
      日本音響学会2011年春季研究発表会
    • Place of Presentation
      東京
    • Year and Date
      2011-03-09
    • Related Report
      2010 Annual Research Report
  • [Presentation] りきまれる発話の使用場面2010

    • Author(s)
      Jun Arai
    • Organizer
      International Conference on Japanese Language Education (ICJLE2010)
    • Place of Presentation
      Taipei, Taiwan
    • Year and Date
      2010-07-31
    • Related Report
      2010 Annual Research Report
  • [Presentation] Acoustic, electroglottographic and paralinguistic analyses of "rikimi" in expressive speech2010

    • Author(s)
      Carlos T.Ishi
    • Organizer
      Speech Prosody 2010 (SP2010)
    • Place of Presentation
      Chicago, USA
    • Year and Date
      2010-05-14
    • Related Report
      2010 Annual Research Report
  • [Presentation] Head Motion during Dialogue Speech and Nod Timing Control in Humanoid Robots2010

    • Author(s)
      Ishi, C.T.
    • Organizer
      Human-Robot Interaction 2010 (HRI 10)
    • Place of Presentation
      Osaka
    • Year and Date
      2010-03-02
    • Related Report
      2009 Annual Research Report
  • [Presentation] Acoustic, electroglottographic and paralinguistic analyses of "rikimi" in expressive speech2010

    • Author(s)
      Ishi, C., Ishiguro, H., Hagita, N.
    • Organizer
      Proceedings of Speech Prosody 2010 (SP2010)(ID 100139, 1-4)
    • Related Report
      2010 Final Research Report
  • [Presentation] Head motion during dialogue speech and nod timing control in humanoid robots2010

    • Author(s)
      Ishi, C.T., Liu, C., Ishiguro, H., Hagita, N.
    • Organizer
      Proceedings of IEEE/RSJ Human Robot Interaction (HRI 2010)(293-300)
    • Related Report
      2010 Final Research Report
  • [Presentation] 声質の変化がもたらすパラ言語情報の分析2009

    • Author(s)
      石井カルロス寿憲
    • Organizer
      日本音響学会2009年秋季研究発表会
    • Place of Presentation
      郡山(福島県)
    • Year and Date
      2009-09-15
    • Related Report
      2009 Annual Research Report
  • [Presentation] 自然対話音声における韻律特徴とコミュニケーションにおける機能の分析2009

    • Author(s)
      石井カルロス寿憲
    • Organizer
      人工知能学会第56回言語.音声理解と対話処理研究会(SIG-SLUD-A901)
    • Place of Presentation
      北見(北海道)
    • Year and Date
      2009-07-24
    • Related Report
      2009 Annual Research Report
  • [Presentation] Analysis of inter- and intra-speaker variability of head motions during spoken dialogue2008

    • Author(s)
      Ishi, Carlos T.
    • Organizer
      International Conference on Auditory-Visual Speech Processing 2008 (AVSP' 2008)
    • Place of Presentation
      Tangalooma, Australia
    • Year and Date
      2008-09-27
    • Related Report
      2008 Annual Research Report
  • [Presentation] The meanings of interjections in spontaneous speech2008

    • Author(s)
      Ishi, Carlos T.
    • Organizer
      The 9th Annual Conference of the International Speech Communication Association (Interspeech' 2008)
    • Place of Presentation
      Brisbane, Australia
    • Year and Date
      2008-09-24
    • Related Report
      2008 Annual Research Report
  • [Presentation] 自然発話に現れる感動詞の発話スタイルと機能の分析2008

    • Author(s)
      Ishi, Carlos T.
    • Organizer
      日本音響学会2008年秋季研究発表会
    • Place of Presentation
      福岡
    • Year and Date
      2008-09-11
    • Related Report
      2008 Annual Research Report
  • [Presentation] Analysis of inter- and intra-speaker variability of head motions during spoken dialogue2008

    • Author(s)
      Ishi, C.T., Ishiguro, H., Hagita, N.
    • Organizer
      Proceedings of the International Conference on Auditory-Visual Speech Processing 2008 (AVSP' 2008)(37-42)
    • Related Report
      2010 Final Research Report
  • [Presentation] The meanings of interjections in spontaneous speech2008

    • Author(s)
      Ishi, C.T., Ishiguro, H., Hagita, N.
    • Organizer
      Proceedings of The 9th Annual Conference of the International Speech Communication Association (Interspeech' 2008)(1208-1211)
    • Related Report
      2010 Final Research Report
  • [Presentation] The roles of breathy/whispery voice qualities in dialogue speech2008

    • Author(s)
      Ishi, C.T., Ishiguro, H., Hagita, N.
    • Organizer
      Proceedings of Speech Prosody 2008(45-48)
    • Related Report
      2010 Final Research Report

URL: 

Published: 2008-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi