• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to project page

2009 Fiscal Year Final Research Report

Speech synthesis with communicative prosody driven by the impressions of output lexicons

Research Project

  • PDF
Project/Area Number 18300063
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Perception information processing/Intelligent robotics
Research InstitutionWaseda University

Principal Investigator

SAGISAKA Yoshinori  Waseda University, 理工学術院, 教授 (70339737)

Co-Investigator(Renkei-kenkyūsha) KOBAYASHI Tetsunori  早稲田大学, 理工学術院, 教授 (30162001)
NONDA Masaaki  早稲田大学, スポーツ科学学術院, 教授 (90367095)
Project Period (FY) 2006 – 2009
Keywords音声情報処理
Research Abstract

A scheme for communicative prosody generation was proposed to synthesize speech needed for conversational purposes. Using the correlation between communicative prosody and impression attributes of lexicons constituting output, the proposed scheme enables prosody control for conversational speech output. Perceptual experiments showed the superiority of the speech synthesized with the proposed communicative prosody to the conventional one with reading style prosody. Further application to Chinese and English speech synthesis and the reverse technology of impression extraction from speech clarified the usefulness of the proposed approach.

  • Research Products

    (18 results)

All 2009 2008 2007 2006 Other

All Journal Article (2 results) (of which Peer Reviewed: 2 results) Presentation (14 results) Book (2 results)

  • [Journal Article] Analysis on paralinguistic prosody control in perceptual impression space using multiple dimensional scaling2009

    • Author(s)
      Y. Greenberg, N. Shibuya, M. Tsuzaki, H. Kato, Y. Sagisaka
    • Journal Title

      Speech Communication Vol.51No.7

      Pages: 585-593

    • Peer Reviewed
  • [Journal Article] Towards Computing Phonetics2008

    • Author(s)
      Yoshinori Sagisaka
    • Journal Title

      中国語音学報 Vol.1

      Pages: 23-37

    • Peer Reviewed
  • [Presentation] Computing prosody variations2009

    • Author(s)
      Y. Sagisaka, H. Kato, M. Tsuzaki, Y. Greenberg S. Nakamura, C. Hansakunbuntheung
    • Organizer
      Proc. IWSLPR (CDROM)
    • Place of Presentation
      Kalkota(India)
    • Year and Date
      20090000
  • [Presentation] Communicative prosody generation using language common features provided by input lexicons2009

    • Author(s)
      Y. Greenberg, M. Tsuzaki, H. Kato, Y. Sagisaka
    • Organizer
      Proc. SNLP
    • Place of Presentation
      Bangkok(Thailand)
    • Year and Date
      20090000
  • [Presentation] Corpus-based speech synthesis from reading speech to communicative speech2008

    • Author(s)
      Y. Sagisaka
    • Organizer
      The first International Workshop on Spoken Languages Technologies for Under-resourced languages
    • Place of Presentation
      Hanoi(Vietnam)
    • Year and Date
      20080000
  • [Presentation] Automatic extraction of paralinguistic information from communicative speech2007

    • Author(s)
      M. Zhu, K. Li, Y. Greenberg, Y. Sagisaka
    • Organizer
      Proc. the 7th Symposium on Natural Language Processing 2007
    • Place of Presentation
      Pattaya(Thailand)
    • Year and Date
      20070000
  • [Presentation] Inter-language prosodic style modification experiment using word impression vector for communicative speech generation2007

    • Author(s)
      K. Li, Y. Greenberg, Y. Sagisaka
    • Organizer
      Proc. Interspeech 2007
    • Place of Presentation
      Vietri sul Male(Italy)
    • Year and Date
      20070000
  • [Presentation] Prosody Generation for Communicative Speech Synthesis2007

    • Author(s)
      Y. Sagisaka
    • Organizer
      Proc. Taiwan-Japan Joint Workshop on Speech Science and Technologies
    • Place of Presentation
      台北(台湾)
    • Year and Date
      20070000
  • [Presentation] 自然発話の韻律情報に基づく聴覚印象の自動抽出2007

    • Author(s)
      朱明朝, 李克, グリーンバーグ陽子, 匂坂芳典
    • Organizer
      日本音響学会2007年秋季研究発表会講演
    • Place of Presentation
      山梨
    • Year and Date
      20070000
  • [Presentation] 印象表現ベクトルに基づく言語間韻律変換2007

    • Author(s)
      李克, グリーンバーグ陽子, 匂坂芳典
    • Organizer
      日本音響学会2007年秋季研究発表会講演
    • Place of Presentation
      山梨
    • Year and Date
      20070000
  • [Presentation] 音声研究の輝かしい展開を求めて-数理モデルからの提案-2006

    • Author(s)
      匂坂芳典
    • Organizer
      日本音声学会創立80周年記念フォーラム資料
    • Place of Presentation
      東京
    • Year and Date
      20060900
  • [Presentation] Towards Computing Phonetics2006

    • Author(s)
      Y. Sagisaka
    • Organizer
      Proc. The 7th Phonetic Conference of China and International forum on Phonetic Frontiers.
    • Place of Presentation
      北京(中国)
    • Year and Date
      20060000
  • [Presentation] A trial of communicative prosody generation based on control characteristic of one word utterance observed in real conversational speech2006

    • Author(s)
      Y. Greenberg, N. Shibuya, M. Tsuzaki, H. Kato, Y. Sagisaka
    • Organizer
      Proc. Speech prosody
    • Place of Presentation
      Dresden(Germany)
    • Year and Date
      20060000
  • [Presentation] 印象表現によるパラ言語情報を用いた韻律制御2006

    • Author(s)
      李克, グリーンバーグ陽子, 渋谷渚, 匂坂芳典
    • Organizer
      2006年秋季日本音響学会講演
    • Place of Presentation
      金沢
    • Year and Date
      20060000
  • [Presentation] Synthesis and Recognition of Communicative Prosody

    • Author(s)
      Y. Sagisaka, Y. Greenberg, K. Li, M. Zhu, M. Tsuzaki, H. Kato
    • Organizer
      The 8th Phonetic Conference of China and International Symposium on Phonetic Frontiers 2008
    • Place of Presentation
      北京
  • [Presentation] Communicative prosody processing for synthesis and recognition of para-linguistic information

    • Author(s)
      Y. Sagisaka, Y. Greenberg, K. Li, M. Zhu, M. Tsuzaki, H. Kato
    • Organizer
      ICCA 2008
    • Place of Presentation
      Yangon(Myanmar)
  • [Book] On the analysis of F0 control characteristics of nonverbal utterances and its application to communicative prosody generation2007

    • Author(s)
      K. Li, Y. Greenberg, N. Shibuya, N. Campbell, Y. Sagisaka
    • Total Pages
      179-183
    • Publisher
      IOS Press
  • [Book] 語彙情報を用いた会話韻律生成について2006

    • Author(s)
      匂坂芳典, グリーンバーグ陽子, 山下琢美
    • Total Pages
      135-145
    • Publisher
      くろしお出版

URL: 

Published: 2011-06-18   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi