• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to project page

2008 Fiscal Year Final Research Report

A study concerning the development of a support system for studying English emotions using synthesized audio and audiovisual models

Research Project

  • PDF
Project/Area Number 19509003
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field Intelligent informatics
Research InstitutionChubu University

Principal Investigator

ISEI-JAAKKOLA Toshiko  Chubu University, 人文学部, 教授 (00454364)

Co-Investigator(Kenkyū-buntansha) HIROSE Keikichi  東京大学, 情報理工学系研究科, 教授 (50111472)
MORISHIMA Shigeo  早稲田大学, 理工学術院, 教授 (10200411)
Project Period (FY) 2007 – 2008
Keywords英語 / 情動・感情 / 学習支援システム / 音声映像 / 音声合成・顔合成 / 韻律 / 学習者
Research Abstract

情動認知に関しては, 文化差(同時に母語の言語系統の差)が関係し, また, 情動・感情ごとに差異があるということも判明した。情動の認知結果と物理音響特性(距離)の相関に関しては, 基本周波数よりも音圧の方がより相関が高いことも分かった。顔合成と音声との同期は極めて難しい課題であることがわかった。時間変化と音声の変化および顔の変化をすべて統合して合成することは現在の技術では不可能に近いことが判明した。

  • Research Products

    (24 results)

All 2009 2008 2007

All Journal Article (16 results) (of which Peer Reviewed: 4 results) Presentation (8 results)

  • [Journal Article] 音と同期した3DCGを用いた日本人英語学習者に苦手な構音運動のためのトレーニングシステム-唇の突き出し2009

    • Author(s)
      ヤーッコラ伊勢井敏子, 鈴木茂樹, 広瀬啓吉, 森島繁生
    • Journal Title

      日本音響学会秋季大会講演論文集

      Pages: 369-370

  • [Journal Article] 英語情動文"I love you"の中国語話者による認知と音響特性相関(2)2009

    • Author(s)
      ヤーッコラ伊勢井敏子, 広瀬啓吉, 森島繁生
    • Journal Title

      日本音響学会秋季大会講演論文集

      Pages: 483-484

  • [Journal Article] 3Dフォルマント母音図における発声母音のリアルタイム可視化2009

    • Author(s)
      佐伯拓郎, 中貴俊, ヤーッコラ伊勢井敏子, 遠藤守, 山田雅之, 宮崎慎也
    • Journal Title

      情報・システム講演論文集 1

      Pages: 169

  • [Journal Article] CGキャラクタの存在感2009

    • Author(s)
      森島繁生
    • Journal Title

      日本バーチャルリアリティ学会誌, 特集アンドロイドやエージェントに感じる人の存在感 vol.14 No.1(招待論文)

      Pages: 23-28

  • [Journal Article] 英語音声教育のための3DCGによる舌の動きと音声のリンク開発の試み-語彙との同期-2008

    • Author(s)
      ヤーッコラ伊勢井敏子, 鈴木茂樹, 森島繁生, 広瀬啓吉
    • Journal Title

      映像メディア学会技術報告, ITE Technical Report Vol.32, No.15

      Pages: 29-32

    • Peer Reviewed
  • [Journal Article] フォルマント母音図の3D可視化の試み2008

    • Author(s)
      ヤーッコラ伊勢井敏子, 中貴俊
    • Journal Title

      日本音響学会春季大会講演論文集

      Pages: 435-536

  • [Journal Article] 英語流音学習のための音と同期した3DCGによる構音運動2008

    • Author(s)
      鈴木茂樹, ヤーッコラ伊勢井敏子, 森島繁生, 広瀬啓吉
    • Journal Title

      日本音響学会秋季大会講演論文集

      Pages: 339-340

  • [Journal Article] 英語情動文"I love you"の中国語話者による認知と音響特性相関(1)2008

    • Author(s)
      ヤーッコラ伊勢井敏子, 広瀬啓吉, 森島繁生
    • Journal Title

      日本音響学会秋季大会講演論文

      Pages: 331-332

  • [Journal Article] 目標言語母音達成のための3Dフォルマント母音図における母音二重表示2008

    • Author(s)
      ヤーッコラ伊勢井敏子, 中貴俊, 広瀬啓吉
    • Journal Title

      日本音響学会秋季大会講演論文集

      Pages: 317-318

  • [Journal Article] Corpus-based synthesis of mandarin speech with F0 contours generated by superposing tone components on rule-generated phrase components2008

    • Author(s)
      Keikichi Hirose, Qinghua Sun, and Nobuaki Minematsu
    • Journal Title

      Proceedings IEEE Workshop on Spoken Language Technology

      Pages: 33-36

    • Peer Reviewed
  • [Journal Article] Corpus-based generation of F_0 contours of Japanese based on the generation process model and its control for prosodic focus2008

    • Author(s)
      Keikichi Hirose, Keiko Ochi, and Nobuaki Minematsu
    • Journal Title

      Proceedings of 9^<th> International Conference on Signal Processing (ICSP2008), Beijing(Invited, Special Session)

      Pages: 647-650

  • [Journal Article] Speech prosody in spoken language technologies2008

    • Author(s)
      Keikichi Hirose
    • Journal Title

      Journal of Signal Processing Vol.12, No.1(Invited Paper)

      Pages: 7-16

  • [Journal Article] 顔表情のCG合成と感動評価2008

    • Author(s)
      森島繁生
    • Journal Title

      映像情報メディア学会誌, 小特集今"顔"が面白い-顔の画像処理とその応用- Vol.62, No.12(招待論文)

      Pages: 1923(20)-1927(23)

  • [Journal Article] Dive into the Movie -Audience-driven Immersive Experience in the Story-2008

    • Author(s)
      Shigeo Morishima
    • Journal Title

      IEICE TRANSACTIONS on Information and systems, Special Section on Human Communication III Vol.E91-D, No.6(招待論文)

      Pages: 1594-1603

  • [Journal Article] Japanese prominence with different focus in affirmative sentences realised by Finnish L22007

    • Author(s)
      Toshiko Isei-Jaakkola, Martti Vainio, and Keikichi Hirose
    • Journal Title

      Proceedings of International Conference on Speech and Computer, Moscow

      Pages: 787-792

    • Peer Reviewed
  • [Journal Article] Corpus-based generation of prosodic features from text based on generation process model2007

    • Author(s)
      Keikichi Hirose, Keiko Ochi, and Nobuaki Minematsu
    • Journal Title

      Proceedings Interspeech 2007, Antwerp

      Pages: 1274-1277

    • Peer Reviewed
  • [Presentation] A computer graphic three-dimensional tongue and lip movement synchronized with English fricatives for Japanese learners2008

    • Author(s)
      Toshiko Isei-Jaakkola, Shigeki Suzuki, Shigeo Morishima and Keikichi Hirose
    • Organizer
      156th Meeting of Acoustical Society of America, The Journal of Acoustical Society of America
    • Place of Presentation
      Florida, U.S.A.(Vol. 124, No.4)
    • Year and Date
      20081110-14
  • [Presentation] Synthesis of F_0 contours for Mandarin speech by superposing corpus-generated tone contours on rule-generated phrase components2008

    • Author(s)
      Keikichi Hirose, Qinghua Sun, and Nobuaki Minematsu
    • Organizer
      Proceedings of Speech Analysis, Synthesis and Recognition -Application in Systems for Homeland Security-, Piechowice, Poland(Plenary talk)
    • Place of Presentation
      Piechowice, POLAND
    • Year and Date
      20080908-12
  • [Presentation] A multilingual 3D vowel chart for monophthongs based on formants2008

    • Author(s)
      Toshiko Isei-Jaakkola, Takatoshi Naka and Keikichi Hirose
    • Organizer
      Nordic Prosody X Abstracts
    • Place of Presentation
      Univ. of Helsinki, FINLAND
    • Year and Date
      20080804-06
  • [Presentation] A three-dimensional visualisation of monophthongs for L22008

    • Author(s)
      Toshiko Isei-Jaakkola and Takatoshi Naka
    • Organizer
      1st International Conference on Literature, Languages and Linguistics
    • Place of Presentation
      Athens, GREECE
    • Year and Date
      20080728-31
  • [Presentation] Long vowel quantity in perception in Japanese2008

    • Author(s)
      Toshiko Isei-Jaakkola
    • Organizer
      Finnish and Czech, 5th Asia pacific Conference on Speech, Language and Hearing, Program & Abstracts
    • Place of Presentation
      The Univ. of Queensland, AUSTRALIA
    • Year and Date
      20080709-13
  • [Presentation] Generation of F_0 contours for Mandarin speech in combination with rule-based and corpus-based methods2008

    • Author(s)
      Keikichi Hirose, Qinghua Sun, and Nobuaki Minematsu
    • Organizer
      Proceedings of 8^<th> Phonetics Conference of China (PCC2008)/International Symposium on Phonetic Frontiers, Beijing(Invited)
    • Place of Presentation
      Beijing, CHINA
    • Year and Date
      20080418-20
  • [Presentation] Researches on speech prosody for advanced spoken language technologies2008

    • Author(s)
      Keikichi Hirose
    • Organizer
      Proceedings of International Symposium : Frontiers of Research on Speech and Music (FRSM-2008), Kolkata(Invited Talk)
    • Place of Presentation
      Kolkata, INDIA
    • Year and Date
      20080220-21
  • [Presentation] 3D Representations of English Monophthongs2008

    • Author(s)
      Toshiko Isei-Jaakkola
    • Organizer
      the 9th Joint Seminar on English Phonetics
    • Place of Presentation
      Seoul National Univ., SOUTH KOREA
    • Year and Date
      2008-03-25

URL: 

Published: 2010-06-10   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi