• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

A study concerning the development of a support system for studying English emotions using synthesized audio and audiovisual models

Research Project

Project/Area Number 19509003
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field Intelligent informatics
Research InstitutionChubu University

Principal Investigator

ISEI-JAAKKOLA Toshiko  Chubu University, 人文学部, 教授 (00454364)

Co-Investigator(Kenkyū-buntansha) HIROSE Keikichi  東京大学, 情報理工学系研究科, 教授 (50111472)
MORISHIMA Shigeo  早稲田大学, 理工学術院, 教授 (10200411)
Project Period (FY) 2007 – 2008
Project Status Completed (Fiscal Year 2008)
Budget Amount *help
¥3,630,000 (Direct Cost: ¥3,300,000、Indirect Cost: ¥330,000)
Fiscal Year 2008: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Fiscal Year 2007: ¥2,200,000 (Direct Cost: ¥2,200,000)
Keywords英語 / 情動・感情 / 学習支援システム / 音声映像 / 音声合成・顔合成 / 韻律 / 学習者 / 音声 / 映像 / 声合成・顔合成
Research Abstract

情動認知に関しては, 文化差(同時に母語の言語系統の差)が関係し, また, 情動・感情ごとに差異があるということも判明した。情動の認知結果と物理音響特性(距離)の相関に関しては, 基本周波数よりも音圧の方がより相関が高いことも分かった。顔合成と音声との同期は極めて難しい課題であることがわかった。時間変化と音声の変化および顔の変化をすべて統合して合成することは現在の技術では不可能に近いことが判明した。

Report

(3 results)
  • 2008 Annual Research Report   Final Research Report ( PDF )
  • 2007 Annual Research Report
  • Research Products

    (34 results)

All 2009 2008 2007

All Journal Article (23 results) (of which Peer Reviewed: 8 results) Presentation (11 results)

  • [Journal Article] 音と同期した3DCGを用いた日本人英語学習者に苦手な構音運動のためのトレーニングシステム-唇の突き出し2009

    • Author(s)
      ヤーッコラ伊勢井敏子, 鈴木茂樹, 広瀬啓吉, 森島繁生
    • Journal Title

      日本音響学会秋季大会講演論文集

      Pages: 369-370

    • Related Report
      2008 Final Research Report
  • [Journal Article] 英語情動文"I love you"の中国語話者による認知と音響特性相関(2)2009

    • Author(s)
      ヤーッコラ伊勢井敏子, 広瀬啓吉, 森島繁生
    • Journal Title

      日本音響学会秋季大会講演論文集

      Pages: 483-484

    • Related Report
      2008 Final Research Report
  • [Journal Article] 3Dフォルマント母音図における発声母音のリアルタイム可視化2009

    • Author(s)
      佐伯拓郎, 中貴俊, ヤーッコラ伊勢井敏子, 遠藤守, 山田雅之, 宮崎慎也
    • Journal Title

      情報・システム講演論文集 1

      Pages: 169-169

    • NAID

      110007094687

    • Related Report
      2008 Final Research Report
  • [Journal Article] CGキャラクタの存在感2009

    • Author(s)
      森島繁生
    • Journal Title

      日本バーチャルリアリティ学会誌, 特集アンドロイドやエージェントに感じる人の存在感 vol.14 No.1(招待論文)

      Pages: 23-28

    • NAID

      10024785695

    • Related Report
      2008 Final Research Report
  • [Journal Article] 英語情動文“I love you"の中国語話者による認知と音響特性相関(2)2009

    • Author(s)
      ヤーッコラ伊勢井敏子, 広瀬啓吉, 森島繁生
    • Journal Title

      日本音響学会春季大会講演論文集

      Pages: 483-484

    • Related Report
      2008 Annual Research Report
  • [Journal Article] 音と同期した3DCGを用いた日本人英語学習者に苦手な構音運動のためのトレーニングシステムー唇の突き出し2009

    • Author(s)
      ヤーッコラ伊勢井敏子, 鈴木茂樹, 広瀬啓吉, 森島繁生
    • Journal Title

      日本音響学会春季大会講演論文集

      Pages: 369-370

    • Related Report
      2008 Annual Research Report
  • [Journal Article] 英語音声教育のための3DCGによる舌の動きと音声のリンク開発の試み-語彙との同期-2008

    • Author(s)
      ヤーッコラ伊勢井敏子, 鈴木茂樹, 森島繁生, 広瀬啓吉
    • Journal Title

      映像メディア学会技術報告, ITE Technical Report Vol.32, No.15

      Pages: 29-32

    • Related Report
      2008 Final Research Report
    • Peer Reviewed
  • [Journal Article] フォルマント母音図の3D可視化の試み2008

    • Author(s)
      ヤーッコラ伊勢井敏子, 中貴俊
    • Journal Title

      日本音響学会春季大会講演論文集

      Pages: 435-536

    • Related Report
      2008 Final Research Report
  • [Journal Article] 英語流音学習のための音と同期した3DCGによる構音運動2008

    • Author(s)
      鈴木茂樹, ヤーッコラ伊勢井敏子, 森島繁生, 広瀬啓吉
    • Journal Title

      日本音響学会秋季大会講演論文集

      Pages: 339-340

    • Related Report
      2008 Annual Research Report 2008 Final Research Report
  • [Journal Article] 英語情動文"I love you"の中国語話者による認知と音響特性相関(1)2008

    • Author(s)
      ヤーッコラ伊勢井敏子, 広瀬啓吉, 森島繁生
    • Journal Title

      日本音響学会秋季大会講演論文

      Pages: 331-332

    • Related Report
      2008 Final Research Report
  • [Journal Article] 目標言語母音達成のための3Dフォルマント母音図における母音二重表示2008

    • Author(s)
      ヤーッコラ伊勢井敏子, 中貴俊, 広瀬啓吉
    • Journal Title

      日本音響学会秋季大会講演論文集

      Pages: 317-318

    • Related Report
      2008 Annual Research Report 2008 Final Research Report
  • [Journal Article] Corpus-based synthesis of mandarin speech with F0 contours generated by superposing tone components on rule-generated phrase components2008

    • Author(s)
      Keikichi Hirose, Qinghua Sun, and Nobuaki Minematsu
    • Journal Title

      Proceedings IEEE Workshop on Spoken Language Technology

      Pages: 33-36

    • Related Report
      2008 Final Research Report
    • Peer Reviewed
  • [Journal Article] Corpus-based generation of F_0 contours of Japanese based on the generation process model and its control for prosodic focus2008

    • Author(s)
      Keikichi Hirose, Keiko Ochi, and Nobuaki Minematsu
    • Journal Title

      Proceedings of 9^<th> International Conference on Signal Processing (ICSP2008), Beijing(Invited, Special Session)

      Pages: 647-650

    • Related Report
      2008 Final Research Report
  • [Journal Article] Speech prosody in spoken language technologies2008

    • Author(s)
      Keikichi Hirose
    • Journal Title

      Journal of Signal Processing Vol.12, No.1(Invited Paper)

      Pages: 7-16

    • Related Report
      2008 Final Research Report
  • [Journal Article] 顔表情のCG合成と感動評価2008

    • Author(s)
      森島繁生
    • Journal Title

      映像情報メディア学会誌, 小特集今"顔"が面白い-顔の画像処理とその応用- Vol.62, No.12(招待論文)

    • NAID

      110006991083

    • Related Report
      2008 Final Research Report
  • [Journal Article] Dive into the Movie -Audience-driven Immersive Experience in the Story-2008

    • Author(s)
      Shigeo Morishima
    • Journal Title

      IEICE TRANSACTIONS on Information and systems, Special Section on Human Communication III Vol.E91-D, No.6(招待論文)

      Pages: 1594-1603

    • NAID

      10026804028

    • Related Report
      2008 Final Research Report
  • [Journal Article] 英語情動文“1 love you"の中国語話者による認知と音響特性相関(1)2008

    • Author(s)
      ヤーツコラ伊勢井敏子, 広瀬啓吉, 森島繁生
    • Journal Title

      日本音響学会秋季大会講演論文集

      Pages: 331-332

    • Related Report
      2008 Annual Research Report
  • [Journal Article] A computer graphic three-dimensional tongue and lip movement synchronized with English fricatives for Japanese learners2008

    • Author(s)
      Toshiko Isei-Jaakkola, Shige ki Suzuki, Shigeo Morishima, Keikichi Hirose
    • Journal Title

      The Journal of Acoustical Society of America Vol. 124, No. 4, Pt. 2 of 2

      Pages: 2594-2594

    • Related Report
      2008 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 英語音声教育のための3DCGによる舌の動きと音声のリンク開発の試み-語彙との同期2008

    • Author(s)
      ヤーッコラ伊勢井敏子
    • Journal Title

      映像メディア学会技術報告 32-15

      Pages: 29-32

    • Related Report
      2007 Annual Research Report
    • Peer Reviewed
  • [Journal Article] フォルマント母音図の3D可視化の試み2008

    • Author(s)
      ヤーッコラ伊勢井敏子
    • Journal Title

      日本音響学会春季大会論文集 CD-ROM

      Pages: 435-436

    • Related Report
      2007 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Japanese prominence with different focus in affirmative sentences realised by Finnish L22007

    • Author(s)
      Toshiko Isei-Jaakkola, Martti Vainio, and Keikichi Hirose
    • Journal Title

      Proceedings of International Conference on Speech and Computer, Moscow

      Pages: 787-792

    • Related Report
      2008 Final Research Report
    • Peer Reviewed
  • [Journal Article] Corpus-based generation of prosodic features from text based on generation process model2007

    • Author(s)
      Keikichi Hirose, Keiko Ochi, and Nobuaki Minematsu
    • Journal Title

      Proceedings Interspeech 2007, Antwerp

      Pages: 1274-1277

    • Related Report
      2008 Final Research Report
    • Peer Reviewed
  • [Journal Article] Japanese prominence with different focus in affirmative sentences realised by Finnish L22007

    • Author(s)
      Toshiko Isei-Jaakkola
    • Journal Title

      Proceedings of International Conference on Speech and Computer Moscow 2007 CD-ROM

    • Related Report
      2007 Annual Research Report
    • Peer Reviewed
  • [Presentation] 3D Representations of English Monophthongs2008

    • Author(s)
      Toshiko Isei-Jaakkola
    • Organizer
      the 9th Joint Seminar on English Phonetics
    • Place of Presentation
      Seoul National Univ., SOUTH KOREA
    • Year and Date
      2008-03-25
    • Related Report
      2008 Final Research Report
  • [Presentation] 3D Representations of English Monophthongs2008

    • Author(s)
      Toshiko Isei-Jaakkola
    • Organizer
      第9回日韓合同英語音声学ソウルセミナー
    • Place of Presentation
      韓国ソウル国立大学
    • Year and Date
      2008-03-25
    • Related Report
      2007 Annual Research Report
  • [Presentation] Long vowel quantity in perception in Japanese2008

    • Author(s)
      Toshiko Isei-Jaakkola
    • Organizer
      Finnish and Czech, 5th Asia pacific Conference on Speech, Language and Hearing, Program & Abstracts
    • Place of Presentation
      The Univ. of Queensland, AUSTRALIA
    • Related Report
      2008 Final Research Report
  • [Presentation] A three-dimensional visualisation of monophthongs for L22008

    • Author(s)
      Toshiko Isei-Jaakkola and Takatoshi Naka
    • Organizer
      1st International Conference on Literature, Languages and Linguistics
    • Place of Presentation
      Athens, GREECE
    • Related Report
      2008 Final Research Report
  • [Presentation] A multilingual 3D vowel chart for monophthongs based on formants2008

    • Author(s)
      Toshiko Isei-Jaakkola, Takatoshi Naka and Keikichi Hirose
    • Organizer
      Nordic Prosody X Abstracts
    • Place of Presentation
      Univ. of Helsinki, FINLAND
    • Related Report
      2008 Final Research Report
  • [Presentation] A computer graphic three-dimensional tongue and lip movement synchronized with English fricatives for Japanese learners2008

    • Author(s)
      Toshiko Isei-Jaakkola, Shigeki Suzuki, Shigeo Morishima and Keikichi Hirose
    • Organizer
      156th Meeting of Acoustical Society of America, The Journal of Acoustical Society of America
    • Place of Presentation
      Florida, U.S.A.(Vol. 124, No.4)
    • Related Report
      2008 Final Research Report
  • [Presentation] Researches on speech prosody for advanced spoken language technologies2008

    • Author(s)
      Keikichi Hirose
    • Organizer
      Proceedings of International Symposium : Frontiers of Research on Speech and Music (FRSM-2008), Kolkata(Invited Talk)
    • Place of Presentation
      Kolkata, INDIA
    • Related Report
      2008 Final Research Report
  • [Presentation] Generation of F_0 contours for Mandarin speech in combination with rule-based and corpus-based methods2008

    • Author(s)
      Keikichi Hirose, Qinghua Sun, and Nobuaki Minematsu
    • Organizer
      Proceedings of 8^<th> Phonetics Conference of China (PCC2008)/International Symposium on Phonetic Frontiers, Beijing(Invited)
    • Place of Presentation
      Beijing, CHINA
    • Related Report
      2008 Final Research Report
  • [Presentation] Synthesis of F_0 contours for Mandarin speech by superposing corpus-generated tone contours on rule-generated phrase components2008

    • Author(s)
      Keikichi Hirose, Qinghua Sun, and Nobuaki Minematsu
    • Organizer
      Proceedings of Speech Analysis, Synthesis and Recognition -Application in Systems for Homeland Security-, Piechowice, Poland(Plenary talk)
    • Place of Presentation
      Piechowice, POLAND
    • Related Report
      2008 Final Research Report
  • [Presentation] A multilingual 3D vowel chart for monophthongs based on forman ts2008

    • Author(s)
      Toshiko Isei-Jaakkola, Takato shi Naka, Keikichi Hirose
    • Organizer
      Nordic Prosody X
    • Place of Presentation
      Helsinki, FINLAND
    • Related Report
      2008 Annual Research Report
  • [Presentation] A three-dimensional visualisation of monophthongs for L22008

    • Author(s)
      Toshiko Isei-Jaakkola, Ta katoshi Naka
    • Organizer
      1st International Conference on Literature, Languages and Linguistics
    • Place of Presentation
      Athens, GREECE.
    • Related Report
      2008 Annual Research Report

URL: 

Published: 2007-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi