• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Environment m dialogue of human-machine communication

Research Project

Project/Area Number 14380159
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Intelligent informatics
Research InstitutionChukyo University (2004)
Nagoya University (2002-2003)

Principal Investigator

KAKEHI Kazuhiko  Chukyo University, School of Computer and Cognitive Sciences, Professor, 情報科学部, 教授 (90262930)

Co-Investigator(Kenkyū-buntansha) SHIMADA Shoji  Nagaoka University of Technology, Department of Technology, Professor, 工学部, 教授 (20262462)
KAWAHARA Hideki  Wakayama University, Department of System Engineering, Professor, システム工学部, 教授 (40294300)
TAKEUCHI Yugou  Shizuoka University, Department of Information Science, Associate Professor, 情報科学部, 助教授 (00333500)
Project Period (FY) 2002 – 2004
Project Status Completed (Fiscal Year 2004)
Budget Amount *help
¥14,700,000 (Direct Cost: ¥14,700,000)
Fiscal Year 2004: ¥2,300,000 (Direct Cost: ¥2,300,000)
Fiscal Year 2003: ¥5,400,000 (Direct Cost: ¥5,400,000)
Fiscal Year 2002: ¥7,000,000 (Direct Cost: ¥7,000,000)
KeywordsCommunication in Dialogue / Familiarity with machine / Perception of emotional speech / Categorical perception / Perception of sound source / Sound field control / Moving sound source / Speech morphing / 対話の共感性 / 音源知覚 / 韻律情報 / 対話 / 相互作用 / 感性情報 / モーフィング / 頭部伝達関数
Research Abstract

It is important for a person to have intentionality for a machine in dialogue communication. Non-linguistic information and environmental factor of dialogue has been investigated to realize the intentionality.
Familiarity in dialogue communication : It was clarified that a creature of non-personified agent makes familiarity with a person by responding with a mimicry prosody uttered by a person. It was also shown that a person acts to the virtual body of the personified agent. In the dialogue environment with plural agents in the same place, a person has a tendency to behave considering the major opinion of the agent's group.
High-quality emotional speech manipulation and perceptual characteristics of the emotional speech : A high-quality speech morphing method was proposed. The morphed speech between two different emotions is natural enough to be used psychological experiments and makes a psychological continuum. It was clarified that the perception of emotional speech is not always categorical on the contrary that of facial expression. The emotion perception of speech is universal over the constraints of various kinds of languages.
Perception of a sound source and a control method of a sound environment : The duration of stimulus sound and its type to get a precise sound localization perception was confirmed by psychological experiments. The additional binaural effect of loudness was clarified both in headphone listening and in listening with stereophonic loudspeaker system. A sound-field reproduction method based on a wave field synthesis was proposed. It is able to control a sound field with reduced bit information by extraction of sound source signal. The spatial coding of the sound field by moving sound sources was also successfully developed.

Report

(4 results)
  • 2004 Annual Research Report   Final Research Report Summary
  • 2003 Annual Research Report
  • 2002 Annual Research Report
  • Research Products

    (35 results)

All 2005 2004 2003 2002 Other

All Journal Article (22 results) Book (1 results) Publications (12 results)

  • [Journal Article] 移動音源がある音場の空間符号化-音源抽出による伝送量の削減-2005

    • Author(s)
      木村敏幸
    • Journal Title

      日本バーチャルリアリティ学会論文誌 10

      Pages: 101-110

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Spatial Coding of the Sound Field by Moving Sound Sources2005

    • Author(s)
      Kimura, T.
    • Journal Title

      The Virtual Reality Society Journal 10

      Pages: 101-110

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] 移動音源がある音場の空間符号化 -音源抽出による伝送量の削減-2005

    • Author(s)
      木村敏幸 他
    • Journal Title

      日本バーチャルリアリティ学会論文誌 10, 1(印刷中)

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Emotional perception of voices and faces2005

    • Author(s)
      K.Kakehi
    • Journal Title

      Proc.of ATR Symposium on Cross-modal Processing of Faces and Voices

      Pages: 69-70

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Spatial Coding Based on the Extraction of Moving Sound Sources in Wavefield Synthesis2005

    • Author(s)
      T.Kimura 他
    • Journal Title

      Proc.of ICASSP2005 (印刷中)

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Social effects of the speed of hummed sounds on human-computer interaction2004

    • Author(s)
      Suzuki, N.
    • Journal Title

      International Journal of Human Computer Studies 60

      Pages: 455-568

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] 「ピカチュウ」にこめられた感性情報2004

    • Author(s)
      櫻庭京子
    • Journal Title

      音声研究 8

      Pages: 77-88

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Emotional Expressions in "Pikachuu"2004

    • Author(s)
      Sakuraba, K.
    • Journal Title

      Journal of the Phonetic Society of Japan 8

      Pages: 77-88

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Underlying principle of a high-quality speech manipulation system STRAIGHT and its application to speech segregation2004

    • Author(s)
      Kawahara, H.
    • Journal Title

      Speech Separation by Humans and Machines (ed. Divenyi, P.)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Social effects of the speed of hummed sounds on human-computer Interaction2004

    • Author(s)
      N.Suzuki 他
    • Journal Title

      Int.J.of Human Computer Studies 60

      Pages: 455-468

    • Related Report
      2004 Annual Research Report
  • [Journal Article] 「ピカチュウ」にこめられた感性情報2004

    • Author(s)
      櫻庭京子 他
    • Journal Title

      音声研究 8, 1

      Pages: 77-88

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Algorithm AMALGAM : Morphing waveform based methods, sinusoidal models and STRAIGHT2004

    • Author(s)
      H.Kawahara 他
    • Journal Title

      Proc.of ICASSP2004 Vol.I

      Pages: 13-16

    • Related Report
      2004 Annual Research Report
  • [Journal Article] 非分節音を用いた人間-コンピュータ間の相互作用における発話速度の変化とその効果2003

    • Author(s)
      鈴木紀子
    • Journal Title

      ヒューマンインターフェイス学会論文誌 15

      Pages: 113-122

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Social effects of echoic mimicry using hummed sounds on human-computer interaction2003

    • Author(s)
      Suzuki, N.
    • Journal Title

      SPEECH COMUNICATION 40

      Pages: 559-573

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Frontal lobe networks for effective processing of ambiguously expressed emotions in humans2003

    • Author(s)
      Nomura, M.
    • Journal Title

      Neuro Sciences Letters 348

      Pages: 113-116

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] 音場再現におけるマルチチャネル信号の空間符号化2003

    • Author(s)
      木村敏幸
    • Journal Title

      日本バーチャルリアリティ学会論文誌 8

      Pages: 433-442

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Effects of speed of hummed sounds on human-computer iteraction2003

    • Author(s)
      Suzuki, N.
    • Journal Title

      Journal of the Human Interface 15

      Pages: 113-122

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Social effects of echoic mimicry using hummed sounds sounds on human computer interaction2003

    • Author(s)
      Suzuki, N.
    • Journal Title

      SPEECH COMMUNICATION 40

      Pages: 559-573

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Frontal lobe networks for effective processing of ambiguously Expressed emotions in humans2003

    • Author(s)
      Nomura, M.
    • Journal Title

      Neuro Sciences Letters 348

      Pages: 113-116

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Spatial Coding of Multi-channel Audio Signals in Sound Field Reproduction2003

    • Author(s)
      Kimura, T.
    • Journal Title

      The Virtual Reality Society Journal 8

      Pages: 433-442

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] 曖昧表情の認知過程における事象関連電位(ERP)の応答2002

    • Author(s)
      野村理朗
    • Journal Title

      感情心理学研究 9

      Pages: 77-86

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] ERP responses to recognition of ambiguous facial expressions2002

    • Author(s)
      Nomura, M.
    • Journal Title

      The Japanese Journal of Research on Emotions 9

      Pages: 77-86

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Book] Under lying principles of a high-quality speech manipulation system STRAIGHT and its application to speech segregation in Speech Separation by Humans and Machines(ed. Divenvi, P.)(319 pages)2004

    • Author(s)
      Kawahara, H.
    • Total Pages
      14
    • Publisher
      Kluwer Academic Publisher
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Publications] 木村敏幸, 筧一彦, 武田一哉, 板倉文忠: "音場再現におけるマルチチャネル信号の空間符号化"日本バーチャルリアリティ学会論文誌. 433-442 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] Yuko Sogabe, Kazuhiko Kakehi, Hideki Kawahara: "Psychological evaluation of emotional speech using a new morphing method"International Conference on Cognitive Science. Vol.2. 628-633 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 工藤彰洋, 穂刈治英, 島田正治: "ヘッドホンによる音像移動の生成方法"電子情報通信学会技術研究報告. EA2003-84. 43-48 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] Hideki Kawahara, Hisami Matsui: "AUDITORY MORPHING BASED ON AN ELASTIC PERCEPTUAL DISTANCE METRIC IN AN INTERFERENCE-FREE TIME-FREQUENCY REPRESENTATION"ICASSP'2003. (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] Yugo Takeuchi, Takuro Hada, Yasuhiro Katagiri: "Effects of CG synthesized facial expression on social attitude"Proc.of the CHI2003 Workshop. 22-23 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] Yugo Takeuchi, Keiko Watanabe, Yasuhiro Katagiri: "Social Influence of Agent's Presence in Desktop Interaction"Proc.of the HCI International 2003. Vol.2. 538-542 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 鈴木紀子, 竹内勇剛, 片桐恭弘: "音声の韻律が人間の行動と印象形成におよぼす影響"ヒューマンインタフェースシンポジウム2002. 183-186 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] 渡邊桂子, 竹内勇剛: "ECAを利用したマルチモーダルインタラクションにおける対話主体の認知"日本認知科学会第19回大会発表論文集. 10-11 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] Takeuchi, Y., Katagiri, Y: "Social Dynamics in Web Page through Inter-Agent Interaction"人工知能学会論文誌. Vol.17, No.4. 439-448 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] Suzuki, N., Kakehi, K., Takeuchi, Y., Okada, M: "Social effects on vocal rate with echoic mimicry using prosody-only voice"proceedings of the Asia Pacific Conference on Computer Human Interaction (APCHI2002). Vol.2. 668-675 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] 薮田洋平, 竹内勇剛: "人間の行動に作用するメディアを介した音声の韻律"電子情報通信学会ヒューマンコミュニケーション基礎研究会技術研究報告. Vol.102, No.598. 7-12 (2003)

    • Related Report
      2002 Annual Research Report
  • [Publications] 鈴木紀子, 筧一彦, 竹内勇剛, 岡田美智男: "非分節音を用いた人間-コンピュータ間の相互作用における発話速度の変化とその社会的効果"ヒューマンインタフェース学会論文誌. Vol.5, No.1. 113-122 (2003)

    • Related Report
      2002 Annual Research Report

URL: 

Published: 2002-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi