会話エージェント研究共有プラットフォームの構築と利用技術の研究

2007 Fiscal Year Annual Research Report

• Project/Area Number: 19100001
• Research Institution: Kyoto University
• Principal Investigator: 西田 豊明 Kyoto University, 情報学研究科, 教授 (70135531)
• Co-Investigator(Kenkyū-buntansha): 河原 達也 京都大学, 学術情報メディアセンター, 教授 (00234104) ; 黒橋 禎夫 京都大学, 情報学研究科, 教授 (50263108) ; 角 康之 京都大学, 情報学研究科, 准教授 (30362578) ; 中野 有紀子 東京農工大学, 工学府, 准教授 (40422505)
• Keywords: ソフトウェアエージェント / 会話エージェント / 対話エージェント / 音声言語 / 言語処理

Research Abstract

会話エージェントシステム汎用プラットフォームGECAの基本的な枠組みの開発,会話エージェント行動モデルの構築,予備的検討を行った.GECA上では,並列分散環境で異種OS上で作られた部品が協調する.会話エージェントの行動スクリプト記述用言語(GSML)を開発した.頭部追跡,モーションキャプチャ入力,音声合成,シナリオ処理などのGECA用コンポーネントを開発した.ユーザ発話のタイミングの分析を行った.類義関係にある語の柔軟なマッチング,用言スキーマの研究,文語口語変換について研究を行い,知見を得た.会話におけるマルチモーダルインタラクションを記録・分析するための環境を構築し,計測データからの抽象的なインデクス抽出法について検討した.Wizard-of-Oz法を用いた会話エージェント対ユーザの対話収集実験により得られた頭部姿勢の計測データと発話音声を分析し,注視遷移パターンと会話参加態度の間の相関関係を見出した.アウグスブルグ大学と共同で,異文化コミュニケーションのコーパスを構築し,分析を行い,いくつかの興味深い知見を得た.会話モデルをベイジアンネットワークを用いて構築した.ザグレブ大学のグループと共同で,GECAを用いた多人数会話システムをeNTERFACE'08に共同提案し採択された.GECAを用いて開発したクイズエージェントシステムを2007年度につづき,2008年度の食品総合研究所の一般公開で展示する準備を進めた.研究協力者の黄が会話エージェントの行動記述標準化を行っているBMLの会合に参加し,動向調査を行った.

Research Products

• [Journal Article] Conversational Informatics and Human-Centered Web Intelligence (2007)
  • Author(s): Toyoaki Nishida
  • Journal Title: IEEE Intelligent Informatics Bulletin 8 Pages: 19-28
  • Peer Reviewed
• [Journal Article] Mediated communication in action: asocial intelligence design approach (2007)
  • Author(s): Renate Fruchter, Toyoaki Nishidaand Duska Rosenberg
  • Journal Title: AI & Society 22 Pages: 93-100
  • Peer Reviewed
• [Journal Article] A two-layered approach to communicative artifacts (2007)
  • Author(s): Yong Xu, Tatsuya Hiramatsu, Kateryna Tarasenko, Toyoaki Nishida. Yoshiyasu Ogasawara, Takashi Tajima, Makoto Hatakeyama, Masashi Okamoto and Yukiko I. Nakano
  • Journal Title: AI & Society 22 Pages: 185-196
  • Peer Reviewed
• [Journal Article] 車内会話の量子化と再利用 (2007)
  • Author(s): 岡村剛, 久保田秀和, 角康之, 西田豊明, 塚原裕史, 岩崎弘利
  • Journal Title: 情報処理学会論文誌 48 Pages: 3893-3906
  • Peer Reviewed
• [Journal Article] 会話量子化器を用いた会話場面の記録 (2007)
  • Author(s): 久保田秀和, 齊藤憲, 角康之, 西田豊明
  • Journal Title: 情報処理学会論文誌 48 Pages: 3703-3714
  • Peer Reviewed
• [Journal Article] ドメインとスタイルを考慮したwebテキストの選択による音声対話システム用言語モデルの構築 (2007)
  • Author(s): 翠輝久, 河原達也
  • Journal Title: 電子情報通信学会論文誌 J90-D Pages: 3024-3032
  • Peer Reviewed
• [Journal Article] 質問応答・情報推薦機能を備えた音声による情報案内システム (2007)
  • Author(s): 翠輝久, 河原達也, 正司哲朗, 美濃導彦
  • Journal Title: 情報処理学会論文誌 48 Pages: 3602-3611
  • Peer Reviewed
• [Journal Article] 言語コンピューティング (2007)
  • Author(s): 黒橋禎夫
  • Journal Title: 人工知能学会誌 22 Pages: 711-718
• [Journal Article] グループ協調を促すインタラクションデザイン (2007)
  • Author(s): 角 康之
  • Journal Title: Human Interface(ヒューマンインタフェース学会誌) 9 Pages: 257-262
• [Presentation] Natural Listening Robot for AAL Applications (2008)
  • Author(s): Yasser Mohammad and Toyoaki Nishida
  • Organizer: International Workshop on IUI for Ambient Assisted Living (IUI4AAL 2008)
  • Place of Presentation: Canary Islands, Spain
  • Year and Date: 20080113-16
• [Presentation] Toward a Culture Adaptive Conversational Agent with a Modularized Approach (2008)
  • Author(s): Huang, H., Cerekovic, A., Pandzic, I., Nakano, Y, and Nishida, T.
  • Organizer: Workshop on Enculturating Conversational Interfaces by Socio-cultural Aspects of Communication
  • Place of Presentation: Canary Islands, Spain
  • Year and Date: 2008-01-13
• [Presentation] Creating a Standardized Corpus of Multimodal Interactions for Enculturating Conversational Interfaces (2008)
  • Author(s): Rehm, M., Gruneberg, F., Nakano, Y., Lipi, A. A., Yamaoka, Y., Huang, H.
  • Organizer: Workshop on Enculturating Conversational Interfaces by Socio-cultural Aspects of Communication
  • Place of Presentation: Canary Islands, Spain
  • Year and Date: 2008-01-13
• [Presentation] Talk is silver, silence is golden: A cross-cultural study on the use of pauses in speech (2008)
  • Author(s): Endrass, B., Rehm, M., Andre, E., and Nakano, Y.
  • Organizer: Workshop on Enculturating Conversational Interfaces by Socio-cultural Aspects of Communication
  • Place of Presentation: Canary Islands, Spain
  • Year and Date: 2008-01-13
• [Presentation] Scripting Human-Agent Interactions in a Generic ECA Framework (2007)
  • Author(s): Huang, H., Cerekovic, A., Pandzic, I., Nakano, Y, and Nishida, T.
  • Organizer: 27th BCS SGAI International Conference on Artificial Intelligence (AI-2007)
  • Place of Presentation: Cambridge, England
  • Year and Date: 20071210-12
• [Presentation] Eica: Embodied interactive control architecture (2007)
  • Author(s): Yasser Mohammad and T. Nishida
  • Organizer: Twentieth Australian Joint Conference on Artificial Intelligence
  • Place of Presentation: Australia
  • Year and Date: 20071202-06
• [Presentation] A Script Driven Multimodal Embodied Conversational Agent Based on a Generic Framework (2007)
  • Author(s): Huang, H., Cerekovic, A., Pandzic, I., Nakano, Y, and Nishida, T.
  • Organizer: 7th International Conference on Intelligent Virtual Agents (IVA07)
  • Place of Presentation: Paris, France
  • Year and Date: 20070917-19
• [Presentation] A Quiz Game Console Based on a Generic Embodied Conversational Agent Framework (2007)
  • Author(s): Huang, H., Inoue, T., Cerekovic, A., Pandzic, I., Nakano, Y, and Nishida, T.
  • Organizer: 7th International Conference on Intelligent Virtual Agents (IVA07)
  • Place of Presentation: Paris, France
  • Year and Date: 20070917-19
• [Presentation] Towards a Multicultural ECA Tour Guide System (2007)
  • Author(s): [4] Cerekovic, A., Huang, H., Pandzic, I., Nakano, Y, and Nishida, T.
  • Organizer: 7th International Conference on Intelligent Virtual Agents (IVA07)
  • Place of Presentation: Paris, France
  • Year and Date: 20070917-19
• [Presentation] The CUBE-G approach - Coaching culgure-specific nonverbal behavior by virtual agents (2007)
  • Author(s): Rehm, M., Andre, E., Bee, N., Endrass, B., Wissner, M., Nakano, Y., Nishida T., Huang, H.
  • Organizer: 〓e 38th Conference of the International Simulation and Gaming Association (ISAGA)
  • Place of Presentation: Nijmegen, New Zealand
  • Year and Date: 20070709-0713
• [Presentation] Towards an Embodied Conversational Agent Talking in Croatian (2007)
  • Author(s): Cerekovic, A., Huang, H., Zoric, G., Tarasenko, K., Levacic, V., Pandzic, I., Nakano, Y., and Nishida, T.
  • Organizer: The 9th International Conference on Telecommunications(Con TEL 2007)
  • Place of Presentation: Zagreb, Croatia
  • Year and Date: 20070613-15
• [Presentation] HMM training based on CV-EM and CV Gaussian mixture optimization (2007)
  • Author(s): T. Shinozaki and T. Kawahara
  • Organizer: IEEE Workshop on Automatic Speech Recognition and Understanding
  • Place of Presentation: 京都
  • Year and Date: 2007-12-11
• [Presentation] When Should Animated Agents Give Additional Instructions to Users? -Monitoring user's understanding in multimodal dialogues - (2007)
  • Author(s): Murata, K., Enomoto, M., Arimoto, Y., and Nakano, Y.
  • Organizer: International Conference on Control, Automation and Systems (ICCAS 2007)
  • Place of Presentation: Portsmouth, UK
  • Year and Date: 2007-10-18
• [Presentation] Evaluation of real-time voice activity detection based on high order statistics (2007)
  • Author(s): D. Cournapeau and T. Kawahara
  • Organizer: INTERSPEECH
  • Place of Presentation: Antwerp, Belgium
  • Year and Date: 2007-08-31
• [Presentation] Bayes risk-based optimization of dialogue management for document retrieval system with speech interface (2007)
  • Author(s): T. Misu and T. Kawahara
  • Organizer: INTERSPEECH
  • Place of Presentation: Antwerp, Belgium
  • Year and Date: 2007-08-31
• [Presentation] Gaussian mixture optimization for HMM based on efficientcross-validation (2007)
  • Author(s): T. Shinozaki and T. Kawahara
  • Organizer: INTERSPEECH
  • Place of Presentation: Antwerp, Belgium
  • Year and Date: 2007-08-30
• [Presentation] PLSA-based topic detection in meetings for adaptation of lexicon and language model (2007)
  • Author(s): Y. Akita, Y. Nemoto, and T. Kawahara
  • Organizer: INTERSPEECH
  • Place of Presentation: Antwerp, Belgium
  • Year and Date: 2007-08-29
• [Presentation] Analyzing temporal transition of real user's behaviors in a spoken dialogue system (2007)
  • Author(s): K. Komatani, T. Kawahara, and H. G. Okuno
  • Organizer: INTERSPEECH
  • Place of Presentation: Antwerp, Belgium
  • Year and Date: 2007-08-28
• [Presentation] An interactive framework for document retrieval and presentation with question-answering function in restricted domain (2007)
  • Author(s): T. Misu and T. Kawahara
  • Organizer: Int'l Conf. Industrial, Engineering & Other Applications of Artificial Intelligent Systems (IEA/AIE)
  • Place of Presentation: 京都
  • Year and Date: 2007-06-26
• [Presentation] Predicting Evidence of Understanding by Monitoring User's Task Manipulation in Multimodal Conversations (2007)
  • Author(s): Nakano, Y. I., Murata, K., Enomoto, M., Arimoto, Y., Asa, Y., and Sagawa, H.
  • Organizer: ACL 2007 Demo and Poster Sessions
  • Place of Presentation: Prague, Czech Republic
  • Year and Date: 2007-06-26
• [Presentation] Automatic detection of sentence and clause units using local syntactic dependency (2007)
  • Author(s): T. Kawahara, M. Saikou, and K. Takanashi
  • Organizer: ICASSP-2007
  • Place of Presentation: Honolulu, Hawaii
  • Year and Date: 2007-04-18
• [Presentation] Speech-based interactive information guidance system using question-answering technique (2007)
  • Author(s): T. Misu and T. Kawahara
  • Organizer: ICASSP-2007
  • Place of Presentation: Honolulu, Hawaii
  • Year and Date: 2007-04-18
• [Presentation] Topic-independent speaking-style transformation of language model for spontaneous speech recognition (2007)
  • Author(s): Y. Akita and T. Kawahara
  • Organizer: ICASSP-2007
  • Place of Presentation: Honolulu, Hawaii
  • Year and Date: 2007-04-17