• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to project page

2010 Fiscal Year Annual Research Report

会話エージェント研究共有プラットフォームの構築と利用技術の研究

Research Project

Project/Area Number 19100001
Research InstitutionKyoto University

Principal Investigator

西田 豊明  京都大学, 情報学研究科, 教授 (70135531)

Co-Investigator(Kenkyū-buntansha) 河原 達也  京都大学, 学術情報メディアセンター, 教授 (00234104)
黒橋 禎夫  京都大学, 情報学研究科, 教授 (50263108)
中野 有紀子  成蹊大学, 理工学部, 准教授 (40422505)
大本 義正  京都大学, 情報学研究科, 助教 (90511775)
黄 宏軒  立命館大学, 情報理工学部, 助教 (00572950)
Keywordsエージェント / 会話エージェント / 対話エージェント / 音声言語 / 言語処理
Research Abstract

(1)GECAプラットフォームのメンテナンスを行った.没入型協調的インタラクション環境内での複数エージェントとの言語・非言語の統合的インタラクションを可能にした.(2)音声認識エンジンJulius,自然言語解析パーザKNP,及び音声合成ソフトをモジュール間通信で結合した音声対話エンジンを実現した.音声認識エンジンの残響抑圧及び雑音抑圧のパラメータを最適化する方法を考案し,有効性を検証した.あいづちの音韻的・韻律的パターン同定,会話音声からのあいづち自動検出法の評価を行った.(3)マルチモーダルインタラクションの収集と分析,複数人ユーザ対応型会話エージェントにおける受話者推定機構を開発した.国語辞典の定義文からの語彙知識獲得,事典に現れる名詞句の自動分割を行なった.教師なし学習を用いた非言語行動モデルの推定とエージェントの行動生成手法を開発した.(4)通常の写真から,屋外の広い空間を,奥行き情報付きで没入型環境へ投影できる仮想空間構築システムを開発した.クラスタリング手法を適用して,ユーザの知識構造の再構築や目的の知識の円滑な閲覧を助けるシステムを実装した.書き言葉からの話し言葉変換プログラムの整理を行った.Web上のニュース記事やWikipediaなどを知識源として,ユーザとシステムが雑談する雑談対話システムを構築した.ユーザの選好構造の対話的な形成手法を開発した.(5)ユーザの発話のタイミングと顔の動きなどの非言語情報を基に決定木を生成し,発話対象を60%程度の精度で推定できた.異文化理解のための教材となりうるエージェントシステムの開発とヨーロッパと日本での評価実験を行うためのコンテンツについて検討した.信頼のモデルを用いたエージェントシミュレーションと,連想テストを用いて,会話エージェントの振る舞いが人間に与える影響に関する手法を研究開発した.

  • Research Products

    (48 results)

All 2011 2010

All Journal Article (12 results) (of which Peer Reviewed: 12 results) Presentation (35 results) Book (1 results)

  • [Journal Article] Communicating with multiple users for embodied conversational agents in quiz game context2010

    • Author(s)
      Hung-Hsuan Huang, Takuya Furukawa, Hiroki Ohashi, Toyoaki Nishida, Aleksandra Cerekovic, Igor S.Pandzic, Yukiko I.Nakano
    • Journal Title

      IJIIDS

      Volume: 4(6) Pages: 579-598

    • Peer Reviewed
  • [Journal Article] 複数ユーザインタラクションにおける外発的な盛り上がりの雰囲気の判定方法と影響の検討2010

    • Author(s)
      大本義正・三宅峰・西田豊明
    • Journal Title

      電子情報通信学会論文誌D

      Volume: Vol.J93-D No.6 Pages: 870-878

    • Peer Reviewed
  • [Journal Article] Incremental learning of gestures for human-robot interaction2010

    • Author(s)
      Shogo Okada, Yoichi Kobayashi, Satoshi Ishibashi, Toyoaki Nishida
    • Journal Title

      AI Soc.

      Volume: 25(2) Pages: 155-168

    • Peer Reviewed
  • [Journal Article] Controlling gaze with an embodied interactive control architecture2010

    • Author(s)
      Yasser F.O.Mohammad, Toyoaki Nishida
    • Journal Title

      Applied Intelligence

      Volume: 32(2) Pages: 148-163

    • Peer Reviewed
  • [Journal Article] Using physiological signals to detect natural interactive behavior.2010

    • Author(s)
      Yasser F.O.Mohammad, Toyoaki Nishida
    • Journal Title

      Applied Intelligence

      Volume: 33(1) Pages: 79-92

    • Peer Reviewed
  • [Journal Article] 統計的言語モデル変換を用いた音響モデルの準教師つき学習2010

    • Author(s)
      三村正人, 秋田祐哉, 河原達也
    • Journal Title

      電子情報通信学会論文誌

      Volume: Vol.J94-D, No.2 Pages: 460-468

    • Peer Reviewed
  • [Journal Article] Online unsupervised classification with model comparison in the Variational Bayes framework for voice activity detection2010

    • Author(s)
      D.Cournapeau, S.Watanabe, A.Nakamura, T.Kawahara
    • Journal Title

      IEEE J.Selected Topics in Signal Processing

      Volume: Vol.4, No.6 Pages: 1071-1083

    • Peer Reviewed
  • [Journal Article] 会議録作成支援のための国会審議の音声認識システム2010

    • Author(s)
      秋田祐哉, 三村正人, 河原達也
    • Journal Title

      電子情報通信学会論文誌

      Volume: Vol.J93-D, No.9 Pages: 1736-1744

    • Peer Reviewed
  • [Journal Article] Robust speech recognition based on dereverberation parameter optimization using acoustic model likelihood2010

    • Author(s)
      R.Gomez, T.Kawahara
    • Journal Title

      IEEE Trans.Audio, Speech & Language Process

      Volume: Vol.18, No.7 Pages: 1708-1716

    • Peer Reviewed
  • [Journal Article] Statistical transformation of language and pronunciation models for spontaneous speech recognition2010

    • Author(s)
      Y.Akita, T.Kawahara
    • Journal Title

      IEEE Trans.Audio, Speech & Language Process

      Volume: Vol.18, No.6 Pages: 1539-1549

    • Peer Reviewed
  • [Journal Article] Speech activity detection for multi-party conversation analyses based on likelihood ratio test on spatial magnitude2010

    • Author(s)
      K.Ishizuka. S.Araki, T.Kawahara
    • Journal Title

      IEEE Trans.Audio, Speech & Language Process

      Volume: Vol.18, No.6 Pages: 1354-1365

    • Peer Reviewed
  • [Journal Article] Culture and Social Relationship as Factors of Affecting Communicative Non-verbal Behaviors2010

    • Author(s)
      Afia Akhter Lipi, Yukiko Nakano, Mathias Rehm
    • Journal Title

      人工知能学会論文誌

      Volume: Vol.25 No.6 Pages: 712-722

    • Peer Reviewed
  • [Presentation] Simulated Crowd : Towards a Synthetic Culture for Engaging a Learner in Culture-dependent Nonverbal Interaction2011

    • Author(s)
      Sutasinee Thovuttikul, Divesh Lala, Hiroki Ohashi, Shogo Okada, Yoshimasa Ohmoto, Toyoaki Nishida.
    • Organizer
      2nd Workshop on Eye Gaze in Intelligent Human Machine Interaction
    • Place of Presentation
      Stanford University, USA
    • Year and Date
      2011-02-13
  • [Presentation] Gaze and Conversation Domination in Multiparty Interaction2011

    • Author(s)
      Yuki Fukuhara, Yukiko Nakano
    • Organizer
      2nd Workshop on Eye Gaze in Intelligent Human Machine Interaction
    • Place of Presentation
      Stanford University, USA
    • Year and Date
      2011-02-13
  • [Presentation] Combining Multiple Types of Eye-gaze Information to Predict User's Conversational Engagement2011

    • Author(s)
      Ryo Ishii, Yuta Shinohara, Yukiko Nakano, Toyoaki Nishida
    • Organizer
      2nd Workshop on Eye Gaze in Intelligent Human Machine Interaction
    • Place of Presentation
      Stanford University, USA
    • Year and Date
      2011-02-13
  • [Presentation] Incremental Gesture Discovery for Interactive Robots2010

    • Author(s)
      Yasser Mohammad, Toyoaki Nishida
    • Organizer
      IEEE ROBIO 2010
    • Place of Presentation
      Tianjin, China
    • Year and Date
      20101214-20101218
  • [Presentation] Optimizing wavelet parameters for dereverberation in automatic speech recognition2010

    • Author(s)
      R.Gomez, T.Kawahara
    • Organizer
      APSIPA ASC
    • Place of Presentation
      Biopolis, Singapore
    • Year and Date
      20101214-20101217
  • [Presentation] Automatic transcription of parliamentary meetings and classroom lectures --a sustainable approach and real system evaluations--2010

    • Author(s)
      Tatsuya Kawahara
    • Organizer
      Int'l Sympo.Chinese Spoken Language Processing
    • Place of Presentation
      台湾・台南(keynote speech 招待講演)
    • Year and Date
      20101129-20101203
  • [Presentation] Learning Spontaneous Nonverbal Behavior using a Three Layers Hierarchy2010

    • Author(s)
      Yasser Mohammad, Toyoaki Nishida
    • Organizer
      10th WSEAS International Conference on Applied Computer Science
    • Place of Presentation
      Iwate, Japan
    • Year and Date
      20101004-20101006
  • [Presentation] Detection of hot spots in poster conversations based on reactive tokens of audience2010

    • Author(s)
      T.Kawahara, K.Sumi, Z.Q.Chang, K.Takanashi
    • Organizer
      INTERSPEECH
    • Place of Presentation
      Makuhari, Japan
    • Year and Date
      20100926-20100930
  • [Presentation] Learning a language model from continuous speech2010

    • Author(s)
      G.Neubig, M.Mimura, S.Mori, T.Kawahara
    • Organizer
      INTERSPEECH
    • Place of Presentation
      Makuhari, Japan
    • Year and Date
      20100926-20100930
  • [Presentation] Classroom note-taking system for hearing impaired students using automatic speech recognition adapted to lectures2010

    • Author(s)
      T.Kawahara, N.Katsumaru, Y.Akita, S.Mori
    • Organizer
      INTERSPEECH
    • Place of Presentation
      Makuhari, Japan
    • Year and Date
      20100926-20100930
  • [Presentation] An improved wavelet-based dereverberation for robust automatic speech recognition2010

    • Author(s)
      R.Gomez, T.Kawahara
    • Organizer
      INTERSPEECH
    • Place of Presentation
      Makuhari, Japan
    • Year and Date
      20100926-20100930
  • [Presentation] Semi-automated update of automatic transcription system for the Japanese national congress2010

    • Author(s)
      Y.Akita, M.Mimura, G.Neubig, T.Kawahara
    • Organizer
      INTERSPEECH
    • Place of Presentation
      Makuhari, Japan
    • Year and Date
      20100926-20100930
  • [Presentation] Towards Conversation-centric Knowledge Circulation2010

    • Author(s)
      Toyoaki Nishida
    • Organizer
      7th International Conference on Multimedia & Network Information Systems
    • Place of Presentation
      Wroclaw, Poland(Plenary Talk 招待講演)
    • Year and Date
      20100923-20100924
  • [Presentation] An Empirical Study of Multiparty Conversations with a Virtual Agent in Wizard-of-Oz Setting2010

    • Author(s)
      Huang, H.H., Takeda, S., Fukuhara, Y., Baba, N., Shibasaki, Y., Nakano, Y., Nishida, T.
    • Organizer
      the 10th International Conference on Intelligent Virtual Agents (IVA'10)
    • Place of Presentation
      Philadelphia, USA
    • Year and Date
      20100920-20100922
  • [Presentation] Multi Class Semi-Supervised Classification with Graph Construction Based on Adaptive Metric Learning2010

    • Author(s)
      Shogo Okada, Toyoaki Nishida
    • Organizer
      ICANN 2010
    • Place of Presentation
      Thessaloniki, Greece.
    • Year and Date
      20100915-20100918
  • [Presentation] Machine Learning Approaches for Time-Series Data Based on Self-Organizing Incremental Neural Network2010

    • Author(s)
      Shogo Okada, Osamu Hasegawa, Toyoaki Nishida
    • Organizer
      ICANN 2010
    • Place of Presentation
      Thessaloniki, Greece.
    • Year and Date
      20100915-20100918
  • [Presentation] Analyses of the facilitating behavior by using discussion conditions, participant stances and nonverbal behavior2010

    • Author(s)
      Ohmoto, Y., Toda, Y., Ueda, K., Nishida, T.
    • Organizer
      Social Intelligence Design 2010
    • Place of Presentation
      Royal Holloway, University of London, UK
    • Year and Date
      20100913-20100916
  • [Presentation] A Proposal of Novel WOZ Environment for Realizing Essence of Communication in Social Robots2010

    • Author(s)
      Hiroki Ohashi, Shogo Okada, Yoshimasa Ohmoto, Toyoaki Nishida
    • Organizer
      Social Intelligence Design 2010
    • Place of Presentation
      Royal Holloway, University of London, UK
    • Year and Date
      20100913-20100916
  • [Presentation] Multi-modal Processing for Acquisition of Interaction Behavior in Social Robot2010

    • Author(s)
      Kae Sakamoto, Shogo Okada, Toyoaki Nishida
    • Organizer
      Social Intelligence Design 2010
    • Place of Presentation
      Royal Holloway, University of London, UK
    • Year and Date
      20100913-20100916
  • [Presentation] The Design of Model-based Agents and a Gaming Environment to Analyze and Express Trust Behavior2010

    • Author(s)
      Divesh Lala, Toyoaki Nishida
    • Organizer
      Social Intelligence Design 2010
    • Place of Presentation
      Royal Holloway, University of London, UK
    • Year and Date
      20100913-20100916
  • [Presentation] Evaluating Embodied Conversational Agents Using an Implicit Association Test2010

    • Author(s)
      Andrey Kiselev, Niyaz Abdikeev, Toyoaki Nishida
    • Organizer
      Social Intelligence Design 2010
    • Place of Presentation
      Royal Holloway, University of London, UK
    • Year and Date
      20100913-20100916
  • [Presentation] Semantic Classification of Automatically Acquired Nouns using Lexico-Syntactic Clues2010

    • Author(s)
      Yuga Murawaki, Sadao Kurohashi
    • Organizer
      COLING 2010
    • Place of Presentation
      Beijing, China
    • Year and Date
      20100822-20100827
  • [Presentation] Social Intelligence Design for Cultivating Shared Situated Intelligence2010

    • Author(s)
      Toyoaki Nishida
    • Organizer
      The 2010 IEEE Conference on Granular Computing (GrC 2010)
    • Place of Presentation
      Silicon Valley, USA(Keynote Talk 招待講演)
    • Year and Date
      20100814-20100816
  • [Presentation] Conversation analysis based on reactive tokens in poster sessions2010

    • Author(s)
      Tatsuya Kawahara
    • Organizer
      Workshop on Predictive Models of Human Communication Dynamics
    • Place of Presentation
      USC, USA(Invited talk 招待講演)
    • Year and Date
      20100804-20100806
  • [Presentation] On-Line Unsupervised Segmentation for Multidimensional Time-Series Data and Application to Spatiotemporal Gesture data2010

    • Author(s)
      Shogo Okada, Satoshi Ishibashi, Toyoaki Nishida
    • Organizer
      IEA/AIE
    • Place of Presentation
      Cordoba, Spain
    • Year and Date
      20100601-20100604
  • [Presentation] Down-Up-Down Behavior Generation for Interactive Robots2010

    • Author(s)
      Yasser Mohammad, Toyoaki Nishida
    • Organizer
      IEA/AIE 2010
    • Place of Presentation
      Cordoba, Spain
    • Year and Date
      20100601-20100604
  • [Presentation] How multiple concurrent users react to a quiz agent attentive to the dynamics of their game participation2010

    • Author(s)
      Hung-Hsuan Huang, Takuya Furukawa, Hiroki Ohashi, Toyoaki Nishida, Aleksandra Cerekovic, Igor S.Pandzic, Yukiko I.Nakano
    • Organizer
      AAMAS 2010
    • Place of Presentation
      Toronto, Canada
    • Year and Date
      20100510-20100514
  • [Presentation] Analysis on prosodic features of Japanese reactive tokens in poster conversations2010

    • Author(s)
      T.Kawahara, Z.Q.Chang, K.Takanashi
    • Organizer
      Int'l Conf.Speech Prosody
    • Place of Presentation
      Chicago, USA
    • Year and Date
      20100510-20100514
  • [Presentation] Analysis environment of conversational structure with nonverbal multimodal data2010

    • Author(s)
      Yasuyuki Sumi, Masaharu Yano, Toyoaki Nishida
    • Organizer
      ICMI-MLMI 2010.
    • Place of Presentation
      Beijing, China
    • Year and Date
      2010-11-10
  • [Presentation] From observation to interaction2010

    • Author(s)
      Toyoaki Nishida
    • Organizer
      SSPW 2010 : ACM Workshop on Social Signal Processing
    • Place of Presentation
      Florence, Italy(Keynote Talk 招待講演)
    • Year and Date
      2010-10-29
  • [Presentation] Learning Interaction Protocols using Augmented Baysian Networks Applied to Guided Navigation2010

    • Author(s)
      Yasser Mohammad, Toyoaki Nishida
    • Organizer
      IROS 2010
    • Place of Presentation
      Taipei, Taiwan
    • Year and Date
      2010-10-20
  • [Presentation] Panel : Technology Innovation in Real-life2010

    • Author(s)
      Toyoaki Nishida
    • Organizer
      Connected World
    • Place of Presentation
      Royal Holloway, University of London(招待講演)
    • Year and Date
      2010-09-15
  • [Presentation] Unsupervised Learning of Interactive Behavior for HRI2010

    • Author(s)
      Yasser Mohammad, Toyoaki Nishida
    • Organizer
      RSS 2010 Workshop on Learning for Human Robot Interaction Modeling
    • Place of Presentation
      Zaragoza, Spain
    • Year and Date
      2010-06-27
  • [Presentation] Toward a Proactive Information Providing Agent in Multi-user Collaborative Decision-making Conversation2010

    • Author(s)
      Huang, H.H., Takeda, S., Ono, M., Nakano, Y., Pandzic, I., Nishida, T.
    • Organizer
      International Workshop on Interacting with ECAs as Virtual Characters
    • Place of Presentation
      Toronto, Canada
    • Year and Date
      2010-05-10
  • [Presentation] Capture and Express Behavior Environment (CEBE) as WOZ system to realize effective human-agent interaction2010

    • Author(s)
      Ohmoto, Y., Ohashi, H., Takahashi, A., Nishida, T.
    • Organizer
      International Workshop on Interacting with ECAs as Virtual Characters
    • Place of Presentation
      Toronto, Canada
    • Year and Date
      2010-05-10
  • [Book] Modelling Machine Emotions for Realizing Intelligence : Foundations and Applications2010

    • Author(s)
      Toyoaki Nishida, Lakhmi Jain, Colette Faucher
    • Total Pages
      240
    • Publisher
      Springer

URL: 

Published: 2012-07-19  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi