Self-initiated Communication Learning Mechanism by Integrating Situation, Image, and Language

2011 Fiscal Year Final Research Report

• Project/Area Number: 22650026
• Research Category: Grant-in-Aid for Challenging Exploratory Research
• Allocation Type: Single-year Grants
• Research Field: Intelligent informatics
• Research Institution: Kyoto University
• Principal Investigator: NISHIDA Toyoaki 京都大学, 大学院・情報学研究科, 教授 (70135531)
• Research Collaborator: 大本 義正 ; 岡田 将吾 ; YASSER Mohammad ; 名渕 博人 ; 伊豆蔵 拓也 ; 坂本 佳愛
• Project Period (FY): 2010 – 2011
• Keywords: 学習 / 知識獲得 / 言語・非言語コミュニケーション

Research Abstract

This research addresses fundamental aspects of a self-initiated mechanism for learning verbal-nonverbal communication integrating situations, images, and language. The result consists of the architecture for empathic agents, a method for extracting verbal-nonverbal associations from multi-modal interaction data and its application to creating agent communication behavior patterns, learning instruction patterns and task structure by incremental acquisition of behavior rules, and algorithms for self-initiated learning by mimicking.

Research Products

• [Journal Article] Towards Mutual Dependency between Empathy and Technology (2012)
  • Author(s): Toyoaki Nishida
  • Journal Title: AI & Society
• [Presentation] An Engineering Approach to Conversational Informatics (2011)
  • Author(s): Toyoaki Nishida
  • Organizer: International Workshop on Multimodality in Multispace Interaction(MiMI)
  • Place of Presentation: Takamatsu, Japan
  • Year and Date: 20111201-02
• [Presentation] Talking with Uncertainty (2011)
  • Author(s): Toyoaki Nishida
  • Organizer: Keynote Speech the International Symposium on Integrated Uncertainty Management and Applications
  • Year and Date: 20111028-30
• [Presentation] From observation to interaction. Keynote Talk (2011)
  • Author(s): Toyoaki Nishida
  • Organizer: SSPW 2010 : ACM Workshop on Social Signal Processing
  • Place of Presentation: Florence, Italy
  • Year and Date: 20111000
• [Presentation] Towards Conversational Artifacts, Keynote Speech (2011)
  • Author(s): Toyoaki Nishida
  • Organizer: The 2011 International Conference on Active Media Technology? AMT-2011
  • Place of Presentation: Lanzhou, China
  • Year and Date: 20110907-09
• [Presentation] Discovering Causal Change Relationships Between Processes in Complex Systems (2011)
  • Author(s): Yasser Mohammad and Toyoaki Nishida
  • Organizer: IEEE SII 2011
  • Year and Date: 20110000
• [Presentation] On Comparing SSA-based Change Point Discovery Algorithms (2011)
  • Author(s): Yasser Mohammad and Toyoaki Nishida
  • Organizer: IEEE SII 2011
  • Year and Date: 20110000
• [Presentation] 二段階モチーフ発見アルゴリズムに基づく連続インタラクションデータからのジェスチャパターンの抽出とロボットナビゲーションへの応用 (2011)
  • Author(s): 岡田将吾, 伊豆蔵拓也, 西田豊明
  • Organizer: 人工知能学会全国大会
  • Year and Date: 20110000
• [Presentation] 時系列マルチモーダルデータマイニングを用いたロボットの撮影行動則の獲得 (2011)
  • Author(s): 坂本佳愛, 岡田将吾, 西田豊明
  • Organizer: 人工知能学会全国大会
  • Year and Date: 20110000
• [Presentation] 回帰モデルに基づく言語・非言語指示パターンによる移動ロボットのための制御則の獲得 (2011)
  • Author(s): 伊豆藏拓也, 岡田将吾, 西田豊明
  • Organizer: 人工知能学会全国大会
  • Year and Date: 20110000
• [Presentation] Social Intelligence Design for Cultivating Shared Situated Intelligence (2010)
  • Author(s): Toyoaki Nishida
  • Organizer: The 2010 IEEE Conference on Granular Computing(GrC 2010)
  • Place of Presentation: Silicon Valley, USA
  • Year and Date: 20100814-16
• [Presentation] 連続インタラクションデータからのインタラクションコンテキストの変化点の検出 (2010)
  • Author(s): 坂本佳愛, 岡田将吾, 西田豊明
  • Organizer: 人工知能学会全国大会
  • Year and Date: 20100600
• [Remarks] 受賞December 21, 2011. Yasser Mohammad and Toyoaki Nishida received SII2011 Best Paper Award(Control) from 2011 IEEE/SICE International Symposium on System Integration, December 20-22, 2011, Kyoto Japan. Yasser Mohammad and Toyoaki Nishida, On Comparing SSA-based Change Point Discovery Algorithms, IEEE SII 2011, 938-945.