Improving object reference recognition through human-robot alignment

• Project/Area Number: 15K16075
• Research Category: Grant-in-Aid for Young Scientists (B)
• Allocation Type: Multi-year Fund
• Research Field: Intelligent robotics
• Research Institution: Advanced Telecommunications Research Institute International
• Principal Investigator: Iio Takamasa 株式会社国際電気通信基礎技術研究所, 知能ロボティクス研究所, 連携研究員 (70642958)
• Project Period (FY): 2015-04-01 – 2017-03-31
• Project Status: Completed (Fiscal Year 2016)
• Budget Amount: ¥3,900,000 (Direct Cost: ¥3,000,000、Indirect Cost: ¥900,000); Fiscal Year 2016: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000); Fiscal Year 2015: ¥2,340,000 (Direct Cost: ¥1,800,000、Indirect Cost: ¥540,000)
• Keywords: 知能ロボティクス / ヒューマンロボットインタラクション / 引き込み現象 / 指示物体認識 / 指示物体認識システム / 行動の引き込み

Outline of Final Research Achievements

When referring to an object, a person sometimes use a reference with insufficient information for specifying the object. Such ambiguous references decrease a performance of object reference recognition.
In this research, I developed an algorithm of robot's confirmation behaviors to entrain humans to use enough information in their references based on human-robot alignment, which is a phenomenon that human behaviors are elicited to robot behavior, and implemented the algorithm into the object reference recognition system. Through an experiment, the proposed algorithm made the performance of object reference recognition better than basic one.

Research Products

• [Presentation] 幼児に対する読み聞かせにおける複数ロボットの利用法による効果 (2017)
  • Author(s): 田村 優美子, 木本 充彦, 塩見 昌裕, 飯尾 尊優, Ivan Tanev, 下原 勝憲, 萩田 紀博
  • Organizer: 第44回知能システムシンポジウム
  • Place of Presentation: 東京都高輪
  • Year and Date: 2017-03-13
• [Presentation] 複数台ロボットによる“褒め”が人間の技能向上へ及ぼす影響 (2017)
  • Author(s): 奥村 奏音, 塩見 昌裕, 飯尾 尊優, 木本 充彦, Ivan Tanev, 下原 勝憲, 萩田 紀博
  • Organizer: 第44回知能システムシンポジウム
  • Place of Presentation: 東京都高輪
  • Year and Date: 2017-03-13
• [Presentation] 指示物体認識における人のパーソナリティとロボットの対話戦略との関係性分析 (2017)
  • Author(s): 木本 充彦, 飯尾 尊優, 塩見 昌裕, Ivan Tanev, 下原 勝憲, 萩田 紀博
  • Organizer: 第44回知能システムシンポジウム
  • Place of Presentation: 東京都高輪
  • Year and Date: 2017-03-13
• [Presentation] Relationship between Personality and Robots’ Interaction Strategies in Object Reference Conversations (2016)
  • Author(s): Mitsuhiko Kimoto, Takamasa Iio, Masahiro Shiomi, Ivan Tanev, Katsunori Shimohara, Norihiro Hagita
  • Organizer: The Second International Conference on Electronics and Software Science (ICESS2016)
  • Place of Presentation: Takamatsu, Japan
  • Year and Date: 2016-11-14
  • Int'l Joint Research
• [Presentation] Communication Cues in Human-Robot Touch Interaction (2016)
  • Author(s): Takahiro Hirano, Masahiro Shiomi, Takamasa Iio, Mitsuhiko Kimoto, Takuya Nagashio, Ivan Tanev, Katsunori Shimohara, Norihito Hagita
  • Organizer: The 4th International Conference on Human-Agent Interaction
  • Place of Presentation: Singapore
  • Year and Date: 2016-10-04
  • Int'l Joint Research
• [Presentation] Alignment Approach Comparison between Implicit and Explicit Suggestions in Object Reference Conversations (2016)
  • Author(s): Mitsuhiko Kimoto, Takamasa Iio, Masahiro Shiomi, Ivan Tanev, Katsunori Shimohara, Norihito Hagita
  • Organizer: The 4th International Conference on Human-Agent Interaction
  • Place of Presentation: Singapore
  • Year and Date: 2016-10-04
  • Int'l Joint Research
• [Presentation] 動作と発話の引き込みを利用した物体認識精度の向上 (2015)
  • Author(s): 木本充彦，飯尾尊優，塩見昌裕，Tanev Ivan，下原勝憲，萩田紀博
  • Organizer: 日本ロボット学会第33回学術講演会講演論文集
  • Place of Presentation: 東京，日本
  • Year and Date: 2015-09-03
• [Presentation] Improvement of object reference recognition through human robot alignment (2015)
  • Author(s): Mitsuhiko Kimoto, Takamasa Iio, Masahiro Shiomi, Ivan Tanev, Katsunori Shimohara, Norihiro Hagita
  • Organizer: Robot and Human Interactive Communication (RO-MAN), 2015 24th IEEE International Symposium on
  • Place of Presentation: Kobe, Japan
  • Year and Date: 2015-08-31
  • Int'l Joint Research
• [Presentation] Self-Organizing of Information by Rhizomic-Link which Autonomously Grows: Modeling and Evaluation of Rhizomic-Link Mechanism (2015)
  • Author(s): Mitsuhiko Kimoto, Takamasa Iio, Masahiro Shiomi, Ivan Tanev, Katsunori Shimohara
  • Organizer: The 34th Chinese Control Conference and SICE Annual Conference 2015 (CCC & SICE 2015)
  • Place of Presentation: Hangzhou, China
  • Year and Date: 2015-07-28
  • Int'l Joint Research
• [Presentation] Self-Organizing of Information by Rhizomic-Link which Autonomously Grows: Modeling and Evaluation of Rhizomic-Link Mechanism (2015)
  • Author(s): Mitsuhiko Kimoto, Takamasa Iio, Masahiro Shiomi, Ivan Tanev, Katsunori Shimohara
  • Organizer: The 34th Chinese Control Conference and SICE Annual Conference 2015 (CCC & SICE 2015)
  • Place of Presentation: Takamatsu, Japan
  • Year and Date: 2015-07-20
  • Int'l Joint Research