Robots for daily life assistance based on a multimodal language

2012 Fiscal Year Final Research Report

• Project/Area Number: 22500179
• Research Category: Grant-in-Aid for Scientific Research (C)
• Allocation Type: Single-year Grants
• Section: 一般
• Research Field: Perception information processing/Intelligent robotics
• Research Institution: Nihon University
• Principal Investigator: OKA Tetsushi 日本大学, 生産工学部, 准教授 (00282921)
• Project Period (FY): 2010 – 2012
• Keywords: ロボット / 生活支援 / インタラクション / 音声 / ジェスチャ / タッチスクリーン / マルチモーダル / 言語

Research Abstract

Some user studies of robots that can be directed to move to goals, move objects, and operate home electrical appliances were conducted. The results show that untrained Japanese speakers can effortlessly communicate with robots for daily life assistance through multimodal interactions using speech, 3D gesture and touch on a screen. Furthermore, they provide new insight into designing multimodal languages for commanding robots to receive wider spectrum of help.

Research Products

• [Journal Article] A multimodal language to communicate with life-supporting robots through a touch screen and a speech interface (2011)
  • Author(s): 岡 哲資、松 本 大 賢、木 林 龍 一
  • Journal Title: Artificial Life and Robotics Volume: 16 Pages: 292-296
  • DOI: DOI:10.1007/s10015-011-0924-x
  • Peer Reviewed
• [Journal Article] User study of a life-supporting humanoid directed in a multimodal language (2011)
  • Author(s): 岡 哲資 、阿倍豊和、杉田薫、横田将生
  • Journal Title: Artificial Life and Robotics Volume: 16 Pages: 224-228
  • DOI: DOI:10.1007/s10015-011-0923-y
  • Peer Reviewed
• [Journal Article] Commanding a humanoid to move objects in a multimodal language (2010)
  • Author(s): 岡 哲資 、阿倍豊和、杉田薫、横田将生
  • Journal Title: Artificial Life and Robotics Volume: 15 Pages: 17-20
  • DOI: DOI:10.1007/s10015-010-0758-y
  • Peer Reviewed