Robots for daily life assistance based on a multimodal language

• Project/Area Number: 22500179
• Research Category: Grant-in-Aid for Scientific Research (C)
• Allocation Type: Single-year Grants
• Section: 一般
• Research Field: Perception information processing/Intelligent robotics
• Research Institution: Nihon University
• Principal Investigator: OKA Tetsushi 日本大学, 生産工学部, 准教授 (00282921)
• Project Period (FY): 2010 – 2012
• Project Status: Completed (Fiscal Year 2012)
• Budget Amount: ¥4,290,000 (Direct Cost: ¥3,300,000、Indirect Cost: ¥990,000); Fiscal Year 2012: ¥780,000 (Direct Cost: ¥600,000、Indirect Cost: ¥180,000); Fiscal Year 2011: ¥650,000 (Direct Cost: ¥500,000、Indirect Cost: ¥150,000); Fiscal Year 2010: ¥2,860,000 (Direct Cost: ¥2,200,000、Indirect Cost: ¥660,000)
• Keywords: ロボット / 生活支援 / インタラクション / 音声 / ジェスチャ / タッチスクリーン / マルチモーダル / 言語 / 生活支援ロボット / 接触 / 家電 / 意図伝達 / コミュニケーション

Research Abstract

Some user studies of robots that can be directed to move to goals, move objects, and operate home electrical appliances were conducted. The results show that untrained Japanese speakers can effortlessly communicate with robots for daily life assistance through multimodal interactions using speech, 3D gesture and touch on a screen. Furthermore, they provide new insight into designing multimodal languages for commanding robots to receive wider spectrum of help.

Research Products

• [Journal Article] A multimodal language to communicate with life-supporting robots through a touch screen and a speech interface (2011)
  • Author(s): 岡 哲資、松 本 大 賢、木 林 龍 一
  • Journal Title: Artificial Life and Robotics Volume: 16 Issue: 3 Pages: 292-296
  • DOI: 10.1007/s10015-011-0924-x
  • Peer Reviewed
• [Journal Article] User study of a life-supporting humanoid directed in a multimodal language (2011)
  • Author(s): 岡 哲資 、阿倍豊和、杉田薫、横田将生
  • Journal Title: Artificial Life and Robotics Volume: 16 Issue: 2 Pages: 224-228
  • DOI: 10.1007/s10015-011-0923-y
  • Peer Reviewed
• [Journal Article] Commanding a humanoid to move objects in a multimodal language (2010)
  • Author(s): 岡 哲資 、阿倍豊和、杉田薫、横田将生
  • Journal Title: Artificial Life and Robotics Volume: 15 Issue: 1 Pages: 17-20
  • DOI: 10.1007/s10015-010-0758-y
  • Peer Reviewed
• [Presentation] 音声と手のジェスチャーによる家庭用ロボットへの家電操作命令 (2013)
  • Author(s): 岡哲資
  • Organizer: 情報処理学会第75回全国大会
  • Place of Presentation: 東北大学
• [Presentation] Gesture detection based on 3D tracking for multimodal communication with a life-supporting robot (2012)
  • Author(s): 岡哲資・木林龍一
  • Organizer: 17^<th> International Symposium on Artificial Life and Robotics (AROB17)
  • Place of Presentation: ビーコンプラザ(大分県別府市)
  • Year and Date: 2012-01-21
• [Presentation] 音声とタッチパネルによる生活支援ロボットの命令方法 (2011)
  • Author(s): 松本大賢
  • Organizer: 日本機械学会ロボティクスメカトロニクス講演会ROBOMEC 2011 in OKAYAMA
  • Place of Presentation: 岡山コンベンションセンター(岡山県岡山市)
  • Year and Date: 2011-05-28
• [Presentation] A multimodal language to communicate with life supporting robots through a touch screen and a speech interface (2011)
  • Author(s): 岡哲資
  • Organizer: 16^<th> International Symposium on Artificial Life and Robotics (AROB16)
  • Place of Presentation: ビーコンプラザ(大文県別府市)
  • Year and Date: 2011-01-27
• [Presentation] User study of a life-supporting humanoid directed in a multimodal langauge (2011)
  • Author(s): 岡哲資
  • Organizer: 16^<th> International Symposium on Artificial Life and Robotics (AROB16)
  • Place of Presentation: ビーコンプラザ(大文県別府市)
  • Year and Date: 2011-01-27
• [Remarks]
  • URL: http://okalab.su.cit.nihon-u.ac.jp/users/oka/research/lsr/
• [Remarks]
  • URL: http://okalab.su.cit.nihon-u.ac.jp/users/oka/research/lsr/