• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Research on a Robot that Operates Based on a Dialog with a User.

Research Project

Project/Area Number 13650279
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field Intelligent mechanics/Mechanical systems
Research InstitutionOsaka University

Principal Investigator

MIURA Jun  Associate Professor, Graduate School of Engineering, Osaka University, 大学院・工学研究科, 助教授 (90219585)

Co-Investigator(Kenkyū-buntansha) SAKIYAMA Takuro  Research Associate, Graduate School of Engineering, Osaka University, 大学院・工学研究科, 助手 (70335371)
SHIMADA Nobutaka  Associate Professor Graduate School of Engineering, Osaka University, 大学院・工学研究科, 助教授 (10294034)
SHIRAI Yoshiaki  Professor Gradnate School of Engineering, Osaka University, 大学院・工学研究科, 教授 (50206273)
Project Period (FY) 2001 – 2002
Project Status Completed (Fiscal Year 2002)
Budget Amount *help
¥3,500,000 (Direct Cost: ¥3,500,000)
Fiscal Year 2002: ¥1,600,000 (Direct Cost: ¥1,600,000)
Fiscal Year 2001: ¥1,900,000 (Direct Cost: ¥1,900,000)
KeywordsPersonal service robot / Object model generation and recognition / Interactive object recognition / Dialog generation / Robust speech recognition / Teaching / Mobile manipulator / 物体認識 / インタラクティブビジョン / 会話認識 / 辞書獲得 / センサベーストマニピュレーション / 作業移動ロボット
Research Abstract

As we are facing the "aging society", the need for such personal service robots which can help human in various everyday situations is increasing. We are developing a prototype of personal service robot that is able to fetch a can from a distant refrigerator. We have performed the research on the following functions required for such service robots:
Easy teaching of mobile manipulator: Usually service robots have to deal with much wider range of tasks than industrial ones. An easy, user-friendly teaching method is, therefore, desirable for such service robots. We developed the following teaching method. A user teaches the robot a nominal trajectory of the hand and its tolerance to achieve a task. The robot searches for a feasible trajectory within the given tolerance; it also generates the movement of the mobile base if necessary. Since the user only needs to consider the movement of the hand, the method is well intuitive and does not require much effort from a user; in addition, the robot does not need much computation for trajectory generation because a nominal trajectory is given.
Interactive object recognition: The robot basically recognizes cans and bottles using color information. If the robot failed to find a target object, it tries to obtain additional information by a dialog with a user. The robot generates a good question which can retrive informative answers from the user; this is a key to a smooth interaction between the robot aud the user.
Robust speech recognition: Many existing dialog-based interface systems assume that a speech recognition (sub)system always works well. However, since the dialog with a robot is usually held in environments where various noises exist, such an assumption cannot be made. We have developed a method for estimating the meaning of unidentified words from the (mistakenly) recognized words, the identified words before and after the unidentified one, and the state of the dialog.

Report

(3 results)
  • 2002 Annual Research Report   Final Research Report Summary
  • 2001 Annual Research Report
  • Research Products

    (22 results)

All Other

All Publications (22 results)

  • [Publications] Y.Makihara, M.Takizawa, K.Ninokata, Y.Shirai, J.Miura, N.Shimada: "Service Robot Acting by Occasional Dialog -Object Recognition Using Dialog with User and Sensor-Based Manipulation -"J. of Robotics and Mechatronics. 14・2. 124-132 (2002)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Y.Makihara, M.Takizawa, Y.Shirai, J.Miura, N.Shimada: "Object Recognition Supported by User Interaction for Service Robots"Proc. of the 5th Asian Conf. on Computer Vision. 719-724 (2002)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Y.Makihara, M.Takizawa, Y.Shirai, J.Miura, N.Shimada: "Object Recognition Supported by User Interaction for Service Robots"Proc. of the 16th Int. Conf. on Pattern Recoginition. 561-564 (2002)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] 滝澤, 槇原, 白井, 島田, 三浦: "サービスロボットのための対話システム"システム制御情報学会誌. 16・4. 174-182 (2003)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] J.Miura, Y.Shirai, N.Shimada, Y.Makihara, M.Takizawa, Y.Yano: "Development of a Personal Service Robot with User-Friendly Interfaces"Proc. of the 4th Int. Conf. on Field and Service Robots. (to appear). (2003)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Y.Makihara, M.Takizawa, N.Shimada, N.Shirai: "Object Recognition in Various Lighting Conditions"Proc. of the 13th Scandinavian Conf. on Image Analysis. (to appear). (2003)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Y. Makihara, M. Takizawa, K. Ninokata, Y. Shirai, J. Miura, and N. Shimada: "A Service Robot Acting by Occasional Dialog-Object Recognition Using Dialog with User and Sensor-Based Manipulation -"J. of Robotics and Mechatronics. Vol. 14, No. 2. 124-132 (2002)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Y. Makihara, M. Takizawa, Y. Shirai, J. Miura, and N. Shimada: "Object Recognition Supported by User Interaction for Service Robots"Proc. of the 5th Asian Conf. on Computer Vision. 719-724 (2002)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Y. Makihara, M. Takizawa, Y. Shirai, J. Miura, and N. Shimada: "Object Recognition Supported by User Interaction for Service Robots"Proc. of the 16th Int. Conf. on Pattern Recognition. 561-564 (2002)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] J. Miura, Y. Shirai, N. Shimada, Y. Makihara, M. Takizawa, and Y. Yano: "Development of a Personal Service Robot with User-Friendly Interfaces"Proc. of the 4th Int. Conf. on Field and Service Robots. to appear. (2003)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Y. Makihara, M. Takizawa, N. Shimada, and Y. Shirai: "Object Recognition in Various Lighting Conditions"Proc. of the 13th Scandinavian Conf. on Image Analysis. to appear. (2003)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Y.Makihara, M.Takizawa, K.Ninokata, Y.Shirai, J.Miura, N.Shimada: "A Service Robot Acting by Occasional Dialog-Object Recognition Using Dialog with User and Sensor-Based Manipulation"J. of Robotics and Mechatronics. 14・2. 124-132 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] 滝澤, 槇原, 白井, 三浦, 島田: "サービスロボットのための対話システム"システム制御情報学会誌. 16・4(掲載予定). (2003)

    • Related Report
      2002 Annual Research Report
  • [Publications] Y.Makihara, M.Takizawa, Y.Shirai, J.Miura, N.Shimada: "Object Recognition Supported by User Interaction for Service Robots"Proc. of the 16th Int. Conf. on Pattern Recoginition. 561-564 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] 矢野, 槇原, 滝澤, 白井, 三浦, 島田: "福祉用サービスロボットの開発"第2回福祉工学シンポジウム. 145-149 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] 槇原, 滝澤, 白井, 三浦, 島田: "ユーザとの対話を用いたサービスロボットのための物体認識"第20回日本ロボット学会学術講演会. (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] 矢野, 三浦, 白井, 島田: "移動マニピュレータのための直観的作業教示方法"第20回日本ロポット学会学術講演会. (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] 矢野, 伊藤, 三浦, 白井, 島田: "パーソナルサービスロボットの開発-離れた場所にある冷蔵庫から缶飲料を取ってくる作業の実現-"日本機械学会ロボティクス・メカトロニクス講演会. (発表予定). (2003)

    • Related Report
      2002 Annual Research Report
  • [Publications] Y.Makihara et al.: "A Service Robot Acting by Occasional Dialog-Object Recognition Using Dialog with User and Sensor-Based Manipulation-"J. of Robotics and Mechatronics. 14・2(to appear). (2002)

    • Related Report
      2001 Annual Research Report
  • [Publications] Y.Makihara et al.: "Object Recognition Supported by User Interaction for Service Robots"Proc. 5th Asian Conf. on Computer Vision. 719-724 (2002)

    • Related Report
      2001 Annual Research Report
  • [Publications] 槇原, 滝澤, 白井, 三浦, 島田: "ユーザとの対話を用いたサービスロボットのための物体登録"第19回日本ロボット学会学術講演会. (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] 槙原, 二ノ方, 滝澤, 白井, 三浦, 島田: "必要に応じてユーザと対話しながら行動するロボット-対話を利用した物体の認識と操作-"日本機械学会ロボティクス・メカトロニクス講演会. (2001)

    • Related Report
      2001 Annual Research Report

URL: 

Published: 2001-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi