• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Environment Recognition Method Based on Vision-Haptics-Motion Fusion with a Humanoid Robot

Research Project

Project/Area Number 17300068
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Perception information processing/Intelligent robotics
Research InstitutionNational Institute of Advanced Industrial Science and Technology

Principal Investigator

YOKOI Kazuhito  National Institute of Advanced Industrial Science and Technology, National Institute of Advanced Industrial Science and Technology,Intelligent Systems Research Instit, Research Group Leader (40358304)

Co-Investigator(Kenkyū-buntansha) NOBORIO Hiroshi  Osaka Electro-Communication University, Faculty of Information Science and Arts, Professor (10198616)
YOSHIDA Eiichi  National Institute of Advanced Industrial Science and Technology, Intelligent Systems Research Institute, Senior Researcher (30358329)
KITA Nobuyuki  National Institute of Advanced Industrial Science and Technology, Intelligent Systems Research Institute, Senior Researcher (90356874)
Project Period (FY) 2005 – 2007
Project Status Completed (Fiscal Year 2007)
Budget Amount *help
¥15,790,000 (Direct Cost: ¥14,500,000、Indirect Cost: ¥1,290,000)
Fiscal Year 2007: ¥5,590,000 (Direct Cost: ¥4,300,000、Indirect Cost: ¥1,290,000)
Fiscal Year 2006: ¥4,800,000 (Direct Cost: ¥4,800,000)
Fiscal Year 2005: ¥5,400,000 (Direct Cost: ¥5,400,000)
KeywordsIntelligent Robotics / Humanoid Robot / Motion Planning / ヒューマノイド / ロボット / 視覚 / 触覚 / 行動 / 環境
Research Abstract

The long term target of our humanoid research is to improve the capabilities of humanoid robot in order to perform a larger set of tasks in normal environments. This work is part of the undergoing investigation in integrating vision, haptics, and motion in an efficient way to increase humanoid's autonomy, interactivity and communication. In tins research, we developed several new technologies:
1. A human-inspired method to implement a basic visio-haptic behavior serving in preliminary knowledge acquisition of manipulable objects
2. The first implementation of real-time 3D SLAM for a humanoid robot which is able to demonstrate loop closing
3. A method of generating a reaching motion of a humanoid robot
4. A 3D object recognition method based on spin-images for a humanoid robot having a stereoscopic vision system which is able quickly to compute multi-resolution and interpolating spin-images
5. A visual search behavior of a 3D object in a 3D environment performed by a humanoid robot
6. A method of an object reconstruction for a visual search by a humanoid robot
7. A method to improving a performance of single camera SLAM by using fish-eye view, and
8. A method of generating full body motion for a humanoid robot to achieve camera pose given by a Next Best View algorithm.
The effectiveness of all the methods was confirmed by numerical simulations with OpenHRP simulator and experiments with a real humanoid robot HRP-2.

Report

(4 results)
  • 2007 Annual Research Report   Final Research Report Summary
  • 2006 Annual Research Report
  • 2005 Annual Research Report
  • Research Products

    (27 results)

All 2008 2007 2006 2005

All Journal Article (19 results) (of which Peer Reviewed: 7 results) Presentation (8 results)

  • [Journal Article] Active Visual Search by a Humanoid Robot2008

    • Author(s)
      Francois Saidi, 他
    • Journal Title

      Lecture Notes in Control and Information Sciences: Recent Progress in Robotics: Viable Robotic Service Human LNCIS 370

      Pages: 171-184

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] Active Visual Search by a Humanoid Robot2008

    • Author(s)
      Francois Saidi, et. al.
    • Journal Title

      Lecture Notes in Control and Information Sciences: Recent Progress in Robotics: Viable Robotic Service to Human LNCIS 370

      Pages: 171-184

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] Active Visual Search by a Humanoid Robot2008

    • Author(s)
      Francois Saidi, Olivier Stasse, Kazuhito Yokoi
    • Journal Title

      Lecture Notes in Control and lnformation Sciences:Recent Progress in Robotics:Viable Robotic Service to Human 370

      Pages: 171-184

    • Related Report
      2007 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Vision-based Virtual Information and Semi-autonomous Behaviors for a Humanoid Robot2006

    • Author(s)
      Stasse Olivier, 他
    • Journal Title

      Intelligent Autonomous Systems 9

      Pages: 794-803

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] A Method Determining the Reaching Behavior of Humanoid Robots2006

    • Author(s)
      Haitao Na, 他
    • Journal Title

      Proceedings of 2006 IEEE International Conference on Robotics and Biomimetics -

      Pages: 1535-1541

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] Real-time 3D SLAM for Humanoid Robot considering Pattern Generator Information2006

    • Author(s)
      Olivier Stasse, 他
    • Journal Title

      Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. -

      Pages: 348-355

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] 3D object recognition using spin-images for a humanoid stereoscopic vision system2006

    • Author(s)
      Olivier Stasse, 他
    • Journal Title

      Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems -

      Pages: 2955-2960

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] Vision-based Virtual Information and Semi-autonomous Behaviors for a Humanoid Robot2006

    • Author(s)
      Stasse Olivier, et. al.
    • Journal Title

      Intelligent Autonomous Systems 9

      Pages: 794-803

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] A Method Determining the Reaching Behavior of Humanoid Robots2006

    • Author(s)
      Haitao Na, et. al.
    • Journal Title

      Proceedings of 2006 IEEE International Conference on Robotics and Biomimetics

      Pages: 1535-1541

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] Real-time 3D SLAM for Humanoid Robot considering Pattern Generator Information2006

    • Author(s)
      Stasse Olivier, et. al.
    • Journal Title

      Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems

      Pages: 348-355

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] 3D object recognition using spin-images for a humanoid stereoscopic vision system2006

    • Author(s)
      Stasse Olivier, et. al.
    • Journal Title

      Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems

      Pages: 2955-2960

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] A Method Determining the Reaching Behavior of Humanoid Robots2006

    • Author(s)
      Haitao Na
    • Journal Title

      Proceedings of 2006 IEEE International Conference on Robotics and Biomimetics

      Pages: 1535-1541

    • Related Report
      2006 Annual Research Report
  • [Journal Article] 3D object recognition using spin-images for a humanoid stereoscopic vision system2006

    • Author(s)
      Olivier Stasse
    • Journal Title

      Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems

      Pages: 2955-2960

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Real-time 3D SLAM for Humanoid Robot considering Pattern Generator Information2006

    • Author(s)
      Olivier Stasse
    • Journal Title

      Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems

      Pages: 348-355

    • Related Report
      2006 Annual Research Report
  • [Journal Article] 単眼SLAMの広視野化による性能向上2006

    • Author(s)
      喜多 伸之
    • Journal Title

      動的画像処理実利用化ワークショップ2007講演論文集

      Pages: 293-298

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Vision-based Virtual Information and Semi-autonomous Behaviours for a Humanoid Robot2006

    • Author(s)
      Stasse Olivier
    • Journal Title

      Intelligent Autonomous Sytems 9

      Pages: 794-794

    • Related Report
      2005 Annual Research Report
  • [Journal Article] A Visio-haptic Percept using Guarded Motion and Augmented Reality Occlusion Checking for Humanoid Self-body Extraction and Primary Touch Function2005

    • Author(s)
      Abderrahmane Kheddar, 他
    • Journal Title

      Proceedings of International Symposium on Robotics -

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] A Visio-haptic Percept using Guarded Motion and Augmented Reality Occlusion Checking for Humanoid Self-body Extraction and Primary Touch Function2005

    • Author(s)
      Abderrahmane Kheddar, et. al.
    • Journal Title

      Proceedings of International Symposium on Robotics

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] A Visio-haptic Percept using Guarded Motion and Augmented Reality Occlusion Checking for Humanoid Self-body Extraction and Primary Touch Function2005

    • Author(s)
      Kheddar Abderrahmane
    • Journal Title

      Porceedings of International Symposium on Robotics

    • Related Report
      2005 Annual Research Report
  • [Presentation] 単眼SLAMの広視野化による性能向上(2)2008

    • Author(s)
      喜多 伸之
    • Organizer
      動的画像処理実利用化ワークショップ2008
    • Place of Presentation
      愛知県豊田市
    • Year and Date
      2008-03-06
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] Performance Improvement of Single Camera SLAM by Using Fish-eye View (2)2008

    • Author(s)
      Nobuyuki Kita.
    • Organizer
      Workshop on Dynamic Image Processing for Real Application
    • Place of Presentation
      Toyota, Aichi
    • Year and Date
      2008-03-06
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] 単眼SLAMの広視野化による性能向上2008

    • Author(s)
      喜多 伸之
    • Organizer
      動的画像処理実利用化ワークショップDIA2008
    • Place of Presentation
      愛知県豊田市
    • Year and Date
      2008-03-06
    • Related Report
      2007 Annual Research Report
  • [Presentation] Towards Autonomous Object Reconstruction for Visual Search by the Humanoid Robot HRP-22007

    • Author(s)
      Olivier Stasse, 他
    • Organizer
      IEEE-RAS International Conference on Humanoid Robots
    • Place of Presentation
      米国ペンシルバニア州
    • Year and Date
      2007-12-01
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] Towards Autonomous Object Reconstruction for Visual Search by the Humanoid Robot HRP-22007

    • Author(s)
      Olivier Stasse, et. al.
    • Organizer
      IEEE-RAS International Conference on Humanoid Robots
    • Place of Presentation
      Pittsburgh, Pennsylvania, USA.
    • Year and Date
      2007-12-01
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] Towards Autonomous Object Reconstruction for Visual Search by the Humanoid Robot HRP-22007

    • Author(s)
      O.Stasse, D.Larlus, B.Lagarde, A.Escande, F.Saidi, A.Kheddar, K.Yokoi, F.Juhe
    • Organizer
      IEEE-RAS International Conference on HumanoidRobots
    • Place of Presentation
      米国ペンシルバニア州
    • Year and Date
      2007-12-01
    • Related Report
      2007 Annual Research Report
  • [Presentation] 単眼SLAMの広視野化による性能向上2007

    • Author(s)
      喜多 伸之
    • Organizer
      動的画像処理実利用化ワークショップ2007
    • Place of Presentation
      北海道札幌市
    • Year and Date
      2007-03-09
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] Performance Improvement of Single Camera SLAM by Using Fish-eye View2007

    • Author(s)
      Nobuyuki Kita.
    • Organizer
      Workshop on Dynamic Image Processing for Real Application
    • Place of Presentation
      Sapporo, Hokkaido.
    • Year and Date
      2007-03-08
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary

URL: 

Published: 2005-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi