• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to project page

2005 Fiscal Year Final Research Report Summary

Research for 3D Space Map Acquisition for Robot by Combining Active Motion and Visual Perception

Research Project

Project/Area Number 15360213
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Measurement engineering
Research InstitutionTohoku University

Principal Investigator

DEGUCHI Koichiro  Tohoku University, Graduate School of Information Science, Professor, 大学院・情報科学研究科, 教授 (30107544)

Co-Investigator(Kenkyū-buntansha) OKATANI Takayuki  Tohoku University, Graduate School of Information Science, Associate Professor, 大学院・情報科学研究科, 助教授 (00312637)
USHIDA Shun  Tohoku University, Graduate School of Information Science, Research Assistant, 大学院・情報科学研究科, 助手 (30343114)
Project Period (FY) 2003 – 2005
KeywordsComputer Vision / Active Vision / 3-Dimension Vision / Space Perception / Robot Vision / Motion Image Processing / Camera Calibration / Cooperative Vision
Research Abstract

This research project aimed to develop an active vision strategy to let a robot obtain 3D scene understanding from his stereo eyes. That is, the robot constructs a 3D map of an unknown environment by himself using his own eyes (cameras) and his own intentional actions. The task to get to know the external world using vision is absolutely difficult for artificial systems, such as robots, while our human achieves it easily without teacher or advance knowledge. In this research, we placed an answer based on a key concept of the invariance against our actions.
We reported a realization of the direct perception of three-dimensional space in a robot. We proposed a method to calibrate the stereo eyes of a robot to build 3D map in his brain. It does not need an external reference of calibration objects but a combination of active motion and visual perception.
The idea is common to so-called the self-calibration to some extent. But, the calibration and the following construction of the 3D map still considered separately in the self-calibration. In our method, we combine action and vision to achieve totally efficient calibration and the construction of the 3D map. We rely only on the consistency in the calibration results. We introduced the fact that "stationary object both in the real environment and on the robot's 3D map never moves even when the robot moves around". This means that we accept a calibration error and resulting geometric distortion of the constructed 3D map. We consider that the most important for the 3D map is the consistency between the intended motion of the robot and the perceived image by the robot.
We showed the feasibility of this idea with plenty of simulation experiments and implementation on actual robots.

  • Research Products

    (36 results)

All 2006 2005 2004 2003

All Journal Article (36 results)

  • [Journal Article] 3D Space Map Acquisition for Robot by Combining Active Motion and Visual Perception2006

    • Author(s)
      K.Deguchi, T.Nakagawa
    • Journal Title

      International Journal of Pattern Recognition and Artificial Intelligence (印刷中)

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] 3D Space Map Acquisition for Robot by Combining Active Motion and Visual Perception2006

    • Author(s)
      K.Deguchi, T.Nakagawa
    • Journal Title

      International Journal of Pattern Recognition and Artificial Intelligence (in press)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] 行動と画像変化を結びつけたロボットの空間認識2005

    • Author(s)
      中川智洋, 岡谷貴之, 出口光一郎
    • Journal Title

      日本ロボット学会誌 Vol.23, No.3

      Pages: 362-369

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] Expanding selfsimilar solutions of a crystalline flow with applications to contour figure analysis2005

    • Author(s)
      Hidekata Hontani, Mi-Ho Giga, Yoshikazu Giga, Koichiro Deguchi
    • Journal Title

      Discrete Applied Mathematics 147

      Pages: 265-285

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] Autocalibration of a Projector-Camera System2005

    • Author(s)
      Takayuki Okatani, Koichiro Deguchi
    • Journal Title

      IEEE Trans. Pattern Analysis and Machine Intelligence Vol.27, No.12

      Pages: 1845-1855

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] Motion Stabilization of Biped Robot by Gaze Control2005

    • Author(s)
      Shota TAKIZAWA, Shun USHIDA, Takayuki OKATANI, Koichiro DEGUCHI
    • Journal Title

      Proceedings of the 9th IAPR Conference on Machine Vision Applications(MVA2005)

      Pages: 324-327

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] HHMM Based Recognition of Human Activity Motion Trajectories in Image Sequences2005

    • Author(s)
      Daiki KAWANAKA, Shun USHIDA, Takayuki OKATANI, Koichiro DEGUCHI
    • Journal Title

      Proceedings of the 9th IAPR Conference on Machine Vision Applications (MVA2005)

      Pages: 578-581

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] A scale-space analysis of a contour figure using a crystalline flow2005

    • Author(s)
      H.Hontani, Y.Suzuki, Y.Giga, M.-H.Giga, K.Deguchi
    • Journal Title

      Proceedings of 5th International Conference

      Pages: 155--166

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] 2DOF Motion Stabilization of Biped Robot by Gaze Control Strategy2005

    • Author(s)
      Shota TAKIZAWA, Shun USHIDA, Takayuki OKATANI, Koichiro DEGUCHI
    • Journal Title

      2005 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS2005)

      Pages: 3809-3814

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] Active Acquisition of 3D Map in Robot Brain by Combining Motion and Perceived Images2005

    • Author(s)
      Koichiro Deguchi
    • Journal Title

      First International Symposium on Brain, Vision, and Artificial Intelligence (BV&AI2005)

      Pages: 386-395

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] 3D Space Recognition of Robot by Combining Action and Visual Perception2005

    • Author(s)
      Tomohiro Nakagawa, Takayuki Okatani, Koichiro Deguchi
    • Journal Title

      Transaction of The Robotics Society of Japan Vol.23, No.3

      Pages: 362-369

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] Autocalibration of a Projector-Camera System2005

    • Author(s)
      Takayuki Okatani, Koichiro Deguchi
    • Journal Title

      IEEE Trans.Pattern Analysis and Machine Intelligence Vol.27, No.12

      Pages: 1845-1855

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] Motion Stabilization of Biped Robot by Gaze Control2005

    • Author(s)
      Shota TAKIZAWA, Shun USHIDA, Takayuki OKATANI, Koichiro DEGUCHI
    • Journal Title

      Proceedings of the 9th IAPR Conference on Machine Vision Applications (MVA2005)

      Pages: 324-327

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] A scale-space analysis of a contour figure using a crystalline flow2005

    • Author(s)
      H.Hontani, Y.Suzuki, Y.Giga, M.-H.Giga, K.Deguchi
    • Journal Title

      Proceedings of 5th International Conference, Scale-Space 2005

      Pages: 155-166

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] 実環境での物体認識のための距離画像マッチング2004

    • Author(s)
      長尾影洋, 岡谷貴之, 出口光一郎
    • Journal Title

      計測自動制御学会論文誌 vol.40. no.1

      Pages: 10-17

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] Compression Performances of Computer Vision Based Coding2004

    • Author(s)
      Franck Galpin, Koichiro Deguchi, Luce Morin
    • Journal Title

      IEICE Transactions on Information and Systems Vol.E87-D, Num.1

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] ACTIVE CONSTRUCTION OF 3D MAP IN ROBOT BY COMBINING MOTION AND PERCEIVED IMAGES2004

    • Author(s)
      Tomohiro Nakagawa, Takayuki Okatani, Koichiro Deguchi
    • Journal Title

      Proceedings of Asian Conference on Computer Vision Vol.1

      Pages: 563-568

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] A Color-based Tracking by Kalman Particle Filter2004

    • Author(s)
      Yoshinori Satoh, Takayuki Okatani, Koichiro Deguchi
    • Journal Title

      17th International Conference on Pattern Recognition(ICPR17) vol.3

      Pages: 502-505

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] Object tracking by the mean-shift of regional color distribution combined with the particle-filter algorithm2004

    • Author(s)
      Koichiro Deguchi, Daiki Kawanaka, Takayuki Okatani
    • Journal Title

      17th International Conference on Pattern Recognition(ICPR17) vol.3

      Pages: 506-509

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] A Color-based Probabilistic Tracking by Using Graphical Models2004

    • Author(s)
      Y.Sato, T.Okatani, K.Deguchi
    • Journal Title

      Proceedings of 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems

      Pages: 631-636

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] Active and Direct Acquisition of 3D Map in Robot by Combining Motion and Perceived Images2004

    • Author(s)
      K.Deguchi, T.Nakagawa
    • Journal Title

      Proceedings of 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems

      Pages: 1692-1697

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] Range Image Matching for Object Recognition in Real Scene2004

    • Author(s)
      Kagehiro Nagao, Takayuki Okatani, Koichiro Deguchi
    • Journal Title

      Transaction of The Society of Instrument and Control Engineers vol.40.no.1

      Pages: 10-17

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] A Color-based Tracking by Kalman Particle Filter2004

    • Author(s)
      Yoshinori Satoh, Takayuki Okatani, Koichiro Deguchi
    • Journal Title

      17th International Conference on Pattern Recognition (ICPR17) vol.3

      Pages: 502-505

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] Object tracking by the mean-shift of regional color distribution combined with the particle-filter algorithm2004

    • Author(s)
      Koichiro Deguchi, Daiki Kawanaka, Takayuki Okatani
    • Journal Title

      17th International Conference on Pattern Recognition (ICPR17) vol.3

      Pages: 506-509

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] A Color-based Probabilistic Tracking by Using Graphical Models2004

    • Author(s)
      Y.Sato, T.Okatani, K.Deguchi
    • Journal Title

      Proceedings of 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems, (IROS2004)

      Pages: 631-636

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] Active and Direct Acquisition of 3D Map in Robot by Combining Motion and Perceived Images2004

    • Author(s)
      K.Deguchi, T.Nakagawa
    • Journal Title

      Proceedings of 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems, (IROS2004)

      Pages: 1692-1697

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] Binocular motion tracking by gaze fixation control and three-dimensional shape reconstruction2003

    • Author(s)
      Y.Satoh, T.Okatani, K.Deguchi
    • Journal Title

      International Journal of RSJ--Advanced Robotics vol.17, no.10

      Pages: 1057-1073

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] Toward a Statistically Optimal Method for Estimating Geometric Relations from Noisy Data : Cases of Linear Relations2003

    • Author(s)
      Takayuki Okatani, Koichiro Deguchi
    • Journal Title

      Proceedings of IEEE Conference on Computer Vision and Pattern Recognition Vol.I

      Pages: 432-439

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] Tracking Multiple Three-Dimensional Motions by Using Modified Condensation Algorithm and Multiple Images2003

    • Author(s)
      Koji Hamasaki, Taira Nakajima, Takayuki Okatani, Koichiro Deguchi
    • Journal Title

      Proceedings of IEEE/RSJ IROS 2003 (CD-ROM)

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] Autocalibration of a Projector-Screen-Camera System : Theory and Algorithm for Screen-to-Camera Homography Estimation2003

    • Author(s)
      T.Okatani, K.Deguchi
    • Journal Title

      Proceedings of International Conference on Computer Vision

      Pages: 774-781

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] A Computation of a Crystalline Flow Starting from Non-admissible Polygon Using Expanding Selfsimilar Solutions2003

    • Author(s)
      H.Hontani, M.H.Giga, Y.Giga, K.Deguchi
    • Journal Title

      11th International Conference of Discrete Geometry for Computer Imagery

      Pages: 465-474

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] Construction of 3D Map in Robot by Combining Action and Perceived Images (Invited)2003

    • Author(s)
      K.Deguchi
    • Journal Title

      Proceedings of the Australia-Japan Advanced Workshop on Computer Vision

      Pages: 132-141

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] Toward a Statistically Optimal Method for Estimating Geometric Relations from Noisy Data : Cases of Linear Relations2003

    • Author(s)
      Takayuki Okatani, Koichiro Deguchi
    • Journal Title

      Toward a Statistically Optimal Method for Estimating Geometric Relations from Noisy Data : Cases of Linear Relations Vol.I

      Pages: 432-439

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] Tracking Multiple Three-Dimensional Motions by Using Modified Condensation Algorithm and Multiple Images2003

    • Author(s)
      Koji Hamasaki, Taira Nakajima, Takayuki Okatani, Koichiro Deguchi
    • Journal Title

      Proceedings of IEEE/RSJ IROS 2003

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] A Computation of a Crystalline Flow Starting from Non-admissible Polygon Using Expanding Selfsimilar Solutions2003

    • Author(s)
      H.Hontani, M.H.Giga, Y.Giga, K.Deguchi
    • Journal Title

      11th International Conference of Discrete Geometry for Computer Imagery (LNCS 2886, Springer)

      Pages: 465-474

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] Construction of 3D Map in Robot by Combining Action and Perceived Images (Invited)2003

    • Author(s)
      K.Deguchi
    • Journal Title

      Proceedings of the Australia-Japan Advanced Workshop on Computer Vision 9-11

      Pages: 132-141

    • Description
      「研究成果報告書概要(欧文)」より

URL: 

Published: 2007-12-13  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi