• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Research for 3D Space Map Acquisition for Robot by Combining Active Motion and Visual Perception

Research Project

Project/Area Number 15360213
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Measurement engineering
Research InstitutionTohoku University

Principal Investigator

DEGUCHI Koichiro  Tohoku University, Graduate School of Information Science, Professor, 大学院・情報科学研究科, 教授 (30107544)

Co-Investigator(Kenkyū-buntansha) OKATANI Takayuki  Tohoku University, Graduate School of Information Science, Associate Professor, 大学院・情報科学研究科, 助教授 (00312637)
USHIDA Shun  Tohoku University, Graduate School of Information Science, Research Assistant, 大学院・情報科学研究科, 助手 (30343114)
中島 平  東北大学, 大学院・工学研究科, 講師 (30312614)
Project Period (FY) 2003 – 2005
Project Status Completed (Fiscal Year 2005)
Budget Amount *help
¥14,500,000 (Direct Cost: ¥14,500,000)
Fiscal Year 2005: ¥4,200,000 (Direct Cost: ¥4,200,000)
Fiscal Year 2004: ¥4,400,000 (Direct Cost: ¥4,400,000)
Fiscal Year 2003: ¥5,900,000 (Direct Cost: ¥5,900,000)
KeywordsComputer Vision / Active Vision / 3-Dimension Vision / Space Perception / Robot Vision / Motion Image Processing / Camera Calibration / Cooperative Vision
Research Abstract

This research project aimed to develop an active vision strategy to let a robot obtain 3D scene understanding from his stereo eyes. That is, the robot constructs a 3D map of an unknown environment by himself using his own eyes (cameras) and his own intentional actions. The task to get to know the external world using vision is absolutely difficult for artificial systems, such as robots, while our human achieves it easily without teacher or advance knowledge. In this research, we placed an answer based on a key concept of the invariance against our actions.
We reported a realization of the direct perception of three-dimensional space in a robot. We proposed a method to calibrate the stereo eyes of a robot to build 3D map in his brain. It does not need an external reference of calibration objects but a combination of active motion and visual perception.
The idea is common to so-called the self-calibration to some extent. But, the calibration and the following construction of the 3D map still considered separately in the self-calibration. In our method, we combine action and vision to achieve totally efficient calibration and the construction of the 3D map. We rely only on the consistency in the calibration results. We introduced the fact that "stationary object both in the real environment and on the robot's 3D map never moves even when the robot moves around". This means that we accept a calibration error and resulting geometric distortion of the constructed 3D map. We consider that the most important for the 3D map is the consistency between the intended motion of the robot and the perceived image by the robot.
We showed the feasibility of this idea with plenty of simulation experiments and implementation on actual robots.

Report

(4 results)
  • 2005 Annual Research Report   Final Research Report Summary
  • 2004 Annual Research Report
  • 2003 Annual Research Report
  • Research Products

    (53 results)

All 2006 2005 2004 2003 Other

All Journal Article (46 results) Book (1 results) Publications (6 results)

  • [Journal Article] 3D Space Map Acquisition for Robot by Combining Active Motion and Visual Perception2006

    • Author(s)
      K.Deguchi, T.Nakagawa
    • Journal Title

      International Journal of Pattern Recognition and Artificial Intelligence (印刷中)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] 3D Space Map Acquisition for Robot by Combining Active Motion and Visual Perception2006

    • Author(s)
      K.Deguchi, T.Nakagawa
    • Journal Title

      International Journal of Pattern Recognition and Artificial Intelligence (in press)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] 3D Space Map Acquisition for Robot by Combining Active Motion and Visual Perception2006

    • Author(s)
      K.Deguchi, T.Nakagawa
    • Journal Title

      International Journal of Pattern Recognition and Artificial Intelligence (掲載決定)(印刷中)

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 行動と画像変化を結びつけたロボットの空間認識2005

    • Author(s)
      中川智洋, 岡谷貴之, 出口光一郎
    • Journal Title

      日本ロボット学会誌 Vol.23, No.3

      Pages: 362-369

    • NAID

      10015532235

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Expanding selfsimilar solutions of a crystalline flow with applications to contour figure analysis2005

    • Author(s)
      Hidekata Hontani, Mi-Ho Giga, Yoshikazu Giga, Koichiro Deguchi
    • Journal Title

      Discrete Applied Mathematics 147

      Pages: 265-285

    • NAID

      120006459340

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Annual Research Report 2005 Final Research Report Summary
  • [Journal Article] Autocalibration of a Projector-Camera System2005

    • Author(s)
      Takayuki Okatani, Koichiro Deguchi
    • Journal Title

      IEEE Trans. Pattern Analysis and Machine Intelligence Vol.27, No.12

      Pages: 1845-1855

    • NAID

      120002337727

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Motion Stabilization of Biped Robot by Gaze Control2005

    • Author(s)
      Shota TAKIZAWA, Shun USHIDA, Takayuki OKATANI, Koichiro DEGUCHI
    • Journal Title

      Proceedings of the 9th IAPR Conference on Machine Vision Applications(MVA2005)

      Pages: 324-327

    • NAID

      10018207568

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] HHMM Based Recognition of Human Activity Motion Trajectories in Image Sequences2005

    • Author(s)
      Daiki KAWANAKA, Shun USHIDA, Takayuki OKATANI, Koichiro DEGUCHI
    • Journal Title

      Proceedings of the 9th IAPR Conference on Machine Vision Applications (MVA2005)

      Pages: 578-581

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] A scale-space analysis of a contour figure using a crystalline flow2005

    • Author(s)
      H.Hontani, Y.Suzuki, Y.Giga, M.-H.Giga, K.Deguchi
    • Journal Title

      Proceedings of 5th International Conference

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] 2DOF Motion Stabilization of Biped Robot by Gaze Control Strategy2005

    • Author(s)
      Shota TAKIZAWA, Shun USHIDA, Takayuki OKATANI, Koichiro DEGUCHI
    • Journal Title

      2005 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS2005)

      Pages: 3809-3814

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Annual Research Report 2005 Final Research Report Summary
  • [Journal Article] Active Acquisition of 3D Map in Robot Brain by Combining Motion and Perceived Images2005

    • Author(s)
      Koichiro Deguchi
    • Journal Title

      First International Symposium on Brain, Vision, and Artificial Intelligence (BV&AI2005)

      Pages: 386-395

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] 3D Space Recognition of Robot by Combining Action and Visual Perception2005

    • Author(s)
      Tomohiro Nakagawa, Takayuki Okatani, Koichiro Deguchi
    • Journal Title

      Transaction of The Robotics Society of Japan Vol.23, No.3

      Pages: 362-369

    • NAID

      10015532235

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Autocalibration of a Projector-Camera System2005

    • Author(s)
      Takayuki Okatani, Koichiro Deguchi
    • Journal Title

      IEEE Trans.Pattern Analysis and Machine Intelligence Vol.27, No.12

      Pages: 1845-1855

    • NAID

      120002337727

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Motion Stabilization of Biped Robot by Gaze Control2005

    • Author(s)
      Shota TAKIZAWA, Shun USHIDA, Takayuki OKATANI, Koichiro DEGUCHI
    • Journal Title

      Proceedings of the 9th IAPR Conference on Machine Vision Applications (MVA2005)

      Pages: 324-327

    • NAID

      10018207568

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Annual Research Report 2005 Final Research Report Summary
  • [Journal Article] A scale-space analysis of a contour figure using a crystalline flow2005

    • Author(s)
      H.Hontani, Y.Suzuki, Y.Giga, M.-H.Giga, K.Deguchi
    • Journal Title

      Proceedings of 5th International Conference, Scale-Space 2005

      Pages: 155-166

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Annual Research Report 2005 Final Research Report Summary
  • [Journal Article] Active Acquisition of 3D Map in Robot Brain by Combining Motion and Perceived Images2005

    • Author(s)
      Koichiro Deguchi
    • Journal Title

      First International Symposium on Brain, Vision, and Artificial Intelligence (BV&AI2005), Springer LNCS No.3704

      Pages: 386-395

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 行動と画像変化を結びつけたロボットの空間認識2005

    • Author(s)
      中川智洋, 岡谷貴之, 出口光一郎
    • Journal Title

      日本ロボット学会誌 23・3

      Pages: 362-369

    • NAID

      10015532235

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Autocalibration of a Projector-Camera System2005

    • Author(s)
      Takayuki Okatani, Koichiro Deguchi
    • Journal Title

      IEEE Trans.Pattern Analysis and Machine Intelligence 27・12

      Pages: 1845-1855

    • NAID

      120002337727

    • Related Report
      2005 Annual Research Report
  • [Journal Article] HHMM Based Recognition of Human Activity Motion Trajectories in Image Sequences2005

    • Author(s)
      Daiki KAWANAKA, Shun USHIDA, Takayuki OKATANI, Koichiro DEGUCHI
    • Journal Title

      Proceedings of the 9th IAPR Conference on Machine Vision Applications (MVA 2005)

      Pages: 578-581

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Just-In-Timeモデリング技術を用いた非線形システムの同定と制御2005

    • Author(s)
      牛田 俊, 木村 英紀
    • Journal Title

      計測自動制御学会誌「計測と制御」 44・2

      Pages: 102-106

    • NAID

      10014356933

    • Related Report
      2004 Annual Research Report
  • [Journal Article] 行動と画像変化を結びつけたロボットの空間認識、20052005

    • Author(s)
      中川智洋, 岡谷貴之, 出口光一郎
    • Journal Title

      日本ロボット学会誌 23・3

      Pages: 1-8

    • Related Report
      2004 Annual Research Report
  • [Journal Article] 実環境での物体認識のための距離画像マッチング2004

    • Author(s)
      長尾影洋, 岡谷貴之, 出口光一郎
    • Journal Title

      計測自動制御学会論文誌 vol.40. no.1

      Pages: 10-17

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Compression Performances of Computer Vision Based Coding2004

    • Author(s)
      Franck Galpin, Koichiro Deguchi, Luce Morin
    • Journal Title

      IEICE Transactions on Information and Systems Vol.E87-D, Num.1

    • NAID

      10011816715

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] ACTIVE CONSTRUCTION OF 3D MAP IN ROBOT BY COMBINING MOTION AND PERCEIVED IMAGES2004

    • Author(s)
      Tomohiro Nakagawa, Takayuki Okatani, Koichiro Deguchi
    • Journal Title

      Proceedings of Asian Conference on Computer Vision Vol.1

      Pages: 563-568

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] A Color-based Tracking by Kalman Particle Filter2004

    • Author(s)
      Yoshinori Satoh, Takayuki Okatani, Koichiro Deguchi
    • Journal Title

      17th International Conference on Pattern Recognition(ICPR17) vol.3

      Pages: 502-505

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Object tracking by the mean-shift of regional color distribution combined with the particle-filter algorithm2004

    • Author(s)
      Koichiro Deguchi, Daiki Kawanaka, Takayuki Okatani
    • Journal Title

      17th International Conference on Pattern Recognition(ICPR17) vol.3

      Pages: 506-509

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] A Color-based Probabilistic Tracking by Using Graphical Models2004

    • Author(s)
      Y.Sato, T.Okatani, K.Deguchi
    • Journal Title

      Proceedings of 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems

      Pages: 631-636

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary 2004 Annual Research Report
  • [Journal Article] Active and Direct Acquisition of 3D Map in Robot by Combining Motion and Perceived Images2004

    • Author(s)
      K.Deguchi, T.Nakagawa
    • Journal Title

      Proceedings of 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems

      Pages: 1692-1697

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Range Image Matching for Object Recognition in Real Scene2004

    • Author(s)
      Kagehiro Nagao, Takayuki Okatani, Koichiro Deguchi
    • Journal Title

      Transaction of The Society of Instrument and Control Engineers vol.40.no.1

      Pages: 10-17

    • NAID

      10011946572

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] A Color-based Tracking by Kalman Particle Filter2004

    • Author(s)
      Yoshinori Satoh, Takayuki Okatani, Koichiro Deguchi
    • Journal Title

      17th International Conference on Pattern Recognition (ICPR17) vol.3

      Pages: 502-505

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Object tracking by the mean-shift of regional color distribution combined with the particle-filter algorithm2004

    • Author(s)
      Koichiro Deguchi, Daiki Kawanaka, Takayuki Okatani
    • Journal Title

      17th International Conference on Pattern Recognition (ICPR17) vol.3

      Pages: 506-509

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] A Color-based Probabilistic Tracking by Using Graphical Models2004

    • Author(s)
      Y.Sato, T.Okatani, K.Deguchi
    • Journal Title

      Proceedings of 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems, (IROS2004)

      Pages: 631-636

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Active and Direct Acquisition of 3D Map in Robot by Combining Motion and Perceived Images2004

    • Author(s)
      K.Deguchi, T.Nakagawa
    • Journal Title

      Proceedings of 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems, (IROS2004)

      Pages: 1692-1697

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Object tracking by the mean-shift of regional color distribution combined with the particle-filter algorithm2004

    • Author(s)
      Koichiro Deguchi, Daiki Kawanaka, Takayuki Okatani
    • Journal Title

      Proceedings of the 17th International Conference on Pattern Recognition (ICPR17) vol.3

      Pages: 506-509

    • Related Report
      2004 Annual Research Report
  • [Journal Article] A Color-based Tracking by Kalman Particle Filter2004

    • Author(s)
      Yoshinori Satoh, Takayuki Okatani, Koichiro Deguchi
    • Journal Title

      Proceedings of the 17th International Conference on Pattern Recognition (ICPR17) vol.3

      Pages: 502-505

    • Related Report
      2004 Annual Research Report
  • [Journal Article] ACTIVE CONSTRUCTION OF 3D MAP IN ROBOT BY COMBINING MOTION AND PERCEIVED IMAGES2004

    • Author(s)
      Tomohiro Nakagawa, Takayuki Okatani, Koichiro Deguchi
    • Journal Title

      Proceedings of Asian Conference on Computer Vision vol.1

      Pages: 563-568

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Binocular motion tracking by gaze fixation control and three-dimensional shape reconstruction2003

    • Author(s)
      Y.Satoh, T.Okatani, K.Deguchi
    • Journal Title

      International Journal of RSJ--Advanced Robotics vol.17, no.10

      Pages: 1057-1073

    • NAID

      10011833840

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Toward a Statistically Optimal Method for Estimating Geometric Relations from Noisy Data : Cases of Linear Relations2003

    • Author(s)
      Takayuki Okatani, Koichiro Deguchi
    • Journal Title

      Proceedings of IEEE Conference on Computer Vision and Pattern Recognition Vol.I

      Pages: 432-439

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Tracking Multiple Three-Dimensional Motions by Using Modified Condensation Algorithm and Multiple Images2003

    • Author(s)
      Koji Hamasaki, Taira Nakajima, Takayuki Okatani, Koichiro Deguchi
    • Journal Title

      Proceedings of IEEE/RSJ IROS 2003 (CD-ROM)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Autocalibration of a Projector-Screen-Camera System : Theory and Algorithm for Screen-to-Camera Homography Estimation2003

    • Author(s)
      T.Okatani, K.Deguchi
    • Journal Title

      Proceedings of International Conference on Computer Vision

      Pages: 774-781

    • NAID

      120002337727

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] A Computation of a Crystalline Flow Starting from Non-admissible Polygon Using Expanding Selfsimilar Solutions2003

    • Author(s)
      H.Hontani, M.H.Giga, Y.Giga, K.Deguchi
    • Journal Title

      11th International Conference of Discrete Geometry for Computer Imagery

      Pages: 465-474

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Construction of 3D Map in Robot by Combining Action and Perceived Images (Invited)2003

    • Author(s)
      K.Deguchi
    • Journal Title

      Proceedings of the Australia-Japan Advanced Workshop on Computer Vision

      Pages: 132-141

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Toward a Statistically Optimal Method for Estimating Geometric Relations from Noisy Data : Cases of Linear Relations2003

    • Author(s)
      Takayuki Okatani, Koichiro Deguchi
    • Journal Title

      Toward a Statistically Optimal Method for Estimating Geometric Relations from Noisy Data : Cases of Linear Relations Vol.I

      Pages: 432-439

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Tracking Multiple Three-Dimensional Motions by Using Modified Condensation Algorithm and Multiple Images2003

    • Author(s)
      Koji Hamasaki, Taira Nakajima, Takayuki Okatani, Koichiro Deguchi
    • Journal Title

      Proceedings of IEEE/RSJ IROS 2003

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] A Computation of a Crystalline Flow Starting from Non-admissible Polygon Using Expanding Selfsimilar Solutions2003

    • Author(s)
      H.Hontani, M.H.Giga, Y.Giga, K.Deguchi
    • Journal Title

      11th International Conference of Discrete Geometry for Computer Imagery (LNCS 2886, Springer)

      Pages: 465-474

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Construction of 3D Map in Robot by Combining Action and Perceived Images (Invited)2003

    • Author(s)
      K.Deguchi
    • Journal Title

      Proceedings of the Australia-Japan Advanced Workshop on Computer Vision 9-11

      Pages: 132-141

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Book] 新編・画像処理ハンドブック2004

    • Author(s)
      出口光一郎(共同執筆)
    • Total Pages
      1991
    • Publisher
      東京大学出版会
    • Related Report
      2004 Annual Research Report
  • [Publications] 川中大樹, 中島平, 岡谷貴之, 出口光一郎: "平均シフト法を用いた複数物体追跡の研究"情報処理学会コンピュータビジョンとイメージメディア研究会. CVIM-138-2. 9-14 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] Y.Satoh, T.Okatani, K.Deguchi: "Binocular motion tracking by gaze fixation control and three-dimenstional shape reconstruction"Intl.J.of RSJ--Advanced Robotics. Vol.17・No.10. 1057-1073 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] Koji Hamasaki, Taira Nakajima, Takayuki Okatani, Koichiro Deguchi: "Tracking Multiple Three-Dimensional Motions by Using Modified Condensation Algorithm and Multiple Images"Proc.IEEE/RSJ IROS 2003. Vol.1. 236-241 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] K.Deguchi: "Construction of 3D Map in Robot by Combining Action and Perceived Images"Proceedings of the Australia-Japan Advanced Workshop on Computer Vision. 132-141 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] Franck Galpin, Koichiro Deguchi, Luce Morin: "Compression Performances of Computer Vision Based Coding"IEICE Transactions on Information and Systems. Vol.E87-D・Num.1. 74-79 (2004)

    • Related Report
      2003 Annual Research Report
  • [Publications] Tomohiro Nakagawa, Takayuki Okatani, Koichiro Deguchi: "ACTIVE CONSTRUCTION OF 3D MAP IN ROBOT BY COMBINING MOTION AND PERCEIVED IMAGES"Proc.ACCV. Vol.1. 563-568 (2004)

    • Related Report
      2003 Annual Research Report

URL: 

Published: 2003-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi