• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Merging Real and Virtual Worlds Considering Depth Information

Research Project

Project/Area Number 09480068
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Intelligent informatics
Research InstitutionNara Institute of Science and Technology

Principal Investigator

YOKOYA Naokazu  Graduate School of Information Science, Nara Institute of Science and Technology, Professor, 情報科学研究科, 教授 (10252834)

Co-Investigator(Kenkyū-buntansha) YAMAZAWA Kazumasa  Graduate School of Information Science, Nara Institute of Science and Technology, Research Associate, 情報科学研究科, 助手 (40283931)
IWASA Hidehiko  Graduate School of Information Science, Nara Institute of Science and Technology, Research Associate, 情報科学研究科, 助手 (50263447)
TAKEMURA Haruo  Graduate School of Information Science, Nara Institute of Science and Technology, Associate Professor, 情報科学研究科, 助教授 (60263430)
KIYOKAWA Kiyoshi  Communications Research Laboratory, Nara Institute of Science and Technology, Researcher, 通信システム部, 研究員
Project Period (FY) 1997 – 1999
Project Status Completed (Fiscal Year 1999)
Budget Amount *help
¥5,500,000 (Direct Cost: ¥5,500,000)
Fiscal Year 1999: ¥1,500,000 (Direct Cost: ¥1,500,000)
Fiscal Year 1998: ¥1,700,000 (Direct Cost: ¥1,700,000)
Fiscal Year 1997: ¥2,300,000 (Direct Cost: ¥2,300,000)
KeywordsMixed Reality / Fusion of Real and Virtual / Geometric Registration / Binocular Stereo / Motion Stereo / 3D Structure Reconstruction / Immersive Modeler / Video See-through Augmented Reality / ビデオシースルー複合現実
Research Abstract

We have obtained the following research results in this project.
1.Acquiring 3D Information of a Real Scene by Binocular Stereo
One of the most important problems in augmented reality is to resolve occlusions between real and virtual objects. The problem requires depth information of a real world scene. We have studied on improving the efficiency of stereo matching. Our idea for improving the efficiency is to limit stereo matching areas to those on which virtual objects are merged. This made it possible to estimate depth of real world in real time.
2.Acquiring 3D Information of a Real Scene by Motion Stereo
A new factorization method was developed for estimating 3D structure of a real scene from a sequence of images obtained by a moving camera. Another attempt is to predict apparent motion in dynamic images, which improves the efficiency of stereo matching.
3.Generation of Virtual Objects by Immersive Modeler
We have extended the immersive solid modeler VLEGO for generating virtual objects in natural and simple way. Also developed is a technique for imposing geometric constraints on virtual objects. This made it possible to create articulated objects and to generate animations.
4.Merging Virtual Objects into a Real World Scene Image with Correct Occlusion
Geometric registration between real and virtual worlds was achieved by tracking markers in captured images. This may be called a vision-based registration. Integrating this result with those in above items, we have developed an efficient method of stereo image composition.
5.Development of Prototype System for Merging Real and Virtual
We have developed a prototype of stereoscopic video see-through HMD which can merge real and virtual objects with correct occlusion in real time. Experiments have shown the feasibility of the prototype systems. The displayed image of merging real and virtual is updated every 100ms.

Report

(4 results)
  • 1999 Annual Research Report   Final Research Report Summary
  • 1998 Annual Research Report
  • 1997 Annual Research Report
  • Research Products

    (54 results)

All Other

All Publications (54 results)

  • [Publications] 清川 清: "複数仮想物体の協調接合操作における一操作補助手法"映像情報メディア学会誌. 51・7. 1079-1085 (1997)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] 大隈 隆史: "ビデオシースルー型拡張現実のための実画像からのカメラパラメータの実時間推定"電子情報通信学会技術研究報告. 97・324. 13-20 (1997)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Norikazu Hiraki: "Imposing geometric constraints on virtual objects within an immersive modeler"Proc. 7th Int. Conf. on Artificial Reality and Tele-Existence. 178-183 (1997)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Atsushi Chaen: "Acquisition of three-dimensional information using omnidirectional stereo vision"Proc. 3rd Asian Conf. on Computer Vision. I・. 288-295 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] 横矢 直和: "全方位ステレオ視による3次元情報の獲得"画像ラボ. 9・6. 15-19 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] 神原 誠之: "複合現実感のための実時間ステレオ画像合成"映像情報メディア学会技術報告. 22・33. 31-36 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Kuo-Chang Hwang: "A factorization method using 3-D linear combination for shape and motion recovery"Proc. 14th IAPR Int. Conf. on Pattern Recognition. II・. 959-963 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Takashi Okuma: "An Augmented reality system using real-time vision based registration"Proc. 14th IAPR Int. Conf. on Pattern Recognition. II・. 1226-1229 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] 神原 誠之: "ビデオシースルー型拡張現実感のためのステレオ画像合成"電子情報情報通信学会技術研究報告.

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Naokazu Yokoya: "Passive range sensing techniques : Depth from images"IEICE Trans. Information and Systems. E85-D・3. 523-533 (1999)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Naokazu Yokoya: "Stereo vision based video see-through mixed reality"Proc. 1st Int. Sympo. on Mixed Reality. 131-145 (1999)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Masayuki Kanbara: "Real-time composition of stereo images for video see-through augmented reality"Proc. 6th IEEE Int. Conf. on Multimedia Computing and Systems. 1・. 213-219 (1999)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] 神原 誠之: "ビデオシースルー型拡張現実感のための実時間ステレオ画像合成"電子情報通信学会論文誌(D-II). J-82-D-II・10. 1775-1783 (1999)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] 大隈 隆史: "拡張現実感システムのための画像からの実時間カメラ位置姿勢推定"電子情報通信学会論文誌(D-II). J-82-D-II・10. 1784-1792 (1999)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] 藤井 博文: "ジャイロセンサを用いたビジョンベースアRのためのマーカ追跡手法"電子情報情報通信学会技術研究報告. 99・488. 31-36 (1999)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] 藤井 博文: "拡張現実のためのジャイロセンサを併用したステレオカメラによる位置合わせ"電子情報情報通信学会技術研究報告. 99・574. 1-8 (2000)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] 神原 誠之: "マーカ切替え追跡による広範囲見回し可能なビデオシースルー型拡張現実感"電子情報情報通信学会技術研究報告. 99・574. 51-56 (2000)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Masayuki Kanbara: "A stereoscopic video see-through augmented reality system based on vision base registration"Proc. IEEE Virtual Reality 2000. (2000)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Kiyoshi Kiyokawa: "Manipulation Aid for Assembling Multiple Virtual Objects"Journal of ITE. 51・7. 1079-1085 (1997)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Takashi Okuma: "Real-time Estimation of Camera Parameters for Video See-through Augmented Reality"Technical Report of IEICE. 97・324. 13-20 (1997)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Norikazu Hiraki: "Imposing Geometric Constraints on Virtual Objects within an Immersive Modeler"Proc. 7th Int. Conf. on Artificial Reality and Tele-existence. 178-183 (1997)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Atsushi Chaen: "Acquisition of Three-dimensional Information Using Omnidirectional Stereo Vision"Proc. 3rd Asian Conf. on Computer Vision. I. 288-295 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Naokazu Yokoya: "Acquisition of Three-dimensional Information by Omnidirectional Stereo"Gazo Lab. 9・6. 15-19 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Masayuki Kanbara: "Real-time Composition of Stereo Images for Mixed Reality"Technical Report of ITE. 22・23. 31-36 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Kuo-Chang Hwang: "A Factorization Method Using 3-D Linear Combination for Shape and Motion Recovery"Proc. 14th IAPR Int. Conf. on Pattern Recognition. II. 959-963 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Takashi Okuma: "An Augmented Reality System Using Real-time Vision Based Registration"Proc. 14th IAPR Int. Conf. on Pattern Recognition. II. 1226-1229 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Masayuki Kanbara: "Composition of Stereo Images for Video See-through Augmented Reality"Technical Report of IEICE. 98・677. 33-40 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Naokazu Yokoya: "Stereo Vision Based Video See-through Mixed Reality"Proc 1st Int. Sympo. on Mixed Reality. 131-145 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Naokazu Yokoya: "Passive Range Sensing Techniques : Depth from Images"IEICE Trans. on Information and Systems. E82-D・3. 523-533 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Masayuki Kanbara: "Real-time Composition of Stereo Images for Video See-through Augmented Reality"Proc. 6th IEEE Int. Conf. on Multi-media Computing and Systems. 1. 213-219 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Masayuki Kanbara: "Real-time Composition of Stereo Images for Video See-through Augmented Reality"Trans. of IEICE (D-II). J82-D-II・10. 1775-1783 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Takashi Okuma: "Real-time Camera Parameter Estimation from Images for an Augmented Reality System"Trans. of IEICE (D-II). J82-D-II・10. 1784-1792 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Hirofumi Fujii: "A Registration Method with Inertial Sensor for Vision-based Augmented Reality"Technical Report of IEICE. 99・488. 31-36 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Hirofumi Fujii: "A Registration Method Using Stereo Cameras with an Inertial Sensor for Augmented Reality"Technical Report of IEICE. 99・574. 1-8 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Masayuki Kanbara: "Development of a Video See-through Augmented Reality System with a Wide Range of Registration by Switching Tracked Markers"Technical Report of IEICE. 99・574. 51-56 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Masayuki Kanbara: "A Stereoscopic Video See-through Augmented Reality System Based on Vision-based Registration"Proc. IEEE Virtual Reality 2000. (to appear). (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Masayuki Kanbara: "Real-time composition of stereo images for video see-through augmented reality"Proc.6th IEEE Int.Conf.on Multimedia Computing and Systems. 1. 213-219 (1999)

    • Related Report
      1999 Annual Research Report
  • [Publications] 神原誠之: "ビデオシースルー型拡張現実感のための実時間ステレオ画像合成"電子情報通信学会(D-II). J-82D-II・10. 1775-1783 (1999)

    • Related Report
      1999 Annual Research Report
  • [Publications] 大隈隆史: "拡張現実感システムのための画像からの実時間カメラ位置姿勢推定"電子情報通信学会(D-II). J-82D-II・10. 1784-1792 (1999)

    • Related Report
      1999 Annual Research Report
  • [Publications] 藤井博文: "ジャイロセンサを用いたビジョンベースARのためのマーカ追跡手法"電子情報通信通信学会技術研究報告. 99・488. 31-36 (1999)

    • Related Report
      1999 Annual Research Report
  • [Publications] 神原誠之: "マーカ切替え追跡による広範囲見回し可能なビデオシースルー型拡張実感"電子情報情報通信学会技術研究報告. 99・574. 51-56 (2000)

    • Related Report
      1999 Annual Research Report
  • [Publications] Masayuki Kanbara: "A steroscopic video see-through augmented reality system based on vision-based registration"Proc.IEEE Virtual Reality 2000. (2000)

    • Related Report
      1999 Annual Research Report
  • [Publications] 神原 誠之: "複合現実感のための実時間ステレオ画像合成" 映像情報メディア学会技術報告. 22・33. 31-36 (1998)

    • Related Report
      1998 Annual Research Report
  • [Publications] Kuo-Chang Hwang: "A factorization method using 3-D linear combination for shape and motion recovery" Proc.14th IAPR Int.Conf.on Pattern Recognition. II・. 959-963 (1998)

    • Related Report
      1998 Annual Research Report
  • [Publications] Takashi Okuma: "An augmented reality system using real-time vision based registration" Proc.14th IAPR Int.Conf.on Pattern Recognition. II・. 1226-1229 (1998)

    • Related Report
      1998 Annual Research Report
  • [Publications] 神原 誠之: "ビデオシースルー型拡張現実感のためのステレオ画像合成" 電子情報情報通信学会技術研究報告. 98・. (1999)

    • Related Report
      1998 Annual Research Report
  • [Publications] Naokazu Yokoya: "Passive range sensing techniques: Depth from images" IEICE Trans.on Information and Systems. E82-D・3. (1999)

    • Related Report
      1998 Annual Research Report
  • [Publications] Masayuki Kanbara: "Real-time composition of stereo images for video see-through augmented reality" Proc.6th IEEE Int.Conf.on Multimedia Computing and Systems. (1999)

    • Related Report
      1998 Annual Research Report
  • [Publications] Yuichi Ohta: "Mixed Reality-Merging Real and Virtual Worlds-" Ohmsha-Springer Verlag, 418 (1999)

    • Related Report
      1998 Annual Research Report
  • [Publications] 清川 清: "複数仮想物体の協調接合操作における一操作補助手法" 映像情報メディア学会誌. 51・7. 1079-1085 (1997)

    • Related Report
      1997 Annual Research Report
  • [Publications] 茶園 篤: "全方位ステレオ視による3次元情報の獲得" 映像情報メディア学会誌. 51・10. 1745-1753 (1997)

    • Related Report
      1997 Annual Research Report
  • [Publications] 大隅 隆史: "ビデオシースルー型拡張現実のためのカメラパラメータの実時間推定" 電子情報通信学会技術研究報告(信学技報). 97・324. 13-20 (1997)

    • Related Report
      1997 Annual Research Report
  • [Publications] Norikazu Hiraki: "Imposing geometric constraints on virtual objects within an immersive modeler" Proc.7th Int.Conf.on Artificial Reality and Tele-Existence (ICAT'97). 178-183 (1997)

    • Related Report
      1997 Annual Research Report
  • [Publications] Atsushi Chaen: "Acquisition of three-dimensional information using omnidirectional stereo vision" Proc.3rd Asian Conf.on Computer Vision (ACCV'98). 288-295 (1998)

    • Related Report
      1997 Annual Research Report

URL: 

Published: 1997-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi