• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Development of Real-time Omnidirectional Stereo Imaging Systems

Research Project

Project/Area Number 09555127
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section展開研究
Research Field 計測・制御工学
Research InstitutionNara Institute of Science and Technology

Principal Investigator

YOKOYA Naokazu  Graduate School of Information Science, Nara Institute of Science and Technology, Professor, 情報科学研究科, 教授 (10252834)

Co-Investigator(Kenkyū-buntansha) YAMAZAWA Kazumasa  Graduate School of Information Science, Nara Institute of Science and Technology, Research Associate, 情報科学研究科, 助手 (40283931)
IWASA Hidehiko  Graduate School of Information Science, Nara Institute of Science and Technology, Research Associate, 情報科学研究科, 助手 (50263447)
TAKEMURA Haruo  Graduate School of Information Science, Nara Institute of Science and Technology, Associate Professor, 情報科学研究科, 助教授 (60263430)
ARAKI Shoichi  Matsushita Electric Industrial Co., Ltd., Senior Researcher, 先端技術研究所, 主任研究員
ETOH Minoru  Matsushita Electric Industrial Co., Ltd., Senior Researcher, 東京通信システム研究所, 主席研究員
栄籐 稔  松下電器産業(株), 東京通信システム研究所, 主席研究員
Project Period (FY) 1997 – 1999
Project Status Completed (Fiscal Year 1999)
Budget Amount *help
¥7,900,000 (Direct Cost: ¥7,900,000)
Fiscal Year 1999: ¥1,200,000 (Direct Cost: ¥1,200,000)
Fiscal Year 1998: ¥2,500,000 (Direct Cost: ¥2,500,000)
Fiscal Year 1997: ¥4,200,000 (Direct Cost: ¥4,200,000)
KeywordsOmnidirectional Image Sensor / Omnidirectional Image / Cylindrical Panoramic Image / Telepresence / Virtual Reality / Computer Vision / Real-time Systems / Immersive Visual Environment
Research Abstract

We have obtained the following research results in this project.
1.Development of Omnidirectional Stereo Imaging Sensors.
We have developed two types of omnidirectional stereo imaging sensors. The first one is based on using a composite mirror of two hyperboloidal mirrors and a standard video camera. It has been concluded that this sensor suffers from low resolution of images and thus requires high-resolution video cameras for practical applications. The second from sensor is developed for overcoming the low-resolution problem in the first sensor. It consists of symmetrically aligned two components, each of which is constructed of a hexagonal pyramidal mirror and six video cameras.
2.Real-time Generation of Perspective and Panoramic Images from an Omnidirectional Image
Perspective and panoramic images can be computed from an omnidirectional image because our sensor components satisfy the single viewpoint constraint. In order to execute the geometric transformation from omnidirectional imag … More es to perspective and/or cylindrical panoramic images in real time, we have developed a novel algorithm which integrates coordinate transformation by software and image warping by hardware. The proposed algorithm is used for realizing two types of telepresence systems ; one uses a head-mounted display (HMD) and the other is based on a large cylindrical screen and projectors.
3.Efficient Coding of Dynamic Omnidirectional and Panoramic Images
We have developed a method for estimating structure and motion from omnidirectional image sequences as well as a method for generating novel views from a sequence of omnidirectional images obtained from a moving omnidirectional sensor.
4.Acquisition of 3D Information from Omnidirectional Stereo Images
Omnidirectional images obtained by our sensors have vertical disparities. In order to generate standard binocular stereo images with horizontal disparities, a correlation-based stereo matching algorithm is applied to omnidirectional stereo images. This may be referred to as omnidirectional stereo. Less

Report

(4 results)
  • 1999 Annual Research Report   Final Research Report Summary
  • 1998 Annual Research Report
  • 1997 Annual Research Report
  • Research Products

    (51 results)

All Other

All Publications (51 results)

  • [Publications] 茶園 篤: "全方位ステレオ視による3次元情報の獲得"映像情報メディア学会誌. 51・10. 1745-1753 (1997)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] 尾上 良雄: "全方位画像センサを用いた実時間テレプレゼンスと画像表示遅延に関する実験的評価"情報処理学会研究報告. 97・79. 49-54 (1997)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] 川西 隆仁: "六角錐ミラーを用いた全方位ステレオ画像センサによる高解像度ステレオパノラマ動画像の作成"電子情報通信学会技術研究報告. 97・324. 51-58 (1997)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] 山澤 一誠: "全方位画像からの視線追従型実時間画像生成によるテレプレゼンス"電子情報通信学会論文誌(D-II). J81-D-II・5. 880-887 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] 横矢 直和: "全方位画像センサによる情景の映像アーカイビング"3次元画像コンファレンス'98講演論文集. 64-69 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] 川西 隆仁: "六角錐ミラーを用いた全方位画像センサによる全周ステレオパノラマ動画像の作成"画像の認識・理解シンポジウム(MIRU'98)講演論文集. I・. 177-182 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Minoru Etoh: "Promotion of block matching : Parametric representation for motion estimation"Proc. 14th IAPR Int. Conf. on Pattern Recognition. I・. 282-285 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Takahito Kawanishi: "Generation of high-resolution stereo panoramic images by omnidirectional imaging sensor using hexagonal pyramidal mirrors"Proc. 14th IAPR Int. Conf. on Pattern Recognition. I・. 485-489 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Yoshio Onoe: "Visual surveillance and monitoring system using an omnidirectional video camera"Proc. 14th IAPR Int. Conf. on Pattern Recognition. I・. 588-592 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Shoichi Araki: "Real-time tracking of multiple moving objects in moving camera image sequences using robust statistics"Proc. 14th IAPR Int. Conf. on Pattern Recognition. II・. 1433-1435 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Nobuhiro Aihara: "Memory-based self-localization suing omnidirectional images"Proc. 14th IAPR Int. Conf. on Pattern Recognition. II・. 1799-1803 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Yoshio Onoe: "Telepresence by real-time view-dependent image generation from omnidirectional video streams"Computer Vision and Image Understanding. 71・2. 154-165 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Minoru Etoh: "Estimation of structure and motion parameters for a roaming robot that scans the space"Proc. 7th Int. Conf. on Computer Vision. I・. 579-584 (1999)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] 横矢 直和: "全方位ビデオカメラを用いた広域屋外環境の仮想化"情報処理学会研究報告. 99・93. 109-116 (1999)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] 山口 晃一郎: "全方位動画像を用いた任意方向両眼ステレオ画像の実時間生成と提示"電子情報通信学会技術研究報告. 99・450. 67-72 (1999)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Kazumasa Yamazawa: "Virtual tours into a visualized dynamic real world using an omnidirectional video camera"Proc. 4th Asian Conf. on Computer Vision. I・. 5-10 (2000)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Ryutaro Miki: "A real-time video surveillance and monitoring system using multiple omnidirectional video cameras"Proc. 4th Asian Conf. on Computer Vision. I・. 528-534 (2000)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] 横矢 直和: "3Dパノラマ画像合成技術"映像情報メディア学会誌. 54・3. (2000)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Atsushi Chaen: "Acquisition of Three-dimensional Information by Omnidirectional Stereo Vision"Journal of ITE. 51・10. 1745-1753 (1997)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Yoshio Onoe: "Real-time Telepresence System Using an Omnidirectional Image Sensor and Experimental Analysis of Time Delay"Technical Report of IPSJ. 97・79. 49-54 (1997)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Takahito Kawanishi: "Generation of High-resolution Stereo Panoramic Images by Omnidirectional Imaging Sensor Using Hexagonal Pyramidal Mirrors"Technical Report of IEICE. 97・324. 51-58 (1997)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Kazumasa Yamazawa: "Telepresence by Real-time View-dependent Image Generation from Omnidirectional Images"Trans. of IEICE (D-II). J81-D-II・5. 880-887 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Naokazu Yokoya: "Visual Archiving of Real-world Dynamic Scenes Using Omnidirectional Image Sensors"Proc. 3D Image Conference '98. 64-69 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Takahito Kawanishi: "Generation of High-resolution Stereo Panoramic Images by Omnidirectional Imaging Sensor Using Hexagonal Pyramidal Mirrors"Proc. Meeting on Image Recognition and Understanding. I. 177-182 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Minoru Etoh: "Promotion of Block Matching : Parametric Representation for Motion Estimation"Proc. 14th IAPR Int. Conf. on Pattern Recognition. I. 282-285 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Takahito Kawanishi: "Generation of High-resolution Stereo Panoramic Images by Omnidirectional Imaging Sensor Using Hexagonal Pyramidal Mirrors"Proc. 14th IAPR Int. Conf. on Pattern Recognition. I. 485-489 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Yoshio Onoe: "Visual Surveillance and Monitoring System Using an Omnidirectional Video Camera"Proc. 14th IAPR Int. Conf. on Pattern Recognition. I. 588-592 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Shoichi Araki: "Real-time Tracking of Multiple Moving Objects in Moving Camera Image Sequences Using Robust Statistics"Proc. 14th IAPR Int. Conf. on Pattern Recognition. II. 1433-1435 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Nobuhiro Aihara: "Memory-based Self-localization Using Omnidirectional Images"Proc. 14th IAPR Int. Conf. on Pattern Recognition. II. 1799-1803 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Yoshio Onoe: "Telepresence by Real-time View-dependent Image Generation from Omnidirectional Video Streams"Computer Vision and Image Understanding. 71・2. 154-165 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Minoru Etoh: "Estimation of Structure and Motion Parameters for a Roaming Robot That Scans the Space"Proc. 7th Int. Conf. on Computer Vision. I. 579-584 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Naokazu Yokoya: "Virtualizing Outdoor Dynamic Real Environments Using Omnidirectional Video Cameras"Technical Report of IPSJ. 99・93. 109-116 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Koichiro Yamaguchi: "Realtime Generation and Presentation of Arbitrarily Directional Binocular Stereo Images Using a Sequence of Omnidirectional Images"Technical Report of IEICE. 99・450. 67-72 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Kazumasa Yamazawa: "Virtual Tours into a Visualized Dynamic Real World Using an Omnidirectional Video Camera"Proc. 4th Asian Conf. on Computer Vision. I. 5-10 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Ryutaro Miki: "A Real-time Video Surveillance and Monitoring System Using Multiple Omnidirectional Video Cameras"Proc. 4th Asian Conf. on Computer Vision. I. 528-534 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Naokazu Yokoya: "Acquiring 3D Panoramic Images of Real Scenes"Journal of ITE. 54・3, (to appear). (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Minoru Etoh: "Estimation of structure and motion parameters for a raming robot that scans the space"Proc.7th Int.Conf.on Computer Vision. I.. 579-584 (1999)

    • Related Report
      1999 Annual Research Report
  • [Publications] 横矢直和: "全方位ビデオカメラを用いた広域屋外環境の仮想化"情報処理学会研究報告. 99.93. 109-116 (1999)

    • Related Report
      1999 Annual Research Report
  • [Publications] 山口晃一郎: "全方位画像を用いた任意方向両眼ステレオ画像の実時間生成と提示"電子情報通信学会技術研究報告. 99.450. 67-72 (1999)

    • Related Report
      1999 Annual Research Report
  • [Publications] Kazumasa Yamazawa: "Virtual tours into a visualized dynamic rela word using an omnidirectional video camera"Proc.4th Asian Conf.on Computer Vision. I.. 5-10 (2000)

    • Related Report
      1999 Annual Research Report
  • [Publications] Ryutaro Miki: "A real-time video surveillance and monitoring system using multiple omnidirectional video cameras"Proc.4th Asian Conf.on Computer Vision. I.. 528-534 (2000)

    • Related Report
      1999 Annual Research Report
  • [Publications] 横矢直和: "3Dパノラマ画像合成技術"映像情報メディア学会誌. 54・3. (2000)

    • Related Report
      1999 Annual Research Report
  • [Publications] 山澤 一誠: "全方位画像からの視線追従型実時間画像生成によるテレプレゼンス" 電子情報通信学会論文誌(D-II). J81-D-II・5. 880-887 (1998)

    • Related Report
      1998 Annual Research Report
  • [Publications] 川西 隆仁: "六角錐ミラーを用いた全方位画像センサによる全周ステレオパノラマ動画像の作成" 画像の認識・理解シンポジウム(MIRU'98)講演論文集. I・. 177-182 (1998)

    • Related Report
      1998 Annual Research Report
  • [Publications] Minoru Etoh: "Promotion of block matching: Parametric representation for motion estimation" Proc.14th IAPR Int.Conf.on Pattern Recognition. I・. 282-285 (1998)

    • Related Report
      1998 Annual Research Report
  • [Publications] Takahito Kawanishi: "Generation of high-resolution stereo panoramic images by omnidirectional imaging sensor using hexagonal pyramidal mirrors" Proc.14th IAPR Int.Conf.on Pattern Recognition. I・. 485-489 (1998)

    • Related Report
      1998 Annual Research Report
  • [Publications] Yoshio Onoe: "Visual surveillance and monitoring system using an omnidirectional video camera" Proc.14th IAPR Int.Conf.on Pattern Recognition. I・. 588-592 (1998)

    • Related Report
      1998 Annual Research Report
  • [Publications] Yoshio Onoe: "Telepresence by real-time view-dependent image generation from omnidirectional video streams" Computer Vision and Image Understanding. 71.2. 154-165 (1998)

    • Related Report
      1998 Annual Research Report
  • [Publications] 尾上 良雄: "全方位画像センサを用いた実時間テレプレゼンスと画像表示遅延に関する実験的評価" 情報処理学会研究報告(情処研報). 97・79. 49-54 (1997)

    • Related Report
      1997 Annual Research Report
  • [Publications] 川西 隆仁: "六角錐ミラーを用いた全方位ステレオ画像センサによる高解像度ステレオパノラマ画像の作成" 電子情報通信学会技術研究報告(信学技報). 97・324. 51-58 (1997)

    • Related Report
      1997 Annual Research Report
  • [Publications] 山澤 一誠: "全方位画像からの視線追従型実時間画像生成によるテレプレゼンス" 電子情報通信学会論文誌(D-II). J81-D-II・5. (1998)

    • Related Report
      1997 Annual Research Report

URL: 

Published: 1997-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi