• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to project page

2006 Fiscal Year Final Research Report Summary

3D Modeling of Outdoor Environments by Integrating Multiple Sensor Information

Research Project

Project/Area Number 16300057
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Perception information processing/Intelligent robotics
Research InstitutionNARA INSTITUTE OF SCIENCE AND TECHNOLOGY

Principal Investigator

YOKOYA Naokazu  Nara Institute of Science and Technology, Graduate School of Information Science, Professor, 情報科学研究科, 教授 (10252834)

Co-Investigator(Kenkyū-buntansha) YAMAZAWA Kazumasa  Nara Institute of Science and Technology, Graduate School of Information Science, Associate Professor, 情報科学研究科, 助教授 (40283931)
KANBARA Masayuki  Nara Institute of Science and Technology, Graduate School of Information Science, Assistant Professor, 情報科学研究科, 助手 (10346306)
SATO Tomokazu  Nara Institute of Science and Technology, Graduate School of Information Science, Assistant Professor, 情報科学研究科, 助手 (50362835)
Project Period (FY) 2004 – 2006
KeywordsComputer Vision / Mixed Reality / 3D Modeling / 3D Environment Model / 3D Reconstruction / Multiple Sensor Fusion / Registration of Multiple Range Data / Digital Archive
Research Abstract

We have obtained the following research results in this project.
1. 3D Reconstruction from Omnidirectional Videos Captured from the Ground
The objective is to reconstruct outdoor scenes using a shape-from-motion technique from omnidirectional video streams obtained by using the omnidirectional multi-camera system Ladybug. First, we have developed an algorithm for estimating extrinsic camera parameters from omnidirectional videos obtained by using a moving camera system. We have then developed a new multi-baseline stereo algorithm, which is based on counting interest points, for computing a dense depth map. These algorithms have been successfully demonstrated with experiments in real outdoor environments.
2. 3D Reconstruction from HD Videos Captured from the Sky
We have developed a method for acquiring 3D surface data from video streams obtained by using a helicopter. The method here is based on the algorithm mentioned above. The shape-from-motion technique and the multi-baseline stereo alg … More orithm are applied to HD video streams for obtaining a dense depth map from the sky.
3. Accurate 3D Measurement Using Laser Rangefinder
The objective is to acquire a textured 3D environment model by accurate 3D measurement using a laser rangefinder. First, we have developed an algorithm for simultaneous registration of multiple range data obtained at different locations and also have developed a method for selecting textures from multiple omnidirectional images. We have then developed a view planning method for efficiently scanning a wide area sequentially. These algorithms and methods have been successfully experimented in our campus.
4. Construction of Textured 3D Scene Model by Integrating Heterogeneous 3D Data
We have developed a 3D active contour model for integrating heterogeneous 3D data obtained above into a unified voxel model representation. This results in the construction of textured 3D outdoor scene models. Experiments have been carried out with an outdoor environment of our campus. Less

  • Research Products

    (58 results)

All 2007 2006 2005 2004

All Journal Article (57 results) Book (1 results)

  • [Journal Article] View planning for wide-area outdoor modeling based on measurement density of objects2007

    • Author(s)
      Toshihiro Asai
    • Journal Title

      Proc. SPIE, Vol. 6491, Video Metrics IX

      Pages: 64910H-1-64910H-8

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] 被写体距離を考慮したImage-Based Renderingによる広域屋外環境のステレオ画像生成2007

    • Author(s)
      堀 磨伊也
    • Journal Title

      電子情報通信学会技術研究報告 106・469

      Pages: 7-12

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] Novel stereoscopic view generation by image-based rendering coordinated with depth information2007

    • Author(s)
      Maiya Hori
    • Journal Title

      Proc. 15th Scandinavian Conf. on Image Analysis (SCIA2007) (印刷中)

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] View planning for wide-area outdoor : modeling based on measurement density of objects2007

    • Author(s)
      Toshihiro Asai
    • Journal Title

      Proc. SPIE Vol.6491, Video Metrics IX, 64910H-1-64910H-8

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] Novel stereoscopic view generation b : image-based rendering coordinated with depth information2007

    • Author(s)
      Maiya Hori
    • Journal Title

      Technical Report of IEICE 106・469

      Pages: 7-12

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] Novel stereoscopic view generation b : image-based rendering coordinated with depth information2007

    • Author(s)
      Maiya Hori
    • Journal Title

      Proc. 15th Scandinavian Conf. on Image Analysis (SCIA2007) (to appear)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] Extrinsic camera parameter estimation based on feature tracking and GPS data2006

    • Author(s)
      Yuji Yokochi
    • Journal Title

      Proc. 7th Asian Conf. on Computer Vision (ACCV2006)

      Pages: 369-378

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] 現実世界と仮想世界を融合する複合現実感技術-II-仮想化現実の方法論2006

    • Author(s)
      横矢 直和
    • Journal Title

      システム/制御/情報 50・2

      Pages: 68-73

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] 複合現実感のための実環境の3次元計測2006

    • Author(s)
      横矢 直和
    • Journal Title

      映像情報インダストリアル 38・2

      Pages: 67-71

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] 特徴点追跡とGPS測位に基づくカメラ外部パラメータの推定2006

    • Author(s)
      横地 裕次
    • Journal Title

      情報処理学会論文誌 : コンピュータビジョンとイメージメディア 47・SIG5(CVIM13)

      Pages: 69-79

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] 現実世界と仮想世界を融合する複合現実感技術-III-仮想化現実の具体例2006

    • Author(s)
      横矢 直和
    • Journal Title

      システム/制御/情報 50・4

      Pages: 162-167

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] 画像処理、コンピュータビジョン、そして複合現実感2006

    • Author(s)
      横矢 直和
    • Journal Title

      電子情報通信学会技術研究報告 106・73

      Pages: 71-74

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] 物体の存在確率を持つボクセルモデルを用いたデータ取得率マップによるビュープランニング2006

    • Author(s)
      浅井 俊弘
    • Journal Title

      画像の認識・理解シンポジウム(MIRU2006)講演論文集 (CD-ROM)

      Pages: 589-594

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] 全方位センサを用いた広域都市環境の仮想化-レーザレンジファインダと全方位カメラによる屋外環境のモデル化-2006

    • Author(s)
      浅井 俊弘
    • Journal Title

      画像ラボ 17・8

      Pages: 47-51

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] Camera recovery of an omnidirectional multi-camera system using GPS positions2006

    • Author(s)
      Sei Ikeda
    • Journal Title

      Proc. 1st Korea-Japan Joint Workshop on Pattern Recognition

      Pages: 91-96

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] Mixed reality : Merging real and virtual worlds-II Methodology for augmented virtuality2006

    • Author(s)
      Naokazu Yokoya
    • Journal Title

      Systems, Control and Information 50・2

      Pages: 68-73

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] 3D measurement of real environments for mixed reality2006

    • Author(s)
      Naokazu Yokoya
    • Journal Title

      Eizojoho Industrial 38・2

      Pages: 67-71

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] Estimation of extrinsic camera parameters based on feature tracking and GPS data2006

    • Author(s)
      Yuji Yokochi
    • Journal Title

      IPSJ Trans, on Computer Vision and Image Media 47・ SIG5(CVIM13)

      Pages: 69-79

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] Mixed reality : Merging real and virtual worlds-III Examples of augmented virtuality2006

    • Author(s)
      Naokazu Yokoya
    • Journal Title

      Systems, Control and Information 50・4

      Pages: 162-167

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] View planning with recommendation rate map generated by voxel voxel model which has existence probability of objects2006

    • Author(s)
      Toshihiro Asai
    • Journal Title

      Proc. Meeting on Image Recognition and Understanding (MIRU2006) (CD-ROM)

      Pages: 589-594

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] Virtualizing wide-area urban environment : using omnidirectional sensors - Modeling of outdoor environments by rangefinder and omnidirectional camera -2006

    • Author(s)
      Toshihiro Asai
    • Journal Title

      Gazo Lab 17・8

      Pages: 47-51

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] 3D reconstruction of outdoor environments from omnidirectional range and color images2005

    • Author(s)
      Toshihiro Asai
    • Journal Title

      Proc. SPIE, Vol. 5664, Stereoscopic Displays and Virtual Reality Systems XII

      Pages: 579-588

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] 動画像とGPSによるハイブリッドなカメラ位置・姿勢推定法2005

    • Author(s)
      横地 裕次
    • Journal Title

      情報処理学会研究報告 2005・4

      Pages: 91-98

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] 複数動画像からの全方位型マルチカメラシステムの位置・姿勢パラメータの推定2005

    • Author(s)
      佐藤 智和
    • Journal Title

      電子情報通信学会論文誌 (D-II) J88-D-II・2

      Pages: 347-357

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] 画像特徴点の数え上げに基づくマルチベースラインステレオ法2005

    • Author(s)
      佐藤 智和
    • Journal Title

      情報処理学会研究報告 2005・18

      Pages: 153-160

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] New multi-baseline stereo by counting interest points2005

    • Author(s)
      Tomokazu Sato
    • Journal Title

      Proc. 2nd Canadian Conf. on Computer and Robot Vision (CRV2005)

      Pages: 96-103

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] 3D modeling of outdoor environments by integrating omnidirectional range and color images2005

    • Author(s)
      Toshihiro Asai
    • Journal Title

      Proc. 5th Int. Conf. on 3-D Digital Imaging and Modeling (3DIM2005)

      Pages: 447-454

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] 画像特徴点の数え上げによるマルチベースラインステレオ法2005

    • Author(s)
      佐藤 智和
    • Journal Title

      画像の認識・理解シンポジウム (MIRU2005) 講演論文集 (CD-ROM)

      Pages: 189-196

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] 動画像とGPSによる位置情報を用いたカメラ外部パラメータの推定2005

    • Author(s)
      横地 裕次
    • Journal Title

      画像の認識・理解シンポジウム (MIRU2005) 講演論文集 (CD-ROM)

      Pages: 650-657

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] レンジファインダの定地点計測と移動計測の統合による屋外環境の三次元モデル化2005

    • Author(s)
      浅井 俊弘
    • Journal Title

      画像の認識・理解シンポジウム (MIRU2005) 講演論文集 (CD-ROM)

      Pages: 808-813

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] 3D modeling of outdoor scenes by integrating stop-and-go and continuous scanning of rangefinder2005

    • Author(s)
      Toshihiro Asai
    • Journal Title

      Proc. Int. Conf. on 3D Virtual Reconstruction and Visualization of Complex Architectures (3D-Arch2005) (CD-ROM)

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] 全方位レンジデータと全方位画像の統合による屋外環境の三次元モデル化2005

    • Author(s)
      浅井 俊弘
    • Journal Title

      画像電子学会誌 34・5

      Pages: 529-538

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] Omni-directional multi-baseline stereo without similarity measures2005

    • Author(s)
      Tomokazu Sato
    • Journal Title

      Proc. 6th Int. Workshop on Omnidirectional Vision, Camera Networks and Non-classical Cameras (OMNIVIS2005) (CD-ROM)

      Pages: 193-200

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] 現実世界と仮想世界を融合する複合現実感技術-I-複合現実感とは2005

    • Author(s)
      横矢 直和
    • Journal Title

      システム/制御/情報 49・12

      Pages: 489-494

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] 複合現実感のための実環境の3次元計測2005

    • Author(s)
      横矢 直和
    • Journal Title

      ビジョン技術の実利用ワークショップ(ViEW2005)講演論文集

      Pages: 186-190

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] 3D reconstruction of outdoor environments from omnidirectional range and color images2005

    • Author(s)
      Toshihiro Asai
    • Journal Title

      Proc. SPIE Vol.5664, Stereoscopic Displays and Virtual Reality Systems XII

      Pages: 579-588

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] A hybrid method for estimating extrinsic camera parameters using a video camera and a GPS2005

    • Author(s)
      Yuji Yokochi
    • Journal Title

      IPSJ SIG Technical Reports 2005・4

      Pages: 91-98

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] Determining extrinsic camera parameters of an omni-directional multi-camera system from multiple video streams2005

    • Author(s)
      Tomokazu Sato
    • Journal Title

      Trans. of IEICE(D-II) J88-D-II・2

      Pages: 347-357

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] Multi-baseline stereo by counting interest points2005

    • Author(s)
      Tomokazu Sato
    • Journal Title

      IPSJ SIG Technical Reports 2005・18

      Pages: 153-160

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] Multi-baseline stereo by counting feature points2005

    • Author(s)
      Tomokazu Sato
    • Journal Title

      Proc. Meeting on Image Recognition and Understanding (MIRU2005) (CD-ROM)

      Pages: 189-196

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] Extrinsic camera parameter estimation using an image sequence and position data acquired by GPS2005

    • Author(s)
      Yuji Yokochi
    • Journal Title

      Proc. Meeting on Image Recognition and Understanding (MIRU2005) (CD-ROM)

      Pages: 650-657

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] 3D modeling of outdoor scenes by integrating stop-and-go and continuous scanning of rangefinder2005

    • Author(s)
      Toshihiro Asai
    • Journal Title

      Proc. Meeting on Image Recognition and Understanding (MIRU2005) (CD-ROM)

      Pages: 808-813

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] 3-D modeling of outdoor environments by integrating omnidirectional range and color images2005

    • Author(s)
      Toshihiro Asai
    • Journal Title

      Journal of IIEE of Japan 34・5

      Pages: 529-538

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] Mixed reality : Merging real and virtual worlds-I Introduction2005

    • Author(s)
      Naokazu Yokoya
    • Journal Title

      Systems, Control and Information 49・12

      Pages: 489-494

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] 3D measurement of the real world for mixed reality2005

    • Author(s)
      Naokazu Yokoya
    • Journal Title

      Proc. Vision Engineering Workshop (ViEW2005)

      Pages: 186-190

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] Extrinsic camera parameter recovery from multiple image sequences captured by an omnidirectional multi-camera system2004

    • Author(s)
      Tomokazu Sato
    • Journal Title

      Proc. 8th European Conf. on Computer Vision (ECCV2004) 2

      Pages: 326-340

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] Camera parameter estimation from a long image sequence by tracking markers and natural features2004

    • Author(s)
      Tomokazu Sato
    • Journal Title

      Systems and Computers in Japan 35・8

      Pages: 12-20

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] 全方位レンジデータと全方位画像の統合による屋外環境の三次元モデル化2004

    • Author(s)
      浅井 俊弘
    • Journal Title

      画像の認識・理解シンポジウム(MIRU2004)講演論文集 1

      Pages: 195-200

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] 自然特徴点を利用したマルチベースラインステレオによる全方位奥行き画像推定2004

    • Author(s)
      佐藤 智和
    • Journal Title

      情報技術レターズ 3

      Pages: 161-164

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] 3D modeling of outdoor scenes from omnidirectional range and color images2004

    • Author(s)
      Toshihiro Asai
    • Journal Title

      Proc. Int. Conf. on Computer Vision and Graphic (ICCVG2004)

      Pages: 118-124

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] 動画像からのカメラ位置・姿勢パラメータの推定-マーカと自然特徴点の追跡による動画像からのカメラ外部パラメータの復元-2004

    • Author(s)
      佐藤 智和
    • Journal Title

      画像ラボ 15・9

      Pages: 27-31

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] 3D modeling of wide area outdoor environments by integrating omnidirectional range and color images2004

    • Author(s)
      Toshihiro Asai
    • Journal Title

      Proc. 3rd IEEE/ACM Int. Symposium on Mixed and Augmented Reality (ISMAR 04)

      Pages: 264-265

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] 3D modeling of outdoor environments by integrating omnidirectional range and color images2004

    • Author(s)
      Toshihiro Asai
    • Journal Title

      Proc. Meeting on Image Recognition and Understanding (MIRU2004) 1

      Pages: 195-200

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] Omni-directional depth-map estimation by multi-baseline stereo using interest points2004

    • Author(s)
      Tomokazu Sato
    • Journal Title

      Information Technology Letters 3

      Pages: 161-164

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] 3D modeling of outdoor scenes from omnidirectional range and color images2004

    • Author(s)
      Toshihiro Asai
    • Journal Title

      Proc. Int. Conf. on Computer Vision and Graphics (ICCVG2004)

      Pages: 118-124

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] Camera position and posture estimation from dynamic images-Reconstruction of extrinsic camera parameters by tracking markers and natural feature points in dynamic images-2004

    • Author(s)
      Tomokazu Sato
    • Journal Title

      Gazo Lab 15・9

      Pages: 27-31

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] Image processing, computer vision and mixed reality2004

    • Author(s)
      Naokazu Yokoya
    • Journal Title

      Technical Report of IEICE 106・73

      Pages: 71-74

    • Description
      「研究成果報告書概要(欧文)」より
  • [Book] Image Processing Technologies - Algorithms, Sensors and Applications -2004

    • Author(s)
      Yasuhito Suenaga
    • Total Pages
      282
    • Publisher
      Marcel Dekker
    • Description
      「研究成果報告書概要(和文)」より

URL: 

Published: 2008-05-27  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi