• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Acquisition of Depth Information form Motion Images Taken in Natural Scene and Their Synthesis.

Research Project

Project/Area Number 09650402
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field 情報通信工学
Research InstitutionTOKYO INSTITUTE OF TECHNOLOGY

Principal Investigator

NAGAHASHI Hiroshi  Tokyo Institute of Technology, Faculty of Engineering, Professor, 工学部, 教授 (20143084)

Project Period (FY) 1997 – 1998
Project Status Completed (Fiscal Year 1998)
Budget Amount *help
¥3,300,000 (Direct Cost: ¥3,300,000)
Fiscal Year 1998: ¥1,000,000 (Direct Cost: ¥1,000,000)
Fiscal Year 1997: ¥2,300,000 (Direct Cost: ¥2,300,000)
Keywordsdepth information / epipolar geometry / stereo vision / affine transformation / voxel data / object tracking / Hopfield neural network / image synthesis / 多視点画像 / 鏡面画像 / 動画像 / 多視点ステレオ視 / 視差マップ
Research Abstract

In this project, several methods for acquiring depth information from images were investigated and an image synthesis method using the information was proposed.
Firstly, two approaches, in which epipolar geometry derived from multi-view images was analyzed to extract depth information, were investigated : one is stereo images and the other is a special case of multi-view system, that is, a monocular image taking a scene in which there exists a mirror. In the approach of stereo vision, disparities on significant edges were calculated by a correlation technology, and a point between two edges in a row line is linearly interpolated its disparity from those of the edges, and the interpolated disparity is corrected so as to be consistent with that obtained by vertical scan. Experimental results showed that this method simply approximate a region with almost homogeneous depth and also separate foreground regions from backgrounds ones. The other approach using a mirror is based on affine trans … More formation. In this method, when four points of an object on desk and their corresponding points reflected on the mirror are given, it is possible to determine 2-D points projected on the image plane of another 3-D object on the desk. This means that CG animation of a real video and a 3-D object in motion can be generated from a special monocular image.
Secondly, 3-D object model reconstructions from images based on 3-D geometry were investigated for image synthesis. A model based volume matching method to extract motion of human being was proposed. It was proved to be possible to identify motion parameters for each pose by matching models with voxel data constructed by four images from different viewpoints.
Thirdly, object tracking by contours to extract depth information were investigated. The object tracking enables to separate foreground regions from background ones in a scene. In this approach, a new region segmentation method based on the Hopfield NN was proposed. Some properties of boundary pixels were embedded in an objective function of the network and the segmentation which minimizes this function was obtained. In order to realize a fast, stable and global region segmentation, pyramid images were used. Experimental results showed that this method is effective for region extraction and motion tracking.
A new image synthesis method without motion incompatibility was also proposed. In this method, when the contours of objects to be superimposed are specified once in the first frame, they are semi-automatically tracked in object image sequence by a hierarchical matching algorithm and an active contour method. In order to synthesize two image sequences without motion incompatibility, position and magnification ratio of an object to be superimposed are determined automatically based on its motion parameters extracted in the process of contour tracking. A new soft-key for blending boundary colors was also proposed to cope with motion blurs. Less

Report

(3 results)
  • 1998 Annual Research Report   Final Research Report Summary
  • 1997 Annual Research Report
  • Research Products

    (55 results)

All Other

All Publications (55 results)

  • [Publications] 青井 隆徳: "1枚のスケッチ画からの3次元物体モデルの自動構築" 日本印刷学会誌. 33, 6. 369-376 (1997)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] 岩田 治幸: "ニューラルネットワークを用いたカラー画像における境界線検出" 映像情報メディア学会誌. 51, 1. 113-120 (1997)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] 永江 孝規: "三重線形補間等値面の陰影付け" 電子情報通信学会論文誌D-II. J80-D-II, 7. 1834-1842 (1997)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] 青井 隆徳: "一般化同筒を用いたスケッチ画からの3次元モデリング" 映像情報メディア学会誌. 51, 8. 1319-1325 (1997)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Mohamod Imine: "A new approach in polynomial and Bezier parametric piecewise modeling" Elsevier Science, Computer Networks and ISDN Systems. 29. 232-240 (1997)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] 岩田 治幸: "ニューラルネットワークを用いたカラー画像における動的領域分割" 電子情報通信学会論文誌・ D-II. J80-D-II, 11. 2995-3003 (1997)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] 永江 孝規: "適応的再標本化による高精細ボリュームレンダタリング" 映像情報メディア学会誌. 51, 12. 2158-2165 (1997)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Mohamed Imine: "Parametric piecewise modeling of Bezier and polynomial surfaces" 電子情報通信学会論文誌. E81-D, 1. 94-104 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] 永江 孝規: "シルエット逆投影による多階調遮蔽包の計測" 映像情報メディア学会誌. 52, 4. 616-622 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] 岩田 治幸: "ニューラルネットワークの学習とエネルギー極小化による動的領域抽出" 映像情報メディア学会誌. 52, 7. 1048-1054 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Haruyuki Iwata: "Motion tracking of color image sequences using neural networks" SPIE VCIP'97. 200-210 (1997)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] 永江 孝規: "レンダリングのための3次 求解法の検討" 電子情報通信学会総合大会講演論文集. D-11-116. 116-116 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] 山口 真紀: "画像合成のための補間と補正による奥行き情報取得の一手法" 電子情報通信学会総合大会講演論文集. D-11-197. 197-197 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] 米田 知則: "樹木ボリュームへの曲面当てはめ" 電子情報通信学会総合大会講演論文集. D-12-107. 306-306 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] 井上 英輝: "多視点動画像を用いた人体の姿勢のモデリング" 電子情報通信学会総合大会講演論文集. D-12-154. 353-353 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] 田中 孝介: "鉢植え植物ボリュームデータの領域分割" 電子情報通信学会総合大会講演論文集. D-12-173. 372-372 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] 早川 知伸: "テクスチャの逆投影による3次元形状の復元-第2報-" 電子情報通信学会総合大会講演論文集. D-12-176. 375-375 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] 永江 孝規: "セルリストマップを用いたボリュームレンダリング" 電子情報通信学会情報システムソサエティ大会講演論文集. D-12-63. 285-285 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] 相馬 俊一: "多視点動画像を用いた腕の動きのモデリングに関する研究" 情報処理学会コンピュータビジョンとイメージメディア研究会資料. CVIM114-6. 41-47 (1999)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] 早川 知伸: "テクスチャの逆投影による3次元形状の復元-第3報-" 電子情報通信学会総合大会講演論文集. D-12-123. 296-296 (1999)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Solange Kashivazui: "A study of weak califration at the mierorsurface" 電子情報通信学会総合大会講演論文集. D-12-172. 345-345 (1999)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] 畑田 敬志: "柔軟物体運動における衝突と変形の安定な計算法に関する研究" 電子情報通信学会総合大会講演論文集. D-12-139. 312-312 (1999)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] T.Aoi, H.Nagahashi and T.Agui: ""Automatic Construction of a 3-D Object Model from a Single Sketch Image"" Bulletin of The Japanese Soci.of Printing Sci.and Tech.33,6. 369-376 (1997)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] H.Iwata, H.Nagahashi and T.Agui: ""Boundary Detection of Color Images Using Neural Networks"" The Journal of the Inst.of Image Infor.and Televi.Eng.51,1. 113-120 (1997)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] T.Nagae, H.Nagahashi: ""Shading of Trilinearly Interpolated Isosurfaces"" The Trans.of IEICE D-II. J-80D-II,7. 1834-1842 (1997)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] T.Aoi, H.Nagahashi: ""3-D Modeling from a Sketch Image Using Geneer-alized Cylinders"" The Journal of the Inst.of Image Infor.and Televi.Eng.51,8. 1319-1325 (1997)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] M.Imine, H.Nagahashi: ""A New Approach in Polynomial and Bezier Parametric Piecewise Modeling."" Elsevier Science, Computer Networks and ISDN Systems. 29. 232-240 (1997)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] H.Iwata, H.Nagahashi: ""Active Region Segmentation of Color Images Using Neural Networks"" The Trans.of IEICE D-II. J80-D-II,11. 2995-3003 (1997)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] T.Nagae, H.Nagahashi: ""High-resolution Volume Rendering by Adaptive Resampling"" The Journal of the Inst.of Image Infor.and Televe.Eng.51,12. 2158-2165 (1997)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] M.Imine, H.Nagahashi: ""Parametric Piecewise Modeling ofB'ezier and Polynomial Surfaces"" The Trans.of IEICE Inf & Syst.E81-D,1. 94-104 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] T.Nagae, H.Nagahashi: ""Acquisition of Grayscale Occluding Hulls by Silhouette Backprojection"" The Journal of the Inst.of Image Infor.and Televi.Eng.52,4. 616-622 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] H.Iwata, H.Nagahashi: ""Active-Region Extraction by Learning and Energy Minimization Using Neural Networks"" The Journal of the Inst.of Image Infor.and Televi.Eng.52,7. 1048-1054 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] H.Iwata, H.Nagahashi: ""Motion Tracking of Color Image Sequences Using Neural Networks"" SPIE VCIP'97. 3024. 200-210 (1997)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] T.Nagae, H.Nagahashi: ""A Surver on Cubic Root Solvers for Rendering"" Proc.of the 1998 IEICE General Conf. D-11-116 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] M.Yamaguchi, H.Nagahashi: ""A Method of Depth Information Acquisition by Interpolation and Correction"" Proc.of the 1998 IEICE General Conf. D-11-197 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] T.Yoneda, T.Nagae, H.Nagahashi: ""Surface Fitting to Volume of Plants"" Proc.of the 1998 IEICE General Conf. D-12-107 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] H.Inoue, T.Nagae, H.Nagahashi: ""Human Pose Modeling from Multiple View"" Proc.of the 1998 IEICE General Conf. D-12-154 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] K.Tanaka, T.Nagae, H.Nagahashi: ""Segmentation of Volume Data of Potted Plants"" Proc.of the 1998 IEICE General Conf. D-12-173 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] T.Hayakawa, T.Nagae, H.Nagahashi: ""3D Shape Restoration by Texture Backprojection-Part2-"" Proc.of the 1998 IEICE General Conf. D-12-176 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] T.Nagae, H.Nagahashi: ""A Volume Rendering Technique Using a cell List Map"" Proc.of the 1998 Inf & Syst.Soci.Conf.of IEICE. D-12-63 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] S.Soma, H.Nagahashi: ""Estimation of Human Arm Movement using Multiple Image Sequence"" IPS Japan CVIM Technical Report. 114-6 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] T.Hayakawa, H.Nagahashi: ""3D Shape Restoration by Texture Backprojection-Part3-"" Proc.of the 1999 IEICE & General.Conf.D-12-123 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] S.Kashivaqui, H.Nagahashi: ""A Study of Weak Calibration at the Mirror surface"" Proc.of the 1999 IEICE & General.Conf.D-12-172 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] T.Hatakeda, H.Nagahashi: ""Robust Calculation Technique for Simulating Deformable Objects"" Proc.of the 1999 IEICE & General.Conf.D-12-139 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] 山口 真紀: "画像合成のための補間と補正による奥行き情報取得の一手法" 電子情報通信学会総合大会講演論文集(1998). D-11-197. 197-197 (1998)

    • Related Report
      1998 Annual Research Report
  • [Publications] 米田 知則: "樹木ボリュームへの曲面当てはめ" 1998年電子情報通信学会総合大会講演論文集. D-12-107. 306-306 (1998)

    • Related Report
      1998 Annual Research Report
  • [Publications] 井上 英輝: "多視点動画像を用いた人体の姿勢のモデリング" 1998年電子情報通信学会総合大会講演論文集. D-12-154. 353-353 (1998)

    • Related Report
      1998 Annual Research Report
  • [Publications] 早川 知伸: "テクスチャの逆投影による3次元形状の復元-第2報-" 1998年電子情報通信学会総合大会講演論文集. D-12-176. 375-375 (1998)

    • Related Report
      1998 Annual Research Report
  • [Publications] 永江 孝規: "シルエット逆投影による多階調遮蔽包の計測" 映像情報メディア学会誌. 52,4. 612-622 (1998)

    • Related Report
      1998 Annual Research Report
  • [Publications] 岩田 治幸: "ニューラルネットワークの学習とエネルギー極小化による動的領域抽出" 映像情報メディア学会誌. 52,7. 1048-1054 (1998)

    • Related Report
      1998 Annual Research Report
  • [Publications] 菅野 恒雄: "ニューラルネットワークによる男女顔特徴抽出" 電子情報通信学会論文誌D-II. J81-DII,11. 2645-2652 (1998)

    • Related Report
      1998 Annual Research Report
  • [Publications] 相馬 俊一: "多視点動画像を用いた腕の動きのモデリングに関する研究" 情報処理学会研究報告 CVIM. 99-114. 41-47 (1999)

    • Related Report
      1998 Annual Research Report
  • [Publications] Solange Kashivaque: "A Study of Weak Calibration at the Mirror Surface" 1999年電子情報通信学会総合大会講演論文集. (発表予定). (1999)

    • Related Report
      1998 Annual Research Report
  • [Publications] 井上英輝・長橋宏: "多視点動画像を用いた人体の動きの認識に関する研究" 映像情報メディア学会冬季大会講演予稿集. ITE′97. 105-105 (1997)

    • Related Report
      1997 Annual Research Report
  • [Publications] 山口真紀・長橋宏: "画像合成のための補間と補正による奥行き情報取得の一手法" 電子情報通信学会総合大会講演論文集. (発表予定). (1998)

    • Related Report
      1997 Annual Research Report

URL: 

Published: 1997-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi