• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to project page

1999 Fiscal Year Final Research Report Summary

Automatic generation of geometric and photometric models for virtual reality systems through computer vision techniques

Research Project

Project/Area Number 09450164
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field 計測・制御工学
Research InstitutionThe University of Tokyo

Principal Investigator

IKEUCHI Katsushi  University of Tokyo, Institute of Industrial Science, Professor, 生産技術研究所, 教授 (30282601)

Co-Investigator(Kenkyū-buntansha) SATO Yoichi  University of Tokyo, Institute of Industrial Science, Assistant Professor, 生産技術研究所, 講師 (70302627)
Project Period (FY) 1997 – 1999
KeywordsColor image analysis / 3D measurement / Illumination measurement / Physics-based vision / Mixed reality / Virtual reality / Computer vision / Computer graphics
Research Abstract

We have been developing methods to automatically generate virtual-reality models through observation of real objects. This research spans both geometric and photometric aspects of modeling.
As for geometric aspect, we have developed a method to obtain shapes of transparent objects such as glasses or jewelry using polarization. Usual shape-determination methods, such as laser range finders or binocular stereo, are only applicable to opaque surfaces ; few methods can be applied to transparent surfaces. Transparent surfaces have highlight and the degree of polarization in highlight depend on surface orientations. The degree of polarization is a double-value function in visible light ?one polarization value corresponds to two surface orientations -- while it is a single-value function in infrared light. On the other hand, accuracy of measurement is much higher in visible light than in infrared light. Thus, by using both infrared and visible light, we have developed an algorithm to determine surface orientations of transparent surfaces. We have conducted experiments to evaluate the accuracy of the method and demonstrated its effectiveness.
As for photometric modeling, we have developed an eigen-texture method. This method stores various views of an object *er a geometric model. These views are compressed with respect to the coordinate defined over the object surface. Then, from these compressed views, the method can re-generate arbitrary views. Since views are compressed on the object Coordinates, each part of view are highly correlated, and, thus, the method can achieve very high compression ratio. We have implemented this method, and conducted various experiment to evaluate the performance of this method.
We have published these results on international journals and presented those at international conferences.

  • Research Products

    (24 results)

All Other

All Publications (24 results)

  • [Publications] 池内 克史: "画像による実物体のモデルの作成"日本ロボット学会誌. 16・6. 29-32 (1998)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] 池内 克史: "複合現実感における光学的整合性の実現"日本バーチャルリアリティ学会 論文誌. 623-630 (1999)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] K. Ikeuchi: "Photometric modeling for mixed reality"Proc. Of International Symposium on Mixed Reallity'99. 147-163 (1999)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Heung-Yeung Shum: "An integral approach to free-form object modeling"IEEE Trans Pattern Analysis and Machine Intelligence. 19.12. 1366-1370 (1997)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Mark D. Wheeler: "Consensus surfaces for modeling 3D objects from multiple range images"Proc. Six Intern. Conference on Computer Vision, Bombay, India. 917-924 (1998)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] 佐藤洋一: "3次元物体形状および表面反射特性を考慮したモーフィング手法"電子情報通信学会論文誌. J80-D-II. 2287-2297 (1997)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] M.Saito: "Measurement of surface orientations of transparent objects use of polarization in highlight"J. Opt Soc. Am. A. 16. 2286-2293 (1999)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Y. Sato: "Object shape and reflectance modeling from observation"Computer Graphics (Proceedings of SIGGRAPH 97). 379-387 (1997)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] 西野 恒: "Eigen-texture法:複合現実感のための3次元モデルに基づく見えの圧縮と合成"電子情報通信学会論文誌 D-II. 1793-1803 (1999)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] 佐藤 いまり: "全方位ステレオによる実光源環境の計測とそれにもとづく仮想物体の実画像への重ね込み"電子情報通信学会論文誌 D-II. 861-871 (1998)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] I. Sato: "Acquiring a radiance distribution to superimpose virtual objects onto a real scene"IEEE Transactions on Visualization and Computer Graphics. 1-12 (1999)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] I. Sato: "Illumination distribution from brightness in shadows : Adaptive estimation of illumination distribution with unknown reflectance properties in shadow regions"Proc. Intern Conf on Computer Vision (ICCV'99). 875-882 (1999)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Katsushi Ikeuchi: "Modeling from reality"Journal of the Robotics Society of Japan. Vol. 16, No. 6. 763-766 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Katsushi Ikeuchi, Y. Sato, K. Nishino, and I. Sato: "Modeling from Reality. Photometric Aspect"TVRSJ. Vol. 4, No. 4. 623-630 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Katsushi Ikeuchi, Y. Sato, K. Nishino, and I. Sato: "Photometric Modeling for Mixed Reality"Proc. of International Symposium on Mixed Reality '99. 147-163 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Heung-Yeung Shum, M. Hebert, K. Ikeuchi, and R. Reddy: "An Integral Approach to Free-Form Object Modeling"IEEE Trans on Pattern Analysis & Machine Intelligence. Vol. 19, No. 12. 1366-1370 (1997)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Mark D. Wheeler, Y. Sato and K. Ikeuchi: "Consensus Surfaces for Modeling 3D Objects from Multiple Range Images"Proc. of Sixth International Conference on Computer Vision. 917-924 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Yoichi Sato, I. Sato, and K. Ikeuchi: "3D Shape and Reflectance Morphing"Trans. of IEICE DII. Vol. J80-D-II, No. 9. 2287-2297 (1997)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Megumi Saito, Y. Sato, K. Ikeuchi, and H. Kashiwagi: "Measurement of Surface Orientations of Transparent Objects by use of Polarization in highlight"J. Opt. Soc. Am. A.. Vol. 16, No. 9. 2286-2293 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Yoichi Sato, M. D. Wheeler, and K. Ikeuchi: "Object Shape and Reflectance Modeling from Observation"Computer Graphics Proceedings, Annual Conference Series. 379-387 (1997)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Ko Nishino, I. Sato, Y. Sato, and K. Ikeuchi: "Eigen-Texture Method : Appearance Compression and Synthesis Based on 3D Model for Mixed Reality"Trans. of IEICE DII. Vol. J82-D-II, No. 10. 1793-1803 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Imari Sato, Y. Sato, and K. Ikeuchi: "Seamless Integration of Computer Generated Objects into a Real Scene Based on a Real Illumination Distribution"Trans. of IEICE DII. Vol. J81-D-II, No. 5. 861-871 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Imari Sato, Y. Sato, and K. Ikeuchi: "Acquiring a Radiance Distribution to Superimpose Virtual Objects onto a Real Scene"IEEE Trans. on Visualization & Computer Graphics. Vol. 5, No. 1. 1-12 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Imari Sato, Y. Sato, and K. Ikeuchi: "Illumination Distribution from Brightness in Shadows : Adaptive Estimation of Illumination Distribution with unknown Reflectance Properties in Shadow Regions"Proc. International Conference on Computer Vision (ICCV'99). 875-882 (1999)

    • Description
      「研究成果報告書概要(欧文)」より

URL: 

Published: 2001-10-23  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi