• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Automatic generation of geometric and photometric models for virtual reality systems through computer vision techniques

Research Project

Project/Area Number 09450164
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field 計測・制御工学
Research InstitutionThe University of Tokyo

Principal Investigator

IKEUCHI Katsushi  University of Tokyo, Institute of Industrial Science, Professor, 生産技術研究所, 教授 (30282601)

Co-Investigator(Kenkyū-buntansha) SATO Yoichi  University of Tokyo, Institute of Industrial Science, Assistant Professor, 生産技術研究所, 講師 (70302627)
Project Period (FY) 1997 – 1999
Project Status Completed (Fiscal Year 1999)
Budget Amount *help
¥15,600,000 (Direct Cost: ¥15,600,000)
Fiscal Year 1999: ¥3,200,000 (Direct Cost: ¥3,200,000)
Fiscal Year 1998: ¥4,000,000 (Direct Cost: ¥4,000,000)
Fiscal Year 1997: ¥8,400,000 (Direct Cost: ¥8,400,000)
KeywordsColor image analysis / 3D measurement / Illumination measurement / Physics-based vision / Mixed reality / Virtual reality / Computer vision / Computer graphics / 三次元画像処理
Research Abstract

We have been developing methods to automatically generate virtual-reality models through observation of real objects. This research spans both geometric and photometric aspects of modeling.
As for geometric aspect, we have developed a method to obtain shapes of transparent objects such as glasses or jewelry using polarization. Usual shape-determination methods, such as laser range finders or binocular stereo, are only applicable to opaque surfaces ; few methods can be applied to transparent surfaces. Transparent surfaces have highlight and the degree of polarization in highlight depend on surface orientations. The degree of polarization is a double-value function in visible light ?one polarization value corresponds to two surface orientations -- while it is a single-value function in infrared light. On the other hand, accuracy of measurement is much higher in visible light than in infrared light. Thus, by using both infrared and visible light, we have developed an algorithm to determine surface orientations of transparent surfaces. We have conducted experiments to evaluate the accuracy of the method and demonstrated its effectiveness.
As for photometric modeling, we have developed an eigen-texture method. This method stores various views of an object *er a geometric model. These views are compressed with respect to the coordinate defined over the object surface. Then, from these compressed views, the method can re-generate arbitrary views. Since views are compressed on the object Coordinates, each part of view are highly correlated, and, thus, the method can achieve very high compression ratio. We have implemented this method, and conducted various experiment to evaluate the performance of this method.
We have published these results on international journals and presented those at international conferences.

Report

(4 results)
  • 1999 Annual Research Report   Final Research Report Summary
  • 1998 Annual Research Report
  • 1997 Annual Research Report
  • Research Products

    (47 results)

All Other

All Publications (47 results)

  • [Publications] 池内 克史: "画像による実物体のモデルの作成"日本ロボット学会誌. 16・6. 29-32 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] 池内 克史: "複合現実感における光学的整合性の実現"日本バーチャルリアリティ学会 論文誌. 623-630 (1999)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] K. Ikeuchi: "Photometric modeling for mixed reality"Proc. Of International Symposium on Mixed Reallity'99. 147-163 (1999)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Heung-Yeung Shum: "An integral approach to free-form object modeling"IEEE Trans Pattern Analysis and Machine Intelligence. 19.12. 1366-1370 (1997)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Mark D. Wheeler: "Consensus surfaces for modeling 3D objects from multiple range images"Proc. Six Intern. Conference on Computer Vision, Bombay, India. 917-924 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] 佐藤洋一: "3次元物体形状および表面反射特性を考慮したモーフィング手法"電子情報通信学会論文誌. J80-D-II. 2287-2297 (1997)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] M.Saito: "Measurement of surface orientations of transparent objects use of polarization in highlight"J. Opt Soc. Am. A. 16. 2286-2293 (1999)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Y. Sato: "Object shape and reflectance modeling from observation"Computer Graphics (Proceedings of SIGGRAPH 97). 379-387 (1997)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] 西野 恒: "Eigen-texture法:複合現実感のための3次元モデルに基づく見えの圧縮と合成"電子情報通信学会論文誌 D-II. 1793-1803 (1999)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] 佐藤 いまり: "全方位ステレオによる実光源環境の計測とそれにもとづく仮想物体の実画像への重ね込み"電子情報通信学会論文誌 D-II. 861-871 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] I. Sato: "Acquiring a radiance distribution to superimpose virtual objects onto a real scene"IEEE Transactions on Visualization and Computer Graphics. 1-12 (1999)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] I. Sato: "Illumination distribution from brightness in shadows : Adaptive estimation of illumination distribution with unknown reflectance properties in shadow regions"Proc. Intern Conf on Computer Vision (ICCV'99). 875-882 (1999)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Katsushi Ikeuchi: "Modeling from reality"Journal of the Robotics Society of Japan. Vol. 16, No. 6. 763-766 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Katsushi Ikeuchi, Y. Sato, K. Nishino, and I. Sato: "Modeling from Reality. Photometric Aspect"TVRSJ. Vol. 4, No. 4. 623-630 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Katsushi Ikeuchi, Y. Sato, K. Nishino, and I. Sato: "Photometric Modeling for Mixed Reality"Proc. of International Symposium on Mixed Reality '99. 147-163 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Heung-Yeung Shum, M. Hebert, K. Ikeuchi, and R. Reddy: "An Integral Approach to Free-Form Object Modeling"IEEE Trans on Pattern Analysis & Machine Intelligence. Vol. 19, No. 12. 1366-1370 (1997)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Mark D. Wheeler, Y. Sato and K. Ikeuchi: "Consensus Surfaces for Modeling 3D Objects from Multiple Range Images"Proc. of Sixth International Conference on Computer Vision. 917-924 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Yoichi Sato, I. Sato, and K. Ikeuchi: "3D Shape and Reflectance Morphing"Trans. of IEICE DII. Vol. J80-D-II, No. 9. 2287-2297 (1997)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Megumi Saito, Y. Sato, K. Ikeuchi, and H. Kashiwagi: "Measurement of Surface Orientations of Transparent Objects by use of Polarization in highlight"J. Opt. Soc. Am. A.. Vol. 16, No. 9. 2286-2293 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Yoichi Sato, M. D. Wheeler, and K. Ikeuchi: "Object Shape and Reflectance Modeling from Observation"Computer Graphics Proceedings, Annual Conference Series. 379-387 (1997)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Ko Nishino, I. Sato, Y. Sato, and K. Ikeuchi: "Eigen-Texture Method : Appearance Compression and Synthesis Based on 3D Model for Mixed Reality"Trans. of IEICE DII. Vol. J82-D-II, No. 10. 1793-1803 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Imari Sato, Y. Sato, and K. Ikeuchi: "Seamless Integration of Computer Generated Objects into a Real Scene Based on a Real Illumination Distribution"Trans. of IEICE DII. Vol. J81-D-II, No. 5. 861-871 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Imari Sato, Y. Sato, and K. Ikeuchi: "Acquiring a Radiance Distribution to Superimpose Virtual Objects onto a Real Scene"IEEE Trans. on Visualization & Computer Graphics. Vol. 5, No. 1. 1-12 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Imari Sato, Y. Sato, and K. Ikeuchi: "Illumination Distribution from Brightness in Shadows : Adaptive Estimation of Illumination Distribution with unknown Reflectance Properties in Shadow Regions"Proc. International Conference on Computer Vision (ICCV'99). 875-882 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] 池内克史: "複合現実感における光学的整合性の実現"日本バーチャルリアリティ学会論文誌. 4・4. 623-630 (1999)

    • Related Report
      1999 Annual Research Report
  • [Publications] M. Saito: "Measurement of surface orientations of transparent objects use of polarization in highlight"J. Opt Soc. Am. A. 16・9. 2286-2293 (1999)

    • Related Report
      1999 Annual Research Report
  • [Publications] 西野恒: "Eigen-texture法 : 複合現実感のための3次元モデルに基づく見えの圧縮と合成"電子情報通信学会論文誌. J82-D-II・10. 1793-1803 (1999)

    • Related Report
      1999 Annual Research Report
  • [Publications] I. Sato: "Acquiring a radiance distribution to superimpose virtual objects onto a real scene"IEEE Trans. Visualization and Computer Graphlcs. 5・1. 1-12 (1999)

    • Related Report
      1999 Annual Research Report
  • [Publications] K. Ikeuchi: "Appearance modeling for mixed reality : photometric aspects"Proc. IEEE Int. Conf. Systems, Man, and Cybernetics (SMC' 99). 36-41 (1999)

    • Related Report
      1999 Annual Research Report
  • [Publications] I. Sato: "Illumination distribution from brightness in shadows : Adaptive estimation of illumination distribution with unknown reflectance properties in shadow regions"Proc. Intern Conf on Computer Vision (ICCV'99). 875-882 (1999)

    • Related Report
      1999 Annual Research Report
  • [Publications] Yoichi Sato: "3D shape and reflectance morphing" Systems and Computers in Japan. 29・3. 28-38 (1998)

    • Related Report
      1998 Annual Research Report
  • [Publications] Y.Sato, I.Sato, and K.Ikeuchi: "3D Shape and reflectance morphing" Systems and Computers in Japan. (1998)

    • Related Report
      1997 Annual Research Report
  • [Publications] Y.Sato, M.D.Wheeler, and K.Ikeuchi: "Object shape and refleetance modeling from obseruation" Proceedings of ACM SIGGRAPH 97. 379-387 (1997)

    • Related Report
      1997 Annual Research Report
  • [Publications] Y.Sato, I.Sato, and K.Ikeuchi: "Object shape morphing with intermediate retlechance properhes" Internahonal Journal of Shape Modeling. Vol.3 Nos.182. 91-106 (1997)

    • Related Report
      1997 Annual Research Report
  • [Publications] 佐藤、佐藤、池内: "全方位ステレオによる実光源環境の計測とそれにもとづく仮想物体の実画像への量ね込み" 電子情報通信学会論文誌. D-II. (1998)

    • Related Report
      1997 Annual Research Report
  • [Publications] 佐藤、佐藤、池内: "3次元物体形状および表面反射特性を考慮したモ-フィング手法" 電子情報通信学会論文誌. D-II September. 2287-2297 (1997)

    • Related Report
      1997 Annual Research Report
  • [Publications] Y.Sato, M.D.Wheeler, and K.Ikeuchi: "Measuring object surface shape and reflectance properhes" Proceedings of ACCV′98. January. 350-359 (1998)

    • Related Report
      1997 Annual Research Report
  • [Publications] K.Ohba, Y.Sato, and K.Ikeuchi: "Appearance loased cisual learning and object recognition with illumination invariance" Proceedings of ACCV′98. January. 424-431 (1998)

    • Related Report
      1997 Annual Research Report
  • [Publications] M.D.Wheeler, Y.Sato, and K.Ikeuchi: "Consensus surfaces for modeling 3D objects from multiple range images" Proceedings of ICCV′98. January. (1998)

    • Related Report
      1997 Annual Research Report
  • [Publications] K.Ohba, Y.Sato, and K.Ikeuchi: "Visual learning and object recognition with illumination invariance" Proceedings of the 8th Congress of the International Colour Association. (1997)

    • Related Report
      1997 Annual Research Report
  • [Publications] Y.Sato, I.Sato, and K.Ikeuchi: "3D shape and reflectance morphing" Proceedings of Infernational Conference on Shape Mode ling and Applications′97. 234-242 (1997)

    • Related Report
      1997 Annual Research Report
  • [Publications] 佐藤、佐藤、池内: "光学的整合性を考慮した実画像への仮想物体の量ね込み" 第3回知能情報メディアシンポジウム. 23-32 (1997)

    • Related Report
      1997 Annual Research Report
  • [Publications] 佐藤、佐藤、池内: "実物体のソフトシャドウにもとづく実照明環境の推定" 情報処理学会 コンピュータビジョンとイメージメディア研究会報告. 98-CVIM-110. (1998)

    • Related Report
      1997 Annual Research Report
  • [Publications] 西野、佐藤、池内: "複合現実感のための3次元モデルに基づく見えの圧縮" 情報処理学会 コンピュータビジョンとイメージメディア研究会報告. 98-CVIM-110. (1998)

    • Related Report
      1997 Annual Research Report
  • [Publications] 斉藤、佐藤、池内: "ハイライトの偏光解析にもとづく透明物体表面形状の計測" 情報処理学会 コンピュータビジョンとイメージメディア研究会報告. 98-CVIM-110. (1998)

    • Related Report
      1997 Annual Research Report
  • [Publications] 佐藤、佐藤、池内: "照明条件を考慮した実画像への仮想物体の量ね込み" 電子情報通信学会、パターン認識.メディア理解研究会報告. PRMU97-114. (1997)

    • Related Report
      1997 Annual Research Report
  • [Publications] 大場、佐藤、池内: "照明条件変化に伴う三次元物体の安定認識" 日本機械学会 ロボティスク.メカトロニクス講演会′97(ROBOMEC′97). pp.1063-1064 (1997)

    • Related Report
      1997 Annual Research Report

URL: 

Published: 1997-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi