• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Analysis of behaviors of non-rigid objects in real space and their real-time reproduction in 3D virtual space

Research Project

Project/Area Number 13650432
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field 情報通信工学
Research InstitutionWaseda University

Principal Investigator

OHYA Jun  Graduate School of Global Information and Telecommunication Studies, Professor, 国際情報通信研究科, 教授 (90329152)

Project Period (FY) 2001 – 2002
Project Status Completed (Fiscal Year 2002)
Budget Amount *help
¥3,900,000 (Direct Cost: ¥3,900,000)
Fiscal Year 2002: ¥1,900,000 (Direct Cost: ¥1,900,000)
Fiscal Year 2001: ¥2,000,000 (Direct Cost: ¥2,000,000)
Keywordsnon-rigid object / virtual space / reproduction / computer vision / computer graphics / water / botanical tree / human image / 仮想的環境 / 非剛体物体 / 挙動再現 / 流体 / バンプマッピング / インタラクション認識 / 動き認識 / 3次元人物モデル
Research Abstract

The purpose of this project is to establish methods that analyze the behaviors of non-rigid objects in real space and reproduce the behaviors in 3D virtual space in real-time. As research targets, this project focuses on 1. water, 2. botanical trees, and 3. human images.
1. We clarified that Bump mapping is appropriate for modeling water in 3D. Then, we studied how to acquire surface normals to many points in water surface, where Bump mapping needs the surface normals for rendering. We proposed a method based on "Shape from Shading" (SFS). It turned out that SFS is useful for areas in which the brightness changes smoothly, but shape discontinuities appear in the boundaries of the reflected images of the objects around the water. We proposed a method that deals with this issue, and we got promising experimental results.
2. We studied how to animate 3D botanical tree models efficiently and realistically. Our approach analyzes the motion of the representative branch segment of each branch without analyzing all the branch segments, where the 3D motions are efficiently. Experimental results show the effectiveness of the proposed method.
3. Human behaviors are classified into facial expressions and body actions. Concerning facial expressions, we explored a method that texture-maps real facial images to the 3D face model that reproduces the structure and actions of facial muscles, and it turned out that precise structures such as wrinkles can be reproduced. Concerning body actions, we studied a color analysis based method that estimates the postures of the person who wears a special suit that is colored differently in each body part so that occlusion problems can be solved. Furthermore, preliminary study of recognizing interactions between a human and object was conducted.

Report

(3 results)
  • 2002 Annual Research Report   Final Research Report Summary
  • 2001 Annual Research Report
  • Research Products

    (66 results)

All Other

All Publications (66 results)

  • [Publications] 寺島哲平, 大谷 淳: "実写画像を用いた流体挙動の仮想的再現の検討"電子情報通信学会 情報・システムソサイエティ大会. 161 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] 劉 奕志, 佐藤 一, 大谷 淳: "3D顔モデル生成方法の比較検討"電子情報通信学会 情報・システムソサイエティ大会. 160 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] 小花麻純, 大谷 淳: "画像処理による人物と物体のインタラクション認識の検討"情報処理学会第63回(平成13年後期)全国大会. 2. 2-215-2-216 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] 寺島哲平, 大谷 淳: "映りこみを利用した水の再現方法の検討"電子情報通信学会 総合大会. 171 (2002)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Jun Ohya: "Computer Vision Based Analysis of Non-Verbal information in HCI"Proc. of IEEE Int. Conf. on Multimedia and Expo. 1076-1079 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] 小花麻純, 大谷 淳: "コンピュータヴィジョンに基づく人物と物体のインタラクション認識の検討"電子情報通信学会 総合大会. 281 (2002)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] 劉 奕志, 佐藤 一, 大谷 淳: "筋肉動作を考慮した3次元顔モデルの構築と表情生成の応用"電子情報通信学会総合大会. 355 (2002)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Masumi Kobana, Jun Ohya: "Computer Vision Based Recognition of Interactions between Humanbody and Object"International Workshop on Entertainment Computing. 159-166 (2002)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] 寺島哲平, 大谷 淳: "実空間中の流体挙動の仮想的再現に関する基礎的検討"2002画像電子学会第30回年次大会 予稿集. 167-168 (2002)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] 佐藤一, 劉奕志, 大谷淳, 寺島信義: "2枚の実写画像による顔面筋動作を考慮した3次元顔特徴モデルの構築法"電子情報通信学会技術研究報告. Vol.102, No.216. 77-82 (2002)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Jun Ohya: "Analysis of Human Behaviors by Computer Vision Based Approaches"2002 IEEE International Conference on Multimedia and Expo. (CD-ROM proceedings). 4 (2002)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Yi-Chih Liu, 他2名, Jun Ohya: "Construction of facial expressions using a muscle-based feature model"2002 IEEE International Conference on Multimedia and Expo. (CD-ROM proceedings). 4 (2002)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] 姜 東完, 大谷 淳: "色彩画像処理による色分け衣服を装着した人物の姿勢推定法の検討"FIT(情報科学技術フォーラム). 43-44 (2002)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] 神田 仁, 大谷 淳: "力学的挙動の効率的表現が可能な樹木の三次元モデリング法の検討"FIT(情報科学技術フォーラム). 223-224 (2002)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] 佐藤一, 大谷 淳, 寺島信義: "動画像と顔面筋動作を考慮したモデルを用いた3次元人物顔画像構築法"電子情報通信学会技術研究報告. Vol.102, No.651. 53-58 (2003)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] 寺島哲平, 大谷 淳: "仮想的再現のためのShape from Shadingを利用した水面形状の推定法の基礎的検討"電子情報通信学会技術研究報告. Vol.102, No.652. 55-60 (2003)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] 神田 仁, 大谷 淳: "効率的かつリアルな3次元樹木モデルのアニメーションの検討"電子情報通信学会技術研究報告. Vol.102, No.660. 81-86 (2003)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] 寺島哲平, 大谷 淳: "仮想的再現のためのShape from Shadingを利用した水面形状の推定法の基礎的検討"電子情報通信学会総合大会. 117 (2003)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] 神田 仁, 大谷 淳: "3次元樹木モデルにおける効率的かつリアルな葉のアニメーション法の検討"電子情報通信学会総合大会. 260 (2003)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] 佐藤一, 大谷 淳, 寺島信義: "実写動画像と顔面筋モデルによる3次元人物顔画像の構築"電子情報通信学会総合大会. 325 (2003)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Hitoshi Kanda, Jun Ohya: "Efficient, Realistic Method for Animating Dynamic Behaviors of 3D Botanical Trees"2002 IEEE International Conference on Multimedia and Expo. (掲載決定). 4 (2003)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Kang, Dong-Wan, Jun Ohya: "Estimating Postures of a Human Wearing a Multiple-Colored Suit Based on Color Information Processing"2002 IEEE International Conference on Multimedia and Expo. (掲載決定). 4 (2003)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Jun Ohya, Akira Utsumi, Junji Yamato: "ANALYZING VIDEO SEQUENCES OF MULTIPLE HUMANS Tracking, Posture Estimation and Behavior Recognition"Kluwer Academic Publishers. 138 (2002)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Teppei Terashima and Jun Ohya: "Study of reproducing fluid's behaviors in a virtual environment using a video sequence"Proceedings of the 2001 Information and Systems Society Conference of the Institute of Electronics, Information and Communication Engineers. 161 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Yi-Chih Liu, Hajime Sato and Jun Ohya: "Comparative Studies of 3D Face Modeling"Proceedings of the 2001 Information and Systems Society Conference of the Institute of Electronics, Information and Communication Engineers. 160 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Masumi Kobana and Jun Ohya: "Recognizing interactions between human body and objects"63th National Convention of the Information Processing Society of Japan. Vol. 2. 2-215-2-216 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Teppei Terashima and Jun Ohya: "Study of recognizing fluid's behaviors using the image of reflected objects"Proceedings of the 2002 IEICE (The Institute of Electronics, Information and Communication Engineers) General Conference. 171 (2002)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Jun Ohya: "Computer Vision Based Analysis of Non-verbal Information in HCI"Proceedings of IEEE International Conference on Multimedia and Expo. 1076-1079 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Masumi Kobana and Jun Ohya: "Computer Vision Based Recognition of Interactions between Human Body and Object"Proceedings of the 2002 IEICE (The Institute of Electronics, Information and Communication Engineers) General Conference. 281 (2002)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Yi-Chih Liu, Hajime Sato and Jun Ohya: "Construction of muscle-based face model and its application to facial expression synthesis"Proceedings of the 2002 IEICE (The Institute of Electronics, Information and Communication Engineers) General Conference. 355 (2002)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Masumi Kobana and Jun Ohya: "Computer Vision Based Recognition of Interactions between Humanbody and Object"International Workshop on Entertainment Computing. 159-166 (2002)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Teppei Terashima and Jun Ohya: "Fundamental study of reproducing real fluid's behaviors in a virtual environment"Proceedings of the 30^<th> National Convention of the Institute of Image Electronics Engineers of Japan. 167-168 (2002)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Hajime Sato, Yi-Chih Liu, Jun Ohya and Nobuyoshi Terashima: "Construction of 3D facial feature model considering facial muscle movements using two photographs"Technical Report of IEICE (The Institute of Electronics, Information and Communication Engineers). Vol. 102, No. 216. 77-82 (2002)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Jun Ohya: "Analysis of Human Behaviors by Computer Vision Based Approaches"2002 IEEE International Conference on Multimedia and Expo, (CD-ROM proceedings). (2002)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Yi-Chih Liu, Hajime Sato, Nobuyoshi Terashima and Jun Ohya: "Construction of facial expressions using a muscle-based feature model"2002 IEEE International Conference on Multimedia and Expo, (CD-ROM proceedings). (2002)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Kang, Dong-Wan and Jun Ohya: "Study of estimating postures of a human wearing a multiple-colored suit based on color information processing"Forum on Information Technology. 43-44 (2002)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Hitoshi Kanda and Jun Ohya: "Study of 3D botanical tree modeling that enables efficient animations of dynamic behaviors"Forum on Information Technology. 223-224 (2002)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Hajime Sato, Jun Ohya and Nobuyoshi Terashima: "Generation of 3D facial images using video images and a facial muscle based model"Technical Report of IEICE (The Institute of Electronics, Information and Communication Engineers). Vol. 102, No. 651. 53-58 (2003)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Teppei Terashima and Jun Ohya: "Estimating the surface shape from shading of water based on Shape from Shading and its reproduction in virtual environments"Technical Report of IEICE (The Institute of Electronics, Information and Communication Engineers). Vol. 102, No. 652. 55-60 (2003)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Hitoshi Kanda and Jun Ohya: "Study of efficient, realistic animation of 3D botanical tree model"Technical Report of IEICE (The Institute of Electronics, Information and Communication Engineers). Vol. 102, No. 660. 81-86 (2003)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Teppei Terashima and Jun Ohya: "Study of estimating the shape of water surface by Shape from Shading and its reproduction in virtual environments"Proceedings of the 2003 IEICE (The Institute of Electronics, Information and Communication Engineers) General Conference. 117 (2003)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Hitoshi Kanda and Jun Ohya: "Study of efficient and realistic animation of leaves in 3D botanical tree models"Proceedings of the 2003 IEICE (The Institute of Electronics, Information and Communication Engineers) General Conference. 260 (2003)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Hajime Sato, Jun Ohya and Nobuyoshi Terashima: "Construction of 3D human face images using video images and a facial muscle model"Proceedings of the 2003 IEICE (The Institute of Electronics, Information and Communication Engineers) General Conference. 325 (2003)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Hitoshi Kanda and Jun Ohya: "Efficient, Realistic Method for Animating Dynamic Behaviors of 3D Botanical Trees"2003 IEEE International Conference on Multimedia and Expo. (to appear). (2003)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Kang, Dong-Wan and Jun Ohya: "Estimating Postures of a Human Wearing a Multiple-Colored Suit Based on Color Information Processing"2003 IEEE International Conference on Multimedia and Expo. (to appear). (2003)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Jun Ohya, Akira Utsumi, and Junji Yamato: "ANALYZING VIDEO SEQUENCES OF MULTIPLE HUMANS Tracking, Posture Estimation and Behavior Recognition"Kluwer Academic Publishers. 138 (2002)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Masumi Kobana, Jun Ohya: "Computer Visin Based Recognition of Interactions between Humanbody and Object"International Workshop on Entertainment Computing (IWEC2002). 159-166 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] Jun Ohya: "Analysis of Human Behaviors by Computer Vision Based Approaches"2002 IEEE International Conference on Multimedia and Expo (ICME2002). (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] Yi-Chih Liu, 他2名, Jun Ohya: "Construction of facial expressions using a muscle-based feature model"2002 IEEE International Conference on Multimedia and Expo (ICME2002). (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] 寺島暫平, 大谷 淳: "実空間中の流体挙動の仮想的再現に関する基礎的検討"2002画像電子学会第30回年次大会 予稿集. 167-168 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] 佐藤一, 劉奕志, 大谷淳, 寺島信義: "2枚の実写画像による顔面筋動作を考慮した3次元顔特徴モデルの構築法"電子惰報通信学会技術研究報告. Vol. 102, No. 216. 77-82 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] 姜 東完, 大谷 淳: "色彩画像処理による色分け衣服を装着した人物の姿勢推定法の検討"FIT(情報科学技術フォーラム)2002. 43-44 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] 神田 仁, 大谷 淳: "力学的挙動の効率的表現が可能な樹木の三次元モデリング法の検討"FIT(情報科学技術フォーラム)2002. 223-224 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] 佐藤一, 大谷 淳, 寺島信義: "動画像と顔面筋動作を考慮したモデルを用いた3次元人物顔画像構築法"電子情報通信学会技術研究報告. Vol. 102, No. 651. 53-58 (2003)

    • Related Report
      2002 Annual Research Report
  • [Publications] 寺島暫平, 大谷 淳: "仮想的再現のためのShape from Shadingを利用した水面形状の推定法の基礎的検討"電子情報通信学会技術研究報告. Vol. 102, No. 652. 55-60 (2003)

    • Related Report
      2002 Annual Research Report
  • [Publications] 神田 仁, 大谷 淳: "効率的かつリアルな3次元樹木モデルのアニメーションの検討"電子情報通信学会技術研究報告. Vol. 102, No. 660. 81-86 (2003)

    • Related Report
      2002 Annual Research Report
  • [Publications] 寺島暫平, 大谷 淳: "仮想的再現のためのShape from Shadingを利用した水面形状の推定法の基礎的検討"電子情報通信学会総合大会. (発表予定). (2003)

    • Related Report
      2002 Annual Research Report
  • [Publications] 神田 仁, 大谷 淳: "3次元樹木モデルにおける効率的かつリアルな葉のアニメーション法の検討"電子情報通信学会総合大会. (発表予定). (2003)

    • Related Report
      2002 Annual Research Report
  • [Publications] 佐藤一, 大谷 淳, 寺島信義: "実写動画像と額面筋モデルによる3次元人物顔画像の構築"電子情報通信学会総合大会. (発表予定). (2003)

    • Related Report
      2002 Annual Research Report
  • [Publications] Jun Ohya, Akira Utsumi, Junji Yamato: "ANALYZING VIDEO SEQUENCES OF MULTIPLE HUMANS Tracking, Posture Estimation and Behavior Recognition"Kluwer Academic Publishers. 138 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] 寺島哲平, 大谷 淳: "実写画像を用いた流体挙動の仮想的再現の検討"電子情報通信学会 情報・システムソサイエティ大会. 161 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] 劉奕 志, 佐藤一, 大谷 淳: "3D顔モデル生成方法の比較検討"電子情報通信学会 情報・システムソサイエティ大会. 160 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] 小花麻純, 大谷 淳: "画像処理による人物と物体のインタラクション認識の検討"情報処理学会第63回(平成13年後期)全国大会. 2. 2-215-2-216 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] 寺島哲平, 大谷 淳: "映りこみを利用した水の再現方法の検討"電子情報通信学会 総合大会. D-11-D-171 (2002)

    • Related Report
      2001 Annual Research Report
  • [Publications] Jun Ohya: "Computer Vision Based Analysis of Non-verbal Information in HCI"Proc. of IEEE Int. Conf. on Multimedia and Expo. 1076-1079 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] 小花麻純, 大谷 淳: "コンピュータヴィジョンに基づく人物と物体のインタラクション認識の検討"電子情報通信学会 総合大会. D-12-D-105 (2002)

    • Related Report
      2001 Annual Research Report

URL: 

Published: 2001-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi