• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

3D shape measurement of human shape from multiple viewpoint images using shape database

Research Project

Project/Area Number 17500119
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field Perception information processing/Intelligent robotics
Research InstitutionKeio University

Principal Investigator

SAITO HIDEO  Keio University, Department of Information and Computer Science, Professor (90245605)

Co-Investigator(Kenkyū-buntansha) MOCHIMARU MASAAKI  Digital Human Research Center, Advanced Institute of Science and Technology, Vice-Leader of the Center (90358169)
Project Period (FY) 2005 – 2007
Project Status Completed (Fiscal Year 2007)
Budget Amount *help
¥3,630,000 (Direct Cost: ¥3,300,000、Indirect Cost: ¥330,000)
Fiscal Year 2007: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Fiscal Year 2006: ¥1,000,000 (Direct Cost: ¥1,000,000)
Fiscal Year 2005: ¥1,200,000 (Direct Cost: ¥1,200,000)
KeywordsMultiple Viewpoint Cameras / Unsynchronized Cameras / Human Shape Measurement / Facial Shape Measurement / Projector / Principal Component Analysis / Anatomical Human Shane Database / Hand-held Cameras / 移動カメラ画像列 / 多視点画像 / 形状データベース
Research Abstract

The purpose of this research project is establish a method for measuring 3D shapes of human parts with approximate 1mm accuracy from multiple viewpoint images by using database that consists of several hundreds 3D shapes of human parts.
In this research, we first pursue a method for measuring food shape from fixed and calibrated multiple cameras, and then have developed a pilot system that can easily reconstruct the shapes of foot shapes. By extending this method, we also established a method for recovering the shape of human facial/head area from an image sequence that captures multiple viewpoint images of the facial/head area with a handy camera that is moved freely by hand. In addition to this achievement, we also proposed a method for reconstructing facial shape from a frontal view image. Finally we extend those methods to a method for recovering facial shape from multiple viewpoint images taken by uncalibrated and unsynchronized multiple cameras, where we assume a situation that a object human's face is captured by surveillance cameras that are widely used for security purpose.
As results, we demonstrated the effectiveness of the proposed methods : 1) the method for reconstructing food shape from multiple calibrated cameras, 2) the method for reconstructing facial/head area shape from multiple viewpoint images that are captured with a handy camera moving freely with a hand, 3) the method for reconstructing facial/head area shape from a single image captured from the front of the face with a single point illumination placed at the same position of the camera, and 4) the method for reconstructing facial/head area shape from a single image captured from the front of the face with a single point illumination placed at the same position of the camera, and 5) the method for reconstructing facial/head area shape from multiple viewpoint images captured with uncalibrated and unsynchronized multiple cameras.

Report

(4 results)
  • 2007 Annual Research Report   Final Research Report Summary
  • 2006 Annual Research Report
  • 2005 Annual Research Report
  • Research Products

    (45 results)

All 2008 2007 2006 2005 Other

All Journal Article (30 results) (of which Peer Reviewed: 10 results) Presentation (14 results) Remarks (1 results)

  • [Journal Article] 3D-Face model Reconstruction Utilizing Facial Shape Database from Multiple Uncalibrated Cameras2008

    • Author(s)
      Toshio Takeuchi, Hideo Saito, Masaaki Mochimaru
    • Journal Title

      Poster Proceedings of WSCG 2008

      Pages: 9-12

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Annual Research Report 2007 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] PCA Based 3D Shape Reconstruction of Human Foot Using Multiple Viewpoint Cameras2008

    • Author(s)
      Edmee Amstutz, Tomoaki Teshima, Makoto Kimura, Masaaki Mochimaru and Hideo Saito
    • Journal Title

      Proceedings of 6th International Conference on Computer Vision Systems(ICVS2008), Lecture Notes in Computer Science 5008 5008

      Pages: 161-170

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] PCA Based 3D Shape Reconstruction of Human Foot Using Multiple Viewpoint Cameras2008

    • Author(s)
      E.Amstutz, T.Teshima, M.Kimura, H.Saito, M.Mochimaru
    • Journal Title

      International Journal of Automation and Computing (accepted for publication) (未定)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] 3D-Face model Reconstruction Utilizing Facial Shape Database from Multiple Uncalibrated Cameras2008

    • Author(s)
      Toshio, Takeuchi, Hideo, Saito, Masaaki, Mochimaru
    • Journal Title

      Poster Proceedings of WSCG 2008

      Pages: 9-12

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] PCA Based 3D Shape Reconstruction of Human Foot Using Multiple Viewpoint Cameras2008

    • Author(s)
      Edmee, Amstutz, Tomoaki, Teshima, Makoto, Kimura, Masaaki, Mochimaru, Hideo, Saito
    • Journal Title

      Proceedings of 6th International Conference on Computer Vision Systems(ICVS2008), Lecture Notes in Computer Science 5008

      Pages: 161-170

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] PCA Based 3D Shape Reconstruction of Human Foot Using Multiple Viewpoint Cameras2008

    • Author(s)
      E., Amstutz, T., Teshima, M., Kimura, H., Saito, M., Mochimaru
    • Journal Title

      International Journal of Automation and Computing (accepted for publication)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] PCA Based 3D Shape Reconstruction of Human Foot Using Multiple Viewpoint Cameras2008

    • Author(s)
      E. Amstutz, T. teshima, M. Kimura, H. Saito, M. Mochimaru
    • Journal Title

      International Journal of Automation and Computing(accepted for publication)

    • Related Report
      2007 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 非同期多視点カメラからの顔の3次元復元2007

    • Author(s)
      竹内 敏夫、斎藤 英雄、持丸 正明
    • Journal Title

      MIRU2007画像の認識、理解シンポジウム論文集

      Pages: 1289-1294

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] Face Shape Reconstruction from Image Sequence Taken with Monocular Camera using Shape Database2007

    • Author(s)
      Hideo Saito, Yosuke Ito, Masaaki Mochimaru
    • Journal Title

      Proc. 14th International Conference on Image Analysis and Processing(ICIAP2007)

      Pages: 165-170

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Annual Research Report 2007 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] Multiple cameras based method to reconstruct the 3D shape of humans' foot2007

    • Author(s)
      E.Amstutz, T.Teshima, H.Saito Masaaki Mochimaru
    • Journal Title

      Proc. ACCV'07 Workshop on Multi-dimensional and Multi-view Image Processing

      Pages: 66-72

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] 3D-Face model Reconstruction from Asynchronous Multi-view cameras2007

    • Author(s)
      Toshio, Takeuchi, Hideo, Saito, Masaaki, Mochimaru
    • Journal Title

      Proceedings on Meeting on Image Recognition and Understanding(MIRU2007)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] Face Shape Reconstruction from Image Sequence Taken with Monocular Camera using Shape Database2007

    • Author(s)
      Hideo, Saito, Yosuke, Ito, Masaaki, Mochimaru
    • Journal Title

      Proc. 14th International Conference on Image Analysis and Processing (ICIAP2007)

      Pages: 165-170

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] Mochimaru Multiple cameras based method to reconstruct the 3D shape of humans' foot2007

    • Author(s)
      E., Amstutz, T., Teshima, H., Saito, Masaaki
    • Journal Title

      Proc. ACCV'07 Workshop on Multi-dimensiona 1 and Multi-view Image Processing

      Pages: 66-72

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] 非同期多視点カメラからの顔の3次元復元2007

    • Author(s)
      竹内 敏夫、斎藤 英雄、持丸 正明
    • Journal Title

      MIRU2007画像の認識・理解シンポジウム論文集

    • Related Report
      2007 Annual Research Report
  • [Journal Article] Multiple cameras based method to reconstruct the 3D shape of humans'foot2007

    • Author(s)
      E. Amstutz, T. Teshima, H. Saito, Masaaki Mochimaru
    • Journal Title

      Proc. ACCV'07 Workshop on Multidimensional and Multi-view Image Processing

    • Related Report
      2007 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Human Foot Reconstruction fromMultiple Camera Images with Foot Shape Database2006

    • Author(s)
      Jiahui WANG, Hideo SAITO, Makoto KIMURA, Masaaki MOCHIMARU, Takeo KANADE
    • Journal Title

      IEICE TRANSACTIONS on Information and Systems E89-D,5

      Pages: 1732-1742

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] Reconstruction of 3D Face Model from Single Shading Image Based on Anatomical Database2006

    • Author(s)
      K.Yoshiki, H.Saito, M.Mochimaru
    • Journal Title

      Proceedings of the 18th International Conference on Pattern Recognition 3

      Pages: 350-353

    • NAID

      110004788367

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] 単眼カメラ画像列からの解剖学的顔形状データベースを用いた顔形状復元2006

    • Author(s)
      伊藤 洋輔, 斎藤 英雄, 持丸 正明
    • Journal Title

      MIRU2006画像の認識、理解シンポジウム

      Pages: 764-769

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] 解剖学的データベースを用いた単眼陰影画像からの顔形状復元2006

    • Author(s)
      吉城 香織, 斎藤 英雄, 持丸 正明
    • Journal Title

      MIRU2006画像の認識、理解シンポジウム

      Pages: 1201-1206

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] Human Foot Reconstruction from Multiple Camera Images with Foot Shape Database2006

    • Author(s)
      Jiahui, WANG, Hideo, SAITO, Makoto, KIMURA, Masaaki, MOCHIMARU, Takeo, KANADE
    • Journal Title

      IEICE TRANSACTIONS on Information and Systems Vol. E89-D, No. 5

      Pages: 1732-1742

    • NAID

      110007503085

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] Reconstruction of 3D Face Model from Single Shading Image Based on Anatomical Database2006

    • Author(s)
      K., Yoshiki, H., Saito, M., Mochimaru
    • Journal Title

      Proceedings of the 18th International Conference on Pattern Recognition Vol. 3

      Pages: 350-353

    • NAID

      110004788367

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] Face Shape Reconstruction from Image Sequence Taken with Monocular Camera Using Anatomical Face Shape Database2006

    • Author(s)
      Yosuke, Ito, Hideo, Saito, Masaaki, Mochimaru
    • Journal Title

      Proceedings on Meeting on Image Recognition and Understanding (MIRU2006)

      Pages: 764-769

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] Reconstruction of 3D Face Model from Single Shading Image Based on Anatomical Database2006

    • Author(s)
      Kaori, Yoshiki, Hideo, Saito, Masaaki, Mochimaru
    • Journal Title

      Proceedings on Meeting on Image Recognition and Understanding (MIRU2006)

      Pages: 1201-1206

    • NAID

      110004788367

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] Human Foot Reconstruction from Multiple Camera Images with Foot Shape Database2006

    • Author(s)
      Jiahui WANG, Hideo SAITO, Makoto KIMURA, Masaaki MOCHIMARU, Takeo KANADE
    • Journal Title

      IEICE TRANSACTIONS on Information and Systems E89-D, 5

      Pages: 1732-1742

    • NAID

      110007503085

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Reconstruction of 3D Face Model from Single Shading Image Based on Anatomical Database2006

    • Author(s)
      K.Yoshiki, H.Saito, M.Mochimaru
    • Journal Title

      The 18th International Conference on Pattern Recognition 3

      Pages: 350-353

    • NAID

      110004788367

    • Related Report
      2006 Annual Research Report
  • [Journal Article] 単眼カメラ画像列からの解剖学的顔形状データベースを用いた顔形状復元2006

    • Author(s)
      伊藤洋輔, 斎藤英雄, 持丸正明
    • Journal Title

      MIRU2006画像の認識・理解シンポジウム

      Pages: 764-769

    • Related Report
      2006 Annual Research Report
  • [Journal Article] 解剖学的データベースを用いた単眼陰影画像からの顔形状復元2006

    • Author(s)
      吉城香織, 斎藤英雄, 持丸正明
    • Journal Title

      MIRU2006画像の認識・理解シンポジウム

      Pages: 1201-1206

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Shape Reconstruction of Human Foot from Multi-Camera Images Based on PCA of Human Shape Database2005

    • Author(s)
      Jiahui WANG, Hideo SAITO, Makoto KIMURA, Masaaki MOCHIMARU, Takeo KANADE
    • Journal Title

      Proceedings of Fifth International Conference on 3-D Digital Imaging and Modeling (3DIM2005)

      Pages: 424-431

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] Shape Reconstruction of Human Foot from Multi-Camera Images Based on PCA of Human Shape Database2005

    • Author(s)
      Jiahui, WANG, Hideo, SAITO, Makoto, KIMURA, Masaaki, MOCHIMARU, Takeo, KANADE
    • Journal Title

      Proceedings of Fifth International Conference on 3-D Digital Imaging and Modeling (3DIM2005)

      Pages: 424-431

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] Shape Reconstruction of Human Foot from Multi-Camera Images Based on PCA of Human Shape Database2005

    • Author(s)
      Jiahui Wang
    • Journal Title

      Proceedings of Fifth International Conference on 3-D Digital Imaging and Modeling (3DIM2005)

      Pages: 424-431

    • Related Report
      2005 Annual Research Report
  • [Presentation] Reconstruction of 3D Facial Shape from Pan-Tilt Camera Image Sequence with Anatomic Face Tracking2008

    • Author(s)
      Seiji, Suzuki, Hideo, Saito, Masaaki, Mochimaru
    • Organizer
      IPSJ-SIG-CVIM
    • Place of Presentation
      Kyoto University
    • Year and Date
      2008-05-08
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] 3D shape reconstruction of human foot using deformable models and multi viewpoint cameras system2008

    • Author(s)
      E.Amstutz, T.Teshima, M. Kimura, M.Mochimaru, H.Saito
    • Organizer
      電子情報通信学会2008総合大会
    • Place of Presentation
      北九州、早稲田大学大学院
    • Year and Date
      2008-03-20
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] 解剖学的データベースを用いたパンチルトカメラ画像群からの3次元顔形状復元2008

    • Author(s)
      鈴木 誠司、斎藤 英雄、持丸 正明
    • Organizer
      電子情報通信学会2008総合大会
    • Place of Presentation
      北九州、早稲田大学大学院
    • Year and Date
      2008-03-20
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] 3D shape reconstruction of human foot using deformable models and multi viewpoint cameras system2008

    • Author(s)
      E., Amstutz, T., Teshima, M., Kimura, M., Mochimaru, H., Saito
    • Organizer
      IEICE General Conferece 2008
    • Place of Presentation
      Kita-Kyushu, Waseda University
    • Year and Date
      2008-03-20
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] Reconstruction of 3D Facial Shape from Pan-Tilt Camera Image Sequence with Anatomic Face Tracking2008

    • Author(s)
      Seiji, Suzuki, Hideo, Saito, Masaaki, Mochimaru
    • Organizer
      IEICE General Conferece 2008
    • Place of Presentation
      Kita-Kyushu, Waseda University
    • Year and Date
      2008-03-20
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] 3D shape reconstruction of human foot using defbrmable models and multi viewpoint cameras system2008

    • Author(s)
      E. Amstutz, T. Teshima, M. Kimura, M. Mochimaru, H. Saito
    • Organizer
      電子情報通信学会2008総合大会
    • Place of Presentation
      北九州・早稲田大学大学院
    • Year and Date
      2008-03-20
    • Related Report
      2007 Annual Research Report
  • [Presentation] 解剖学的データベースを用いたパンチルトカメラ画像群からの3次元顔形状復元2008

    • Author(s)
      鈴木 誠司・斎藤 英雄・持丸 正明
    • Organizer
      電子情報通信学会2008総合大会
    • Place of Presentation
      北九州・早稲田大学大学院
    • Year and Date
      2008-03-20
    • Related Report
      2007 Annual Research Report
  • [Presentation] 非同期多視点カメラからの顔の3次元復元2007

    • Author(s)
      竹内 敏夫, 斎藤 英雄, 持丸 正明
    • Organizer
      電子情報通信学会2007総合大会
    • Place of Presentation
      名城大学
    • Year and Date
      2007-03-21
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] 3D-Face model Reconstruction from Asynchronous Multi-view cameras2007

    • Author(s)
      Toshio, Takeuchi, Hideo, Saito, Masaaki, Mochimaru
    • Organizer
      IEICE General Conference 2007
    • Place of Presentation
      Meijo-University
    • Year and Date
      2007-03-21
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] 解剖学的データベースを用いた単眼陰影画像からの3次元顔モデル復元2006

    • Author(s)
      吉城 香織, 斎藤 英雄, 持丸 正明
    • Organizer
      電子情報通信学会2006総合大会
    • Place of Presentation
      国士舘大学
    • Year and Date
      2006-03-24
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] Reconstruction of 3D Face Model from Single Shading Image Based on Anatomical Database2006

    • Author(s)
      Kaori, Yoshiki, Hideo, Saito, Masaaki, Mochimaru
    • Organizer
      IEICE General Conference 2006
    • Place of Presentation
      Kokushikan-University
    • Year and Date
      2006-03-24
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] 解剖学的データベースを用いた単眼陰影画像からの3次元顔モデル復元2006

    • Author(s)
      吉城 香織, 斎藤 英雄, 持丸 正明
    • Organizer
      電子情報通信学会技術報告, PRMU2005
    • Place of Presentation
      九州大学
    • Year and Date
      2006-03-17
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] Reconstruction of 3D Face Model from Single Shading Image Based on Anatomical Database2006

    • Author(s)
      Kaori, Yoshiki, Hideo, Saito, Masaaki, Mochimaru
    • Organizer
      IPSJ SIG Notes. CVIM
    • Place of Presentation
      Kyushu University
    • Year and Date
      2006-03-17
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] パンチルトカメラにより自動追跡撮影された顔画像列からの3次元顔形状復元2005

    • Author(s)
      鈴木 誠司, 斎藤 英雄, 持丸 正明
    • Organizer
      情報処理学会コンピュータビジョンとイメージメディア研究会
    • Place of Presentation
      京都大学
    • Year and Date
      2005-05-08
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Remarks]

    • URL

      http://www.hvrl.ics.keio.ac.jp

    • Related Report
      2007 Annual Research Report

URL: 

Published: 2005-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi