• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Reconstructing Shape and Texture of 3D Object by Active Wearable Vision Sensor

Research Project

Project/Area Number 14380161
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Intelligent informatics
Research InstitutionNational Institute of Informatics

Principal Investigator

SUGIMOTO Akihiro  National Institute of Informatics, Intelligent Systems Research Division, Associate Professor, 知能システム研究系, 助教授 (30314256)

Co-Investigator(Kenkyū-buntansha) MATSUYAMA Takashi  Kyoto University, Graduate School of Informatics, Professor, 大学院・情報学研究科, 教授 (10109035)
Project Period (FY) 2002 – 2004
Project Status Completed (Fiscal Year 2004)
Budget Amount *help
¥15,100,000 (Direct Cost: ¥15,100,000)
Fiscal Year 2004: ¥2,700,000 (Direct Cost: ¥2,700,000)
Fiscal Year 2003: ¥3,700,000 (Direct Cost: ¥3,700,000)
Fiscal Year 2002: ¥8,700,000 (Direct Cost: ¥8,700,000)
Keywordswearable vision sensor / shape reconstruction / surface reflectance / 3D image registration / motion estimation / computer vision / wearable vision / 装着型視角センサ / 視線情報 / ウェアラブルビジョン
Research Abstract

To establish man-machine interactions in the wearable computer environments, we studied reconstructing the shape and texture of a 3D object that a user takes in his hands through the active wearable vision sensor information. Obtained research results can be summarized as follows.
1.Detecting blink points of a person using active wearable vision sensor.
We developed a wearable vision sensor that consists of the detector of person's viewing lines and two active cameras. First, we established a method for calibrating the sensor so that it can detect person's blink points accurately even in a real situation such that the depth of blink points changes. Next, we proposed a method for detecting a gazing region of a person.
2.Shape reconstruction of a hand-held 3D object.
We proposed a registration method for range images that preserves local structures of object surfaces. The method introduces shape patterns and a skewness of correspondences, both of which are extracted from the local surface ne … More arby a point of interest in each image. These two features enable us to reconstruct full shape of a 3D object that preserves local structures of object surfaces.
3.Reflectance estimation of a 3D object under complex illumination.
We developed a method for recovering reflectance properties of a moving Lambertian object from an image sequence of the object taken by a fixed camera under unknown and complex illumination. Our method enables us to synthesize realistic images of the object in arbitrary poses under arbitrary lighting conditions by using the reconstructed shape and albedo.
4.Ego-motion estimation using active wearable vision sensor.
We proposed a method for incrementally estimating ego motion by two mounted active cameras. Our method independently controls the two cameras during the ego motion so that each camera automatically fixates its optical axisto its own fixation point. Two cameras do not have to share the common field of view in this case whereas in stereo vision they have to do. Less

Report

(4 results)
  • 2004 Annual Research Report   Final Research Report Summary
  • 2003 Annual Research Report
  • 2002 Annual Research Report
  • Research Products

    (35 results)

All 2005 2004 2003 2002 Other

All Journal Article (23 results) Publications (12 results)

  • [Journal Article] アクティブカメラの注視点制御に基づく自己運動の推定2005

    • Author(s)
      池田友彦, 杉本晃宏
    • Journal Title

      電子情報通信学会論文誌 J88-D II(掲載予定)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] 複雑照明下における運動物体の反射特性の推定2005

    • Author(s)
      杜非, 岡部孝弘, 佐藤洋一, 杉本晃宏
    • Journal Title

      電子情報通信学会論文誌 J88-D II(掲載予定)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Globally Convergent Range Image Registration by Graph Kernel Algorithm2005

    • Author(s)
      R.Sara, I.S.Okatani, A.Sugimoto
    • Journal Title

      Proc, of the 5th International Conference on 3-D Digital Imaging and Modeling (to appear.)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Globally Convergent Range Image Registration by Graph Kernel Algorithm2005

    • Author(s)
      R.Sara, I.S.Okatani, A.Sugimoto
    • Journal Title

      Proc. of The 5th International Conference on 3-D Digital Imaging and Modeling (発表予定)

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Diverging Viewing-Lines in Binocular Vision : A Method for Estimating Ego Motion by Mounted Active Cameras2004

    • Author(s)
      A.Sugimoto, T.Ikeda
    • Journal Title

      Proc. of the 5th Workshop on Omnidirectional Vision, Camera Networks and Non-classical Cameras

      Pages: 67-78

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] 物体表面の局所構造を保持する距離画像の位置合わせ2004

    • Author(s)
      岡谷(清水)郁子, 杉本晃宏
    • Journal Title

      情報処理学会CVIM研究会論文誌 Vol.45, No.SIG13(CVIM10)

      Pages: 99-109

    • NAID

      110002768499

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Estimating Ego Motion by Fixation Control of Mounted Active Cameras2004

    • Author(s)
      A.Sugimoto, W.Nagatomo, T.Matsuyama
    • Journal Title

      Proc. of ACCV

      Pages: 67-72

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Active Wearable Vision : Recognition of Human Activities and Environments2004

    • Author(s)
      K.Sumi, A.Sugimoto, T.Matsuyama, M.Toda, S.Tsukizawa
    • Journal Title

      Proc. of the 12th International Conference on Informatics Research for Development of Knowledge Society Infrastructure (ICKS'04)

      Pages: 15-22

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Reflectance Estimation from Motion under Complex Illumination2004

    • Author(s)
      D.Fei, T.Okabe, Y.Sato, A.Sugimoto
    • Journal Title

      Proc. of the 17th International Conference on Pattern Recognition (ICPR2004) Vol.III

      Pages: 218-222

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Range Image Registration Preserving Local Structures of Object Surfaces2004

    • Author(s)
      I.S.Okatani, A.Sugimoto
    • Journal Title

      Proc. of the 17th International Conference on Pattern Recognition (ICPR2004) Vol. II

      Pages: 224-228

    • NAID

      110002768499

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Registration of Range Images that Preserves Local Surface Structures and Colors2004

    • Author(s)
      I.S.Okatani, A.Sugimoto
    • Journal Title

      Proc. of 2nd Int. Symposium on 3D Data Processing, Visualization and Transmission (3DPVT)

      Pages: 789-796

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Diverging Viewing-Lines in Binocular Vision : A Method for Estimating Ego Motion by Mounted Active Cameras2004

    • Author(s)
      Akihiro Sugimoto, Tomohiko Ikeda
    • Journal Title

      Proc. of the 5th Workshop on Omnidirectional Vision, Camera Networks and Non-classical Cameras

      Pages: 67-78

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Reflectance Estimation from Motion under Complex Illumination2004

    • Author(s)
      Du Fei, Takahiro Okabe, Yoichi Sato, Akihiro Sugimoto
    • Journal Title

      Proceedings of the 17th International Conference on Pattern Recognition(ICPR'04) volume.III

      Pages: 218-222

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Range Image Registration Preserving Local Structures of Object Surfaces2004

    • Author(s)
      Ikuko Shimizu Okatani, Akihiro Sugimoto
    • Journal Title

      Proceedings of the 17th International Conference on Pattern Recognition(ICPR'04) volume.II

      Pages: 224-228

    • NAID

      110002768499

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Registration of Range Images that Preserves Local Surface Structures and Colors2004

    • Author(s)
      Ikuko Shimizu Okatani, Akihiro Sugimoto
    • Journal Title

      Proceedings of the 2nd Int. Symp. on 3D Data Processing, Visualization, and Transmission(3DPVT2004)

      Pages: 789-796

    • Related Report
      2004 Annual Research Report
  • [Journal Article] 物体表面の局所構造を保持する距離画像の位置合わせ2004

    • Author(s)
      岡谷(清水)郁子, 杉本晃宏
    • Journal Title

      情報処理学会論文誌コンピュータビジョンとイメージメディア Vol.45, No.SIG13(CVIM10)

      Pages: 99-109

    • NAID

      110002768499

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Active Wearable Vision Sensor : Detecting Person's Blink Points and Estimating Human Motion Trajectory2003

    • Author(s)
      A.Sugimoto, T.Matsuyama
    • Journal Title

      Proc. of IEEE/ASME International Conference on Advanced Intelligent Mechatronics

      Pages: 539-545

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Active Wearable Vision : Sensor Detecting Person's Blink Points and Estimating Human Motion Trajectory2003

    • Author(s)
      A.Sugimoto, T.Matsuyama
    • Journal Title

      Proc. of IEEE/ASME International Conference on Advanced Intelligent Mechatronics

      Pages: 539-545

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Diverging Viewing-Lines in Binocular Vision : A Method for Estimating Ego Motion by Mounted Active Cameras(invited paper)2003

    • Author(s)
      A.Sugimoto, T.Ikeda
    • Journal Title

      Proc. of Australia-Japan Advanced Workshop on Computer Vision

      Pages: 126-133

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Detecting a Gazing Region by Visual Direction and Stereo Cameras2002

    • Author(s)
      A.Sugimoto, A.Nakayama, T.Matsuyama
    • Journal Title

      Proc. of the 16th International Conference on Pattern Recognition Vol. III

      Pages: 278-282

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Detecting a Gazing Region by Visual Direction and Stereo Cameras2002

    • Author(s)
      A.Sugimoto, A.Nakayama, T.Matsuyama
    • Journal Title

      Proc. of the 16th International Conference on Pattern Recognition Vol.III

      Pages: 278-282

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Conic-Based Multiple View Geometry(invited paper)2002

    • Author(s)
      A.Sugimoto
    • Journal Title

      Proc. of the Workshop on Science of Computer Vision

      Pages: 109-116

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Active Wearable Vision : Sensor Detecting Person's Blink Points and Estimating Human Motion Trajectory.2002

    • Author(s)
      A.Sugimoto, T.Matsuyama
    • Journal Title

      Proc. of the 1st International Workshop on Man-Machine Symbiotic Systems

      Pages: 85-108

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Publications] 池田友彦, 杉本晃宏, 井宮淳: "注視点対応とオプティカルフローを利用したカメラ運動の推定"情報処理学会コンピュータビジョンとイメージメディア研究会. SIG-CVIM-138. 105-112 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] Akihiro Sugimoto, Takashi Matsuyama: "Active Wearable Vision Sensor -Detecting Person's Blink Points and Estimating Human Motion Trajectory-"2003 IEEE/ASME International Conference on Advanced Intelligent Mechatronics(AIM2003). 539-545 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] Du Fei, Takahiro Okabe, Yoichi Sato, Akihiro Sugimoto: "Reflectance Estimation under Complex Illumination"情報処理学会コンピュータビジョンとイメージメディア研究会. SIG-CVIM-140. 49-56 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] Akihiro Sugimoto, Tomohiko Ikeda: "Diverging Viewing-Lines in Binocular Vision : A Method for Estimating Ego Motion by Mounted Active Cameras"Australia-Japan Advanced Workshop on Computer Vision. 126-133 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 岡谷(清水)郁子, 杉本晃宏, 前川仁: "局所的位相構造評価を取り入れた距離画像の頑健な位置合わせ"情報処理学会コンピュータビジョンとイメージメディア研究会. SIG-CVIM-141. 71-78 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] A.Sugimoto, W.Nagatomo, T.Matsuyama: "Estimating Ego Motion by Fixation Control of Mounted Active Cameras"6^<th> Asian Conference on Computer Vision(ACCV2004). Vol.I. 67-72 (2004)

    • Related Report
      2003 Annual Research Report
  • [Publications] A.Sugimoto, A.Nakayama, T.Matsuyama: "Detecting a Gazing Region by Visual Direction and Stereo Cameras"Proc. of the 16^<th> International Conference on Pattern Recognition. Vol.III. 278-282 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] A.Sugimoto: "Conic-Based Multiple View Geometry"Proc. of the Workshop on Science of Computer Vision. 109-116 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] 杉本晃宏: "異種幾何特徴の相互乗り入れを目指して…ホモグラフィーを介したコニックと点との接点…"第45回自動制御連合講演会. 517-520 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] 杉本晃宏, 長友渉, 松山隆司: "装着型能動視覚センサを用いた人物の運動推定"画像の認識・理解シンポジウム(MIRU2002). Vol.1. 1-215-1-222 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] 築澤宗太郎, 杉本晃宏, 松山隆司: "装着型視覚センサを用いた対象の3次元形状復元"情報処理学会コンピュータビジョンとイメージメディア研究会. SIG-CVIM-133. 71-78 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] 山田大輔, 井宮淳, 杉本晃宏: "零空間探査法によるレンジフローの計算"情報処理学会コンピュータビジョンとイメージメディア研究会. SIG-CVIM-137. 125-132 (2003)

    • Related Report
      2002 Annual Research Report

URL: 

Published: 2002-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi