• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

3D Visual Media Generation and Mixed Reality Presentation by Cooperative Use of Multiple Handheld Cameras

Research Project

Project/Area Number 21500178
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field Perception information processing/Intelligent robotics
Research InstitutionKeio University

Principal Investigator

SAITO Hideo  慶應義塾大学, 理工学部, 教授 (90245605)

Project Period (FY) 2009 – 2011
Project Status Completed (Fiscal Year 2011)
Budget Amount *help
¥3,900,000 (Direct Cost: ¥3,000,000、Indirect Cost: ¥900,000)
Fiscal Year 2011: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2010: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2009: ¥1,690,000 (Direct Cost: ¥1,300,000、Indirect Cost: ¥390,000)
Keywords多視点カメラ / 複合現実 / 拡張現実 / ARマーカ / SLAM / 多視点映像 / 携帯端末 / キーポイント / キーボイント / パーティクルフィルタ
Research Abstract

In this research project, we propose a method for simultaneously estimating the positions and poses of multiple cameras, so that we can present additional information onto the capture videos, or obstacle removed videos, for achieving extended mixed reality display. To demonstrate the effectiveness of the proposed methods, we develop a system for real-time mixed reality display using multiple smart-phones. In this system. We can perform real-time processing because we send each camera image to PC which returns obstacle-removed images at every frame.

Report

(4 results)
  • 2011 Annual Research Report   Final Research Report ( PDF )
  • 2010 Annual Research Report
  • 2009 Annual Research Report
  • Research Products

    (32 results)

All 2012 2011 2010 2009 Other

All Journal Article (8 results) (of which Peer Reviewed: 8 results) Presentation (23 results) Remarks (1 results)

  • [Journal Article] Foldable augmented maps2012

    • Author(s)
      Sandy Martedi, Hideaki Uchiyama, Guillermo Enriquez, Hideo Saito, Tsutomu Miyashita and Takenori Hara
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: vol.E95-D Pages: 256-266

    • NAID

      10030539131

    • Related Report
      2011 Annual Research Report 2011 Final Research Report
    • Peer Reviewed
  • [Journal Article] Diminished reality using plane-sweep algorithm with weakly-calibrated cameras2011

    • Author(s)
      Songkran Jarusirisawad, Takahide Hosokawa, and Hideo Saito
    • Journal Title

      Progress in Informatics

      Volume: No.7 Pages: 11-20

    • NAID

      110007536080

    • Related Report
      2011 Final Research Report 2010 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Camera tracking by online learning of keypoint arrangements using LLAH in augmented reality applications2010

    • Author(s)
      Hideaki Uchiyama, Hideo Saito, Myriam Servieres, Guillaume Moreau
    • Journal Title

      Virtual Reality

    • Related Report
      2011 Final Research Report
    • Peer Reviewed
  • [Journal Article] セルヴィエルミリアム,モロギヨム,交差点マーク付き地図と交差点データベースを用いた地理データマッチングに基づくGISデータのAR.提示システム2010

    • Author(s)
      内山英昭, 斎藤英雄
    • Journal Title

      映像情報メディア学会誌

      Volume: Vbl. 64, No.4 Pages: 563-569

    • Related Report
      2011 Final Research Report
    • Peer Reviewed
  • [Journal Article] Camera tracking by online learning of keypoint arrangements using LLAH in augmented reality applications2010

    • Author(s)
      Hideaki Uchiyama, Hideo Saito, Myriam Servieres, Guillaume Moreau
    • Journal Title

      Virtual Reality(Springer)

      Volume: (電子出版)

    • Related Report
      2010 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 交差点マーク付き地図と交差点データベースを用いた地理データマッチングに基づくGISデータのAR提示システム2010

    • Author(s)
      内山英昭, 斎藤英雄, セルヴィエルミリアム, モロギョム
    • Journal Title

      映像情報メディア学会誌

      Volume: Vol.64, No.4 Pages: 563-569

    • NAID

      10025989066

    • Related Report
      2010 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Complemental Use of Multiple Cameras for Stable Tracking of Multiple Markers2009

    • Author(s)
      Yuki Arai and Hideo Saito
    • Journal Title

      Lecture Notes in Computer Science

      Volume: Volume 5622/2009 Pages: 421-430

    • Related Report
      2011 Final Research Report
    • Peer Reviewed
  • [Journal Article] Complemental Use of Multiple Cameras for Stable Tracking of Multiple Markers2009

    • Author(s)
      Yuki Arai, Hideo Saito
    • Journal Title

      Lecture Notes in Computer Science Volume5622/2009

      Pages: 421-430

    • Related Report
      2009 Annual Research Report
    • Peer Reviewed
  • [Presentation] コンピュータビジョンによる3D映像生成と実世界提示2012

    • Author(s)
      斎藤英雄
    • Organizer
      第20回サイバーワールド(CW)研究会
    • Place of Presentation
      東京電通大
    • Year and Date
      2012-03-08
    • Related Report
      2011 Final Research Report
  • [Presentation] コンピュータビジョンによる3D映像生成と実世界提示2012

    • Author(s)
      斎藤英雄
    • Organizer
      第20回サイバーワールド(CW)研究会
    • Place of Presentation
      東京電通大(招待講演)
    • Year and Date
      2012-03-08
    • Related Report
      2011 Annual Research Report
  • [Presentation] Texture overlay onto non-rigid surface using commodity depth camera2012

    • Author(s)
      Hayashi, T., de Sorbier, F., Saito, H.
    • Organizer
      International Conference on Computer Vision Theory and Applications 2012(VISAPP2012)
    • Place of Presentation
      ローマ
    • Year and Date
      2012-02-24
    • Related Report
      2011 Final Research Report
  • [Presentation] Texture overlay onto non-rigid surface using commodity depth camera2012

    • Author(s)
      Hayashi, T., de Sorbier, F., Saito, H.
    • Organizer
      International Conference on Computer Vision Theory and Applications 2012 (VISAPP2012)
    • Place of Presentation
      ローマ、イタリア
    • Year and Date
      2012-02-24
    • Related Report
      2011 Annual Research Report
  • [Presentation] Real-Time Diminished Reality using Multiple Smartphones2011

    • Author(s)
      Toshihiro Honda, Takuya Inoue and Hideo Saito
    • Organizer
      21st International Conference on Artificial Reality and Telexistence(ICAT2011)
    • Place of Presentation
      大阪
    • Year and Date
      2011-11-28
    • Related Report
      2011 Final Research Report
  • [Presentation] マーカーレスARのための生成型学習による平面トラッキング2011

    • Author(s)
      吉田拓洋, 斎藤英雄, 清水雅芳, 田口哲典
    • Organizer
      第16回日本バーチャルリアリティ学会大会
    • Place of Presentation
      はこだて未来大学
    • Year and Date
      2011-09-20
    • Related Report
      2011 Annual Research Report 2011 Final Research Report
  • [Presentation] 対象環境の線分情報を用いた実時間SLAM2011

    • Author(s)
      廣瀬圭佑, 斎藤英雄
    • Organizer
      第14回画像の認識・理解シンポジウム(MIRU2011)
    • Place of Presentation
      石川県金沢市
    • Year and Date
      2011-07-21
    • Related Report
      2011 Final Research Report
  • [Presentation] 対象環境の線分情報を用いた実時間SLAM2011

    • Author(s)
      廣瀬圭佑、斎藤英雄
    • Organizer
      第14回画像の認識・理解シンポジウム
    • Place of Presentation
      石川県金沢市
    • Year and Date
      2011-07-21
    • Related Report
      2011 Annual Research Report
  • [Presentation] Interactive AR system for visualization of figure skating using PTAM2011

    • Author(s)
      Mingliang Wang, Takuya Inoue, Yuko Uematsu, Hideo Saito
    • Organizer
      第14回画像の認識・理解シンポジウム(MIRU2011)
    • Place of Presentation
      石川県金沢市
    • Year and Date
      2011-07-20
    • Related Report
      2011 Final Research Report
  • [Presentation] Interactive AR system for visualization of figure skating using PTAM2011

    • Author(s)
      Mingliang Wang, Takuya Inoue, Yuko Uematsu, Hideo Saito
    • Organizer
      第14回画像の認識・理解シンポジウム
    • Place of Presentation
      石川県金沢市
    • Year and Date
      2011-07-20
    • Related Report
      2011 Annual Research Report
  • [Presentation] Computer Vision for 3DTV and Augmented Reality2011

    • Author(s)
      Hideo Saito
    • Organizer
      International Symposium on Ubiquitous Virtual Reality(ISUVR) 2011
    • Place of Presentation
      韓国済州島
    • Year and Date
      2011-07-02
    • Related Report
      2011 Final Research Report
  • [Presentation] Computer Vision for 3DTV and Augmented Reality2011

    • Author(s)
      Hideo Saito
    • Organizer
      International Symposium on Ubiquitous Virtual Reality (ISUVR), 2011
    • Place of Presentation
      韓国済州島(招待講演)
    • Year and Date
      2011-07-02
    • Related Report
      2011 Annual Research Report
  • [Presentation] Skeleton Features Distribution for 3D Object Retrieval2011

    • Author(s)
      Tomoki Hayashi, Benjamin Raynal, Vincent Nozick, Hideo Saito
    • Organizer
      APR CONFERENCE ON MACHINE VISION APPLIcArIoNs(MVA2011)
    • Place of Presentation
      奈良
    • Year and Date
      2011-06-14
    • Related Report
      2011 Final Research Report
  • [Presentation] Automatic Road Extraction from Printed Maps2011

    • Author(s)
      Sebastien Callier, Hideo Saito
    • Organizer
      IAPR CONFERENCE ON MACHINE VISION APPLICATIONS(MVA2011)
    • Place of Presentation
      奈良
    • Year and Date
      2011-06-14
    • Related Report
      2011 Annual Research Report 2011 Final Research Report
  • [Presentation] Skeleton Features Distribution for 3D Object Retrieval2011

    • Author(s)
      Tomoki Hayashi, Benjamin Raynal, Vincent Nozick, Hideo Saito
    • Organizer
      IAPR CONFERENCE ON MACHINE VISION APPLICATIONS (MVA2011)
    • Place of Presentation
      奈良
    • Year and Date
      2011-06-14
    • Related Report
      2011 Annual Research Report
  • [Presentation] Real-Time SLAM Using Line Segments2011

    • Author(s)
      Keisuke Hirose and Hideo Saito
    • Organizer
      The 4th Korea-Japan Workshop on Mixed Reality(KJMR2011)
    • Place of Presentation
      大阪
    • Year and Date
      2011-04-17
    • Related Report
      2011 Final Research Report
  • [Presentation] Planar Object Tracking by Clustering of Feature Descriptors for Markerless Augmented Reality2011

    • Author(s)
      Takumi Yoshida, Hideo Saito
    • Organizer
      The 4th Korea-Japan Workshop on Mixed Reality(KJMR2011)
    • Place of Presentation
      大阪
    • Year and Date
      2011-04-17
    • Related Report
      2011 Final Research Report
  • [Presentation] Planar Object Tracking by Clustering of Feature Descriptors for Marker less Augmented Reality2011

    • Author(s)
      Takumi Yoshida, Hideo Saito
    • Organizer
      The 4th Korea-Japan Workshop on Mixed Reality (KJMR2011)
    • Place of Presentation
      大阪
    • Year and Date
      2011-04-17
    • Related Report
      2011 Annual Research Report
  • [Presentation] Real-Time SLAM Using Line Segments2011

    • Author(s)
      Keisuke Hirose, Hideo Saito
    • Organizer
      The 4th Korea-Japan Workshop on Mixed Reality (KJMR2011)
    • Place of Presentation
      大阪
    • Year and Date
      2011-04-17
    • Related Report
      2011 Annual Research Report
  • [Presentation] Foldable Augmented Maps2010

    • Author(s)
      Sandy Martedi, Hideaki Uchiyama, Guillermo Enriquez, Hideo Saito, Tsutomu Miyashita and Takenori Hara
    • Organizer
      IEEE International Symposium on Mixed and Augmented Reality(ISMAR2010)
    • Place of Presentation
      ソウル、韓国
    • Year and Date
      2010-10-14
    • Related Report
      2011 Final Research Report
  • [Presentation] Foldable Augmented Maps2010

    • Author(s)
      Sandy Martedi, Hideaki Uchiyama, Guillermo Enriquez, Hideo Saito, Tsutomu Miyashita, Takenori Hara
    • Organizer
      IEEE International Symposium on Mixed and Augmented Reality 2010
    • Place of Presentation
      ソウル、韓国
    • Year and Date
      2010-10-14
    • Related Report
      2010 Annual Research Report
  • [Presentation] Interactive paper maps : Merging AR visualization using keypoint tracking and hand gesture based interaction2010

    • Author(s)
      Guillermo Ignacio Enriquez, Hideaki Uchiyama, Martedi Sandy, Hideo Saito, Tsutomu Miyashitaand Takenori Hara
    • Organizer
      The 3rd Korea-Japan Workshop on Mixed Reality(KJMR2010)
    • Place of Presentation
      慶州、韓国
    • Year and Date
      2010-04-24
    • Related Report
      2011 Final Research Report
  • [Presentation] Interactive paper maps : Merging AR visualization using keypoint tracking and hand gesture based interaction2010

    • Author(s)
      Guillermo Ignacio Enriquez, Hideaki Uchiyama, Martedi Sandy, Hideo Saito, Tsutomu Miyashita, Takenori Hara
    • Organizer
      The 3rd Korea-Japan Workshop on Mixed Reality (KJMR2010)
    • Place of Presentation
      慶州、韓国
    • Year and Date
      2010-04-24
    • Related Report
      2010 Annual Research Report
  • [Remarks]

    • URL

      http://www.hvrl.ics.keio.ac.jp/

    • Related Report
      2011 Annual Research Report

URL: 

Published: 2009-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi