3D Visual Media Generation and Mixed Reality Presentation by Cooperative Use of Multiple Handheld Cameras

2011 Fiscal Year Final Research Report

• Project/Area Number: 21500178
• Research Category: Grant-in-Aid for Scientific Research (C)
• Allocation Type: Single-year Grants
• Section: 一般
• Research Field: Perception information processing/Intelligent robotics
• Research Institution: Keio University
• Principal Investigator: SAITO Hideo 慶應義塾大学, 理工学部, 教授 (90245605)
• Project Period (FY): 2009 – 2011
• Keywords: 多視点カメラ / 複合現実 / 拡張現実 / ARマーカ / SLAM / 多視点映像 / 携帯端末 / キーポイント

Research Abstract

In this research project, we propose a method for simultaneously estimating the positions and poses of multiple cameras, so that we can present additional information onto the capture videos, or obstacle removed videos, for achieving extended mixed reality display. To demonstrate the effectiveness of the proposed methods, we develop a system for real-time mixed reality display using multiple smart-phones. In this system. We can perform real-time processing because we send each camera image to PC which returns obstacle-removed images at every frame.

Research Products

• [Journal Article] Foldable augmented maps (2012)
  • Author(s): Sandy Martedi, Hideaki Uchiyama, Guillermo Enriquez, Hideo Saito, Tsutomu Miyashita and Takenori Hara
  • Journal Title: IEICE Transactions on Information and Systems Volume: vol.E95-D Pages: 256-266
  • Peer Reviewed
• [Journal Article] Diminished reality using plane-sweep algorithm with weakly-calibrated cameras (2011)
  • Author(s): Songkran Jarusirisawad, Takahide Hosokawa, and Hideo Saito
  • Journal Title: Progress in Informatics Volume: No.7 Pages: 11-20
  • Peer Reviewed
• [Journal Article] Camera tracking by online learning of keypoint arrangements using LLAH in augmented reality applications (2010)
  • Author(s): Hideaki Uchiyama, Hideo Saito, Myriam Servieres, Guillaume Moreau
  • Journal Title: Virtual Reality
  • DOI: DOI:10.1007/s10055-0l0-0l73-7
  • Peer Reviewed
• [Journal Article] セルヴィエルミリアム,モロギヨム,交差点マーク付き地図と交差点データベースを用いた地理データマッチングに基づくGISデータのAR.提示システム (2010)
  • Author(s): 内山英昭, 斎藤英雄
  • Journal Title: 映像情報メディア学会誌 Volume: Vbl. 64, No.4 Pages: 563-569
  • Peer Reviewed
• [Journal Article] Complemental Use of Multiple Cameras for Stable Tracking of Multiple Markers (2009)
  • Author(s): Yuki Arai and Hideo Saito
  • Journal Title: Lecture Notes in Computer Science Volume: Volume 5622/2009 Pages: 421-430
  • Peer Reviewed
• [Presentation] コンピュータビジョンによる3D映像生成と実世界提示 (2012)
  • Author(s): 斎藤英雄
  • Organizer: 第20回サイバーワールド(CW)研究会
  • Place of Presentation: 東京電通大
  • Year and Date: 2012-03-08
• [Presentation] Texture overlay onto non-rigid surface using commodity depth camera (2012)
  • Author(s): Hayashi, T., de Sorbier, F., Saito, H.
  • Organizer: International Conference on Computer Vision Theory and Applications 2012(VISAPP2012)
  • Place of Presentation: ローマ
  • Year and Date: 2012-02-24
• [Presentation] Real-Time Diminished Reality using Multiple Smartphones (2011)
  • Author(s): Toshihiro Honda, Takuya Inoue and Hideo Saito
  • Organizer: 21st International Conference on Artificial Reality and Telexistence(ICAT2011)
  • Place of Presentation: 大阪
  • Year and Date: 2011-11-28
• [Presentation] マーカーレスARのための生成型学習による平面トラッキング (2011)
  • Author(s): 吉田拓洋, 斎藤英雄, 清水雅芳, 田口哲典
  • Organizer: 第16回日本バーチャルリアリティ学会大会
  • Place of Presentation: はこだて未来大学
  • Year and Date: 2011-09-20
• [Presentation] 対象環境の線分情報を用いた実時間SLAM (2011)
  • Author(s): 廣瀬圭佑, 斎藤英雄
  • Organizer: 第14回画像の認識・理解シンポジウム(MIRU2011)
  • Place of Presentation: 石川県金沢市
  • Year and Date: 2011-07-21
• [Presentation] Interactive AR system for visualization of figure skating using PTAM (2011)
  • Author(s): Mingliang Wang, Takuya Inoue, Yuko Uematsu, Hideo Saito
  • Organizer: 第14回画像の認識・理解シンポジウム(MIRU2011)
  • Place of Presentation: 石川県金沢市
  • Year and Date: 2011-07-20
• [Presentation] Computer Vision for 3DTV and Augmented Reality (2011)
  • Author(s): Hideo Saito
  • Organizer: International Symposium on Ubiquitous Virtual Reality(ISUVR) 2011
  • Place of Presentation: 韓国済州島
  • Year and Date: 2011-07-02
• [Presentation] Skeleton Features Distribution for 3D Object Retrieval (2011)
  • Author(s): Tomoki Hayashi, Benjamin Raynal, Vincent Nozick, Hideo Saito
  • Organizer: APR CONFERENCE ON MACHINE VISION APPLIcArIoNs(MVA2011)
  • Place of Presentation: 奈良
  • Year and Date: 2011-06-14
• [Presentation] Automatic Road Extraction from Printed Maps (2011)
  • Author(s): Sebastien Callier, Hideo Saito
  • Organizer: IAPR CONFERENCE ON MACHINE VISION APPLICATIONS(MVA2011)
  • Place of Presentation: 奈良
  • Year and Date: 2011-06-14
• [Presentation] Real-Time SLAM Using Line Segments (2011)
  • Author(s): Keisuke Hirose and Hideo Saito
  • Organizer: The 4th Korea-Japan Workshop on Mixed Reality(KJMR2011)
  • Place of Presentation: 大阪
  • Year and Date: 2011-04-17
• [Presentation] Planar Object Tracking by Clustering of Feature Descriptors for Markerless Augmented Reality (2011)
  • Author(s): Takumi Yoshida, Hideo Saito
  • Organizer: The 4th Korea-Japan Workshop on Mixed Reality(KJMR2011)
  • Place of Presentation: 大阪
  • Year and Date: 2011-04-17
• [Presentation] Foldable Augmented Maps (2010)
  • Author(s): Sandy Martedi, Hideaki Uchiyama, Guillermo Enriquez, Hideo Saito, Tsutomu Miyashita and Takenori Hara
  • Organizer: IEEE International Symposium on Mixed and Augmented Reality(ISMAR2010)
  • Place of Presentation: ソウル、韓国
  • Year and Date: 2010-10-14
• [Presentation] Interactive paper maps : Merging AR visualization using keypoint tracking and hand gesture based interaction (2010)
  • Author(s): Guillermo Ignacio Enriquez, Hideaki Uchiyama, Martedi Sandy, Hideo Saito, Tsutomu Miyashitaand Takenori Hara
  • Organizer: The 3rd Korea-Japan Workshop on Mixed Reality(KJMR2010)
  • Place of Presentation: 慶州、韓国
  • Year and Date: 2010-04-24