• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Research about Realtime Obstruct Eliminating System by using Multi Cameras

Research Project

Project/Area Number 15200008
Research Category

Grant-in-Aid for Scientific Research (A)

Allocation TypeSingle-year Grants
Section一般
Research Field Media informatics/Database
Research InstitutionThe University of Tokyo

Principal Investigator

HIROSE Michitaka  The University of Tokyo, Research Center for Advanced Science and Technology, Professor, 先端科学技術研究センター, 教授 (40156716)

Co-Investigator(Kenkyū-buntansha) HIROTA Koichi  The University of Tokyo, Graduate school Frontier Sciences, Associate Professor, 大学院・新領域創成科学研究科, 助教授 (80273332)
Project Period (FY) 2003 – 2005
Project Status Completed (Fiscal Year 2005)
Budget Amount *help
¥51,090,000 (Direct Cost: ¥39,300,000、Indirect Cost: ¥11,790,000)
Fiscal Year 2005: ¥13,910,000 (Direct Cost: ¥10,700,000、Indirect Cost: ¥3,210,000)
Fiscal Year 2004: ¥16,380,000 (Direct Cost: ¥12,600,000、Indirect Cost: ¥3,780,000)
Fiscal Year 2003: ¥20,800,000 (Direct Cost: ¥16,000,000、Indirect Cost: ¥4,800,000)
KeywordsObstacle Elimination / Multi Cameras / Realtime Processing / Novel View Synthesis / Spatial Information / 実時間障害物除去 / 障害物透視映像 / 障害物透視手法 / 自然特徴点抽出 / 特徴点クラスタリング / 障害物除去映像 / 画像処理 / 画像伝送 / コンピュータビジョン / ユピキタス / ユビキタス
Research Abstract

In this study, we proposed new approach to generate novel view from which obstacles are removed by using multiple cameras. To be utilized in public environment like city, the approach should have the flexibility and scalability against the alignment of cameras. By observing the obstacle-eliminated images from any point of view, user can understand an exactly ongoing event well.
Thus, we proposed projective transformation based algorism to generate images in real time. By clustering feature points of input images and subdividing images depend on the clustered points, our algorism can be applied to scene in which obstacles are located in front of complex objects. Afterward, by morphing images based on the subdivided images, our approach can generate images from any viewpoint between cameras.
In this work, we implemented a prototype capturing system based on the approach. The system consists of management PC and many cameras and node PCs. To maintain the performance of the system, the cameras should not be manage by one PC, and therefore we use node PCs which are connected to each camera individually. All node PCs are connected with the management PC (Pentium 4 XEON 2.8GHz) through a gigabit network (1000BASE-TX).
By using this prototype system, we evaluated the performance and flexibility of the proposed method for real-time obstacle elimination. In case of several cameras, frame rate of obstacle-eliminated image is 7-10 [fps] and delay time is 160-200 [msec]. And in any patterns of camera alignments, we can eliminate obstacle from images. Also we can see the scene from any viewpoint between the camera positions while eliminating obstacles.
These results show that the proposed method can eliminate obstacle from the scene in real-time by using randomly aligned cameras. In the future, by applying the method to security cameras equipped in public environment, we can easily understand the spatial information of the scene in any time in any places.

Report

(4 results)
  • 2005 Annual Research Report   Final Research Report Summary
  • 2004 Annual Research Report
  • 2003 Annual Research Report
  • Research Products

    (31 results)

All 2006 2005 2004

All Journal Article (31 results)

  • [Journal Article] Projected Reality - Enhancing Projected Augmentations by Dynamically Choosing the Best Among Several Projection Systems2006

    • Author(s)
      Jochen Ehnes, Michitaka Hirose
    • Journal Title

      Proceedings IEEE Virtual Reality 2006

      Pages: 283-284

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] 多視点カメラによる監視システムの状況把握効率向上2005

    • Author(s)
      村松孝治, 小林一郎, 谷川智洋, 山下淳, 広田光一, 廣瀬通孝
    • Journal Title

      映像情報メディア学会誌 59・6

      Pages: 909-912

    • NAID

      110006837553

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Annual Research Report 2005 Final Research Report Summary
  • [Journal Article] 実世界ビデオアバタ-人物像の記録・伝送・再生-2005

    • Author(s)
      廣瀬通孝, 広田光一, 谷川智洋
    • Journal Title

      画像ラボ 16・2

      Pages: 43-47

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Real WorldVideoAvatar : Real-time and Real-size Transmission and Presentation of Human Figure2005

    • Author(s)
      Tomohiro Tanikawa, Yasuhiro Suzuki, Koichi Hirota, Michitaka Hirose
    • Journal Title

      Proc. of 15th International Conference on Artificial Reality and Telexistence (ICAT 2005)

      Pages: 112-118

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Real World Video Avatar2005

    • Author(s)
      Tomohiro Tanikawa, Michitaka Hirose
    • Journal Title

      11th International Conference on Human-Computer Interaction(HCI) (CDROM(Paper No.1965))

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Projected Appliications - Taking application from the desktop onto real world objects2005

    • Author(s)
      Jochen Ehnes, Koichi Hirota, Michitaka Hirose
    • Journal Title

      11th International Conference on Human-Computer Interaction(HCI) (CDROM(Paper No.1966))

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] 多眼カメラを用いた実時間障害物除去に関する研究2005

    • Author(s)
      笹原翔太, 小林一郎, 村松孝治, 谷川智洋, 広田光一, 廣瀬通孝
    • Journal Title

      日本バーチャルリアリティ学会第10回大会論文集

      Pages: 27-30

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] 実世界等身大ビデオアバタ提示システムの研究2005

    • Author(s)
      鈴木康広, 谷川智洋, 広田光一, 廣瀬通孝
    • Journal Title

      日本バーチャルリアリティ学会第10回大会論文集

      Pages: 111-114

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] 多視点カメラを利用した監視システムの状況把握効率向上2005

    • Author(s)
      村松孝治, 笹原翔太, 谷川智洋, 広田光一, 廣瀬通孝
    • Journal Title

      日本バーチャルリアリティ学会第10回大会論文集

      Pages: 433-436

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Annual Research Report 2005 Final Research Report Summary
  • [Journal Article] 回転ディスプレイによる実世界Avatarに関する研究2005

    • Author(s)
      鈴木康広, 谷川智洋, 広田光一, 廣瀬通孝
    • Journal Title

      2005年度亜州藝術科学学会論文集・作品集 1・1

      Pages: 25-26

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Improving the Situation Assessment Efficiency of Monitoring Systems Using Multiple Camera2005

    • Author(s)
      Koji Muramatsu, Ichiro Kobayashi, Tomohiro Tanikawa, Jun Yamashita, Koichi Hirota, Michitaka Hirose
    • Journal Title

      The Journal of the Institute of Image Information and Television Engineers Vol.59, No.16

      Pages: 909-912

    • NAID

      110006837553

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Real World Video Avatar2005

    • Author(s)
      Michitaka Hirose, Koichi Hirota, Tomohiro Tanikawa
    • Journal Title

      Image Lab Vol.6, No.2

      Pages: 43-47

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Real World Video Avatar : Real-time and Real-size Transmission and Presentation of Human Figure2005

    • Author(s)
      Tomohiro Tanikawa, Yasuhiro Suzuki, Koichi Hirota, Michitaka Hirose
    • Journal Title

      Proceedings of 15th International Conference on Artificial Reality and Telexistence(ICAT 2005)

      Pages: 112-118

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Real World Video Avatar2005

    • Author(s)
      Tomohiro Tanikawa, Michitaka Hirose
    • Journal Title

      11th International Conference on Human-Computer Interaction(HCI) CDROM (Paper No.1965)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Projected Applications - Taking application from the desktop onto real world objects2005

    • Author(s)
      Jochen Ehnes, Koichi Hirota, Michitaka Hirose
    • Journal Title

      11th International Conference on Human-Computer Interaction(HCI) CDROM (Paper No.1966)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Realtime Obstruct Erasing System with Multi Cameras2005

    • Author(s)
      Shota Sasahara, Ichiro Kobayashi, Koji Muramatsu, Tomohiro Tanikawa, Koichi Hirota, Michitaka Hirose
    • Journal Title

      Proceedings of the Virtual Reality Society of Japan, the 10th Annual Conference

      Pages: 27-30

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Research of real world life-size video avatar presentation system2005

    • Author(s)
      Yasuhiro Suzuki, Tomohiro Tanikawa, Koichi Hirota, Michitaka Hirose
    • Journal Title

      Proceedings of the Virtual Reality Society of Japan, the 10th Annual Conference

      Pages: 111-114

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Improving the Situation Assessment Efficiency of Monitoring Systems Using Multiple Cameras2005

    • Author(s)
      Koji Muramatsu, Shota Sasahara, Tomohiro Tanikawa, Koichi Hirota, Michitaka Hirose
    • Journal Title

      Proceedings of the Virtual Reality Society of Japan, the 10th Annual Conference

      Pages: 433-436

    • NAID

      110006837553

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Research of real World Video Avatar by Rotating Display System2005

    • Author(s)
      Yasuhiro Suzuki, Tanikawa Tomohiro, Koichi Hirota, Michitaka Hirose
    • Journal Title

      Proceedings of Asian art science society Vol.1, No.1

      Pages: 25-26

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] 多眼カメラを用いた実時間障害物除去に関する研究2005

    • Author(s)
      笹原翔太, 村松孝治, 谷川智洋, 広田光一, 廣瀬通孝
    • Journal Title

      日本バーチャルリアリティ学会第10回大会論文集

      Pages: 27-30

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Projected Augmentation - Augmented Reality using Rotatable Video Projectors2004

    • Author(s)
      Jochen Ehnes, Koichi Hirota, Michitaka Hirose
    • Journal Title

      Proceeding ISMAR2004 (International Symposium on Mixed and Augmented Reality)

      Pages: 26-35

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Real World Video Avatar : Transmission and Presentation of Human Figure2004

    • Author(s)
      Hiroyuki Maeda, Tomohiro Tanikawa, Jun Yamashita, Koichi Hirota, Michitaka Hirose
    • Journal Title

      Proc. of ISMCR 2004

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Real World Video Avatar : Transmission and Presentation of Human Figure2004

    • Author(s)
      Hiroyuki Maeda, Tomohiro Tanikawa, Jun Yamashita, Koichi Hirota, Michitaka Hirose
    • Journal Title

      Proc. of IEEE VR 2004

      Pages: 237-238

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] 全周撮影システムによる任意視点ビデオアバタの実時間取得・提示2004

    • Author(s)
      笹原翔太, 谷川智洋, 広田光一, 廣瀬通孝
    • Journal Title

      日本バーチャルリアリティ学会第9回大会論文集

      Pages: 107-110

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] 多視点カメラによる自由視点監視システム2004

    • Author(s)
      村松孝治, 小林一郎, 谷川智洋, 山下淳, 広田光一, 廣瀬通孝
    • Journal Title

      日本バーチャルリアリティ学会第9回大会論文集

      Pages: 115-118

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary 2004 Annual Research Report
  • [Journal Article] 超多眼カメラによる障害物消去に関する研究2004

    • Author(s)
      小林一郎, 村松孝治, 谷川智洋, 山下淳, 広田光一, 廣瀬通孝
    • Journal Title

      日本バーチャルリアリティ学会第9回大会論文集

      Pages: 143-146

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary 2004 Annual Research Report
  • [Journal Article] Real World Video Avatar : Transmission and Presentation of Human Figure2004

    • Author(s)
      Hiroyuki Maeda, Tomohiro Tanikawa, Jun Yamashita, Koichi Hirota, Michitaka Hirose
    • Journal Title

      Proceedings of ISMCR 2004

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Real World Video Avatar : Transmission and Presentation of Human Figure2004

    • Author(s)
      Hiroyuki Maeda, Tomohiro Tanikawa, Jun Yamashita, Koichi Hirota, Michitaka Hirose
    • Journal Title

      Proceedings of IEEE VR 2004

      Pages: 237-238

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Realtime Modeling and Rendering of Three Dimension Video Avatar with Surround Capturing System2004

    • Author(s)
      Shota Sasahara, Tomohiro Tanikawa, Koichi Hirota, Michitaka Hirose
    • Journal Title

      Proceedings of the Virtual Reality Society of Japan, the 9th Annual Conference

      Pages: 107-110

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Monitoring System Using Multi View Points of Multi Cameras2004

    • Author(s)
      Koji Muramatsu, Ichiro Kobayashi, Tomohiro Tanikawa, Jun Yamashita, Koichi Hirota, Michitaka Hirose
    • Journal Title

      Proceedings of the Virtual Reality Society of Japan, the 9th Annual Conference

      Pages: 115-118

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Research of Obstacle Erasing by Using Multi Camera System2004

    • Author(s)
      Ichiro Kobayashi, Koji Muramatsu, Tomohiro Tanikawa, Jun Yamashita, Koichi Hirota, Michitaka Hirose
    • Journal Title

      Proceedings of the Virtual Reality Society of Japan, the 9th Annual Conference

      Pages: 143-146

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary

URL: 

Published: 2003-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi