An Observer Oriented Free-Viewpoint Video Generation

• Project/Area Number: 21680010
• Research Category: Grant-in-Aid for Young Scientists (A)
• Allocation Type: Single-year Grants
• Research Field: Media informatics/Database
• Research Institution: University of Tsukuba
• Principal Investigator: KITAHARA Itaru 筑波大学, システム情報系, 准教授 (70323277)
• Co-Investigator(Renkei-kenkyūsha): OHTA Yuichi 筑波大学, システム情報系, 教授 (50115804) ; KAMEDA Yoshinari 筑波大学, システム情報系, 准教授 (70283637) ; SAKAMOTO Ryuuki 和歌山大学, システム工学部, 講師 (20395164)
• Project Period (FY): 2009 – 2011
• Project Status: Completed (Fiscal Year 2011)
• Budget Amount: ¥25,350,000 (Direct Cost: ¥19,500,000、Indirect Cost: ¥5,850,000); Fiscal Year 2011: ¥6,110,000 (Direct Cost: ¥4,700,000、Indirect Cost: ¥1,410,000); Fiscal Year 2010: ¥9,100,000 (Direct Cost: ¥7,000,000、Indirect Cost: ¥2,100,000); Fiscal Year 2009: ¥10,140,000 (Direct Cost: ¥7,800,000、Indirect Cost: ¥2,340,000)
• Keywords: 画像認識 / バーチャルリアリティ / 複合現実感 / 自由視点映像 / 映像コンテンツ

Research Abstract

This research develops essential technologies to make various users enjoy free-viewpoint video. The key information to improve the video quality and to realize an easy to browse free-viewpoint display is interaction with observing users. The achievements of this re-search includes an easily assembled/calibrated multiple-view video capturing system, an interactive image processing method by cooperation between human and computer, im-proving the quality of generated videos, an easy to control method of virtual camera that captures free-viewpoint videos.

Research Products

• [Journal Article] 正確で直感的なカメラ操作を可能とする両手を用いた自由視点映像撮影インタフェース (2012)
  • Author(s): 渡邉哲哉, 北原格, 亀田能成, 大田友一
  • Journal Title: 電子情報通信学会論文誌D Volume: 3 Pages: 7-696
  • NAID: 110009418777
  • Peer Reviewed
• [Journal Article] 正確で直感的なカメラ操作を可能とする両手を用いた自由視点映像撮影インタフェース (2012)
  • Author(s): 渡邊哲哉, 北原格, 亀田能成, 大田友一
  • Journal Title: 電子情報通信学会論文誌D Volume: Vol.J95-D, No.3 Pages: 687-696
  • NAID: 110009418777
  • Peer Reviewed
• [Journal Article] 遠隔協調型複合現実感における作業空間表現のための立体人物像提示 (2011)
  • Author(s): 岡本祐樹, 北原格, 大田友一
  • Journal Title: 電子情報通信学会論文誌D Volume: Vol.J94-D, No.5 Pages: 830-838
  • NAID: 110008661377
  • Peer Reviewed
• [Journal Article] An installation of privacy-safe see-through vision (2010)
  • Author(s): Masayuki Hayashi, Ryo Yoshida, Itaru Kitahara, Yoshinari Kameda, Yuichi Ohta
  • Journal Title: ELSEVIER, Procedia-Social and Behavioral Sciences Volume: Vol.2, No.1 Pages: 125-128
  • Peer Reviewed
• [Journal Article] サッカーシーンにおける選手視点映像提示のためのリアルタイム選手軌跡獲得手法 (2009)
  • Author(s): 糟谷望, 北原格, 亀田能成, 大田友一
  • Journal Title: 画像電子学会誌 Volume: No.3
  • NAID: 10025522081
  • Peer Reviewed
• [Journal Article] Toward Cinematizing Our Daily Lives (2009)
  • Author(s): Hansung Kim, Ryuuki Sakamoto, Itaru Kitahara, Tomoji Toriyama, Kiyoshi Kogure
  • Journal Title: Springer International Journal on Multimedia Tools and Ap-plications Volume: Vol.44, No.1 Pages: 87-110
  • NAID: 120007131206
  • Peer Reviewed
• [Journal Article] Toward Cinematizing Our Daily Lives (2009)
  • Author(s): Hansung Kim, Ryuuki Sakamoto, Itaru Kitahara, Tomoji Toriyama, Kiyoshi Kogure
  • Journal Title: Springer International Journal on Multimedia Tools and Applications Vol.44, No.1 Pages: 87-110
  • NAID: 120007131206
  • Peer Reviewed
• [Journal Article] サッカーシーンにおける選手視点映像提示のためのリアルタイム選手軌跡獲得手法 (2009)
  • Author(s): 糟谷望, 北原格, 亀田能成, 大田友一
  • Journal Title: 画像電子学会誌 Vol.38, No.4 Pages: 395-403
  • NAID: 10025522081
  • Peer Reviewed
• [Journal Article] 時間・空間的にまばらな多視点画像を用いた個人識別のための動的な見え方学習法 (2009)
  • Author(s): 田中秀典, 北原格, 斎藤英雄, 村瀬洋, 小暮潔, 萩田紀博
  • Journal Title: 画像電子学会誌 Vol.38, No.5 Pages: 623-633
  • NAID: 10025522421
  • Peer Reviewed
• [Presentation] A Pose Estimation Method of a Mobile Camera by Using an Environmental Stereo Camera (2012)
  • Author(s): Hiroyoshi Tsuru, Itaru Kitahara, Yuichi Ohta
  • Organizer: 18th Korea-Japan Joint Workshop on Frontiers of Computer Vision (FCV2012)
  • Place of Presentation: Kawasaki International Center, Kawasaki, Japan
  • Year and Date: 2012-02-03
• [Presentation] A User Study on Viewpoint Manipulation Methods for Diorama-Based Interface Utilizing Mobile Device Pose in Outdoor Environment (2011)
  • Author(s): Masayuki Hayashi, Itaru Kitahara, Yoshinari Kameda, Yuichi Ohta
  • Organizer: 21st International Conference on Artificial Reality and Telexistence (ICAT2012)
  • Place of Presentation: Expo park, Osaka, Japan
  • Year and Date: 2011-11-28
• [Presentation] Semi-Realistic View Generation of a Player in Soccer Match (2011)
  • Author(s): Nozomu Kasuya, Itaru Kitahara, Yoshinari Kameda, Yuichi Ohta
  • Organizer: The 4th Korea-Japan Workshop on Mixed Reality (KJMR2012)
  • Place of Presentation: Expo park, Osaka, Japan
  • Year and Date: 2011-04-15
• [Presentation] Re-al-Time Soccer Player Tracking Method by Utilizing Shadow Regions (2010)
  • Author(s): Nozomu Kasuya, Itaru Kitahara, Yoshinari Kameda, Yuichi Ohta
  • Organizer: ACM Multimedia 2010 Video Program
  • Place of Presentation: Firenze, Italy
  • Year and Date: 2010-10-26
• [Presentation] 3D Free-Viewpoint Video Capturing In-terface by Using Bimanual Operation (2010)
  • Author(s): Tetsuya Watanabe, Itaru Kitahara, Yoshinari Kameda, Yuichi Ohta
  • Organizer: 3DTV Conference 2010 (3DTV-CON 2010)
  • Place of Presentation: Tampere, Finland
  • Year and Date: 2010-06-09
• [Presentation] A Comparison between Two 3D Free-Viewpoint Generation Methods. Player-Billboard and 3D Reconstruction- (2010)
  • Author(s): Tetsuya Shin, Nozomu Kasuya, Itaru Kitahara, Yoshinari Kameda, and Yuichi Ohta
  • Organizer: 3DTV Conference 2010 (3DTV-CON 2010)
  • Place of Presentation: Tampere, Finland
  • Year and Date: 2010-06-08
• [Presentation] 3D FREE-VIEWPOINT VIDEO CAPRTURING INTERFACE BY USING BIMANUAL OPERATION (2010)
  • Author(s): Tetsuya Watanabe, Itaru Kitahara, Yoshinari Kameda, Yuichi Ohta
  • Organizer: 3DTV Conference 2010 (3DTV-CON 2010)
  • Place of Presentation: Tampere, Finland
  • Year and Date: 2010-06-08
• [Presentation] A COMPARISON BETWEEN TWO 3D FREE-VIEWPOINT GENERATI ON METHODS-PLAYER-BILLBOARD AND 3D RECONSTRUCTION (2010)
  • Author(s): Tetsuya Shin, Nozomu Kasuya, Itaru Kitahara, Yoshinari Kameda, Yuichi Ohta
  • Organizer: 3DTV Conference 2010 (3DTV-CON 2010)
  • Place of Presentation: Tampere, Finland
  • Year and Date: 2010-06-08
• [Presentation] 色情報を利用した環境カメラ画像群からの人物探索方式 (2010)
  • Author(s): 宇津野雄亮・北原格・大田友一
  • Organizer: 電子情報通信学会2010年総合大会
  • Place of Presentation: 東北大学(宮城県)
  • Year and Date: 2010-03-19
• [Presentation] 3次元位置センサと俯瞰映像モニタを用いた自由視点映像提示インタフェース (2009)
  • Author(s): 渡邊哲哉, 北原格, 亀田能成, 大田友一
  • Organizer: 第5回デジタルコンテンツシンポジウム
  • Place of Presentation: 幕張メッセ(千葉県)
  • Year and Date: 2009-06-12
• [Presentation] Au-tomatic Player's View Generation of Real Soccer Scenes Based on Trajectory Tracking (2009)
  • Author(s): Nozomu Kasuya, Itaru Kitahara, Yoshinari Kameda, Yuichi Ohta
  • Organizer: 3DTV-CONFERENCE 2009
  • Place of Presentation: Potsdam, Germany
  • Year and Date: 2009-05-04
• [Book] Advances in Haptics, edited by : Mehrdad Hosseini Zadeh (2010)
  • Author(s): Itaru Kitahara, Morio Nakahara, Yuichi Ohta
  • Publisher: Sensory Properties in Fusion of Visual/Haptic Stimuli Using Mixed Reali-ty