3D Sensing for Moving Objects Based on Integration of the Time-sequential Range Data

2009 Fiscal Year Final Research Report

• Project/Area Number: 20760263
• Research Category: Grant-in-Aid for Young Scientists (B)
• Allocation Type: Single-year Grants
• Research Field: Measurement engineering
• Research Institution: The University of Tokyo
• Principal Investigator: WATANABE Yoshihiro The University of Tokyo, 情報理工学系研究科, 特任助教 (80456160)
• Project Period (FY): 2008 – 2009
• Keywords: センシング情報処理 / 3次元計測 / 高解像度化 / 能動計測 / 画像センシング / 高速ビジョン / 計測工学 / 最適化問題

Research Abstract

The goal of this study involves the development of the new 3D sensing technology and its applications. The new 3D sensing technology is capable of real-time shape acquisition of a high-speed moving/deforming object. Particularly, I focused on the method for the high-resolution shape reconstruction and applications for man-machine interface.
I have proposed a method for High-resolution shape reconstruction. This method enables the reconstruction of high-resolution shape by integrating multiple time-sequential range images. Also the estimation method for non-rigid deformation has been developed in this study. This method achieves accurate surface estimation and planar development based on a mathematical model involving the physical features of the developable surface. In addition, based on the high-speed 3D sensing technology, I have developed an interactive display system. The proposed system is a variant of the multi-touch display technology that introduces an original way of manipulating three dimensional data by utilizing the deformable tangible screen. As another application, I have developed a new book digitalization technology of scanning large stacks of paper while the user performs a continuous page flipping action. The developed technology shows that it is possible to recognize the 3D deformation of the flipped papers and reconstruct the original flat image.

Research Products

• [Journal Article] 変形するタンジブルスクリーンへの適応的映像投影を行うインタラクティブディスプレイシステム (2010)
  • Author(s): 渡辺義浩, アルバロカシネリ, 小室孝, 石川正俊
  • Journal Title: 日本バーチャルリアリティ学会論文誌 Vol.15,No.2
• [Journal Article] 高速ビジョンを用いた高速ロボットの実現 (2010)
  • Author(s): 渡辺義浩, 妹尾拓, 石川正俊
  • Journal Title: ロボット Vol.192 Pages: 47-53
• [Presentation] 高速3次元センシングの実現とその新応用 (2010)
  • Author(s): 渡辺義浩, 石川正俊
  • Organizer: 第57回応用物理学関係連合講演会
  • Place of Presentation: 神奈川
  • Year and Date: 2010-03-18
• [Presentation] Book Flipping Scanning (2009)
  • Author(s): Takashi Nakashima, Yoshihiro Watanabe, Takashi Komuro, Masatoshi Ishikawa
  • Organizer: 22nd Symposium on User Interface Software and Technology (UIST2009)
  • Place of Presentation: Victoria
  • Year and Date: 2009-10-05
• [Presentation] High-resolution Shape Reconstruction from Multiple Range Images based on Simultaneous Estimation of Surface and Motion (2009)
  • Author(s): Yoshihiro Watanabe, Takashi Komuro, Masatoshi Ishikawa
  • Organizer: The 12th IEEE International Conference on Computer Vision (ICCV2009)
  • Place of Presentation: Kyoto
  • Year and Date: 2009-10-01
• [Presentation] 複数の距離画像を用いた曲面/運動同時推定による高解像度形状復元 (2009)
  • Author(s): 渡辺義浩, 小室孝, 石川正俊
  • Organizer: 第12回画像の認識・理解シンポジウム
  • Place of Presentation: 島根
  • Year and Date: 2009-07-22
• [Presentation] 可展面モデルを用いた非剛体変形の推定と展開 (2009)
  • Author(s): 中島崇, 渡辺義浩, 小室孝, 石川正俊
  • Organizer: 第12回画像の認識・理解シンポジウム
  • Place of Presentation: 島根
  • Year and Date: 2009-07-22
• [Presentation] Integration of Time-sequential Range Images for Reconstruction of a High-resolution 3D Shape (2008)
  • Author(s): Yoshihiro Watanabe, Takashi Komuro, Masatoshi Ishikawa
  • Organizer: The 19th International Conference on Pattern Recognition
  • Place of Presentation: Florida
  • Year and Date: 2008-12-08
• [Presentation] The Deformable Workspace: a Membrane between Real and Virtual Space (2008)
  • Author(s): Yoshihiro Watanabe, Alvaro Cassinelli, Takashi Komuro, Masatoshi Ishikawa
  • Organizer: IEEE International Workshop on Horizontal Interactive Human-Computer Systems (Tabletops & Interactive Surfaces 2008)
  • Place of Presentation: Amsterdam
  • Year and Date: 2008-10-03
• [Presentation] 運動物体の三次元計測における高解像度形状の復元 (2008)
  • Author(s): 杉原裕, 渡辺義浩, 小室孝, 石川正俊
  • Organizer: 3次元画像コンファレンス2008
  • Place of Presentation: 東京
  • Year and Date: 2008-07-10
• [Remarks]
  • URL: http://www.k2.t.u-tokyo.ac.jp/members/watanabe/watanabe-j.html
• [Remarks]
  • URL: http://www.k2.t.u-tokyo.ac.jp/vision/HighResolutionShape/
• [Remarks]
  • URL: http://www.k2.t.u-tokyo.ac.jp/perception/DeformableWorkspace/
• [Remarks]
  • URL: http://www.k2.t.u-tokyo.ac.jp/vision/MultiframeAlignment/
• [Remarks]
  • URL: http://www.k2.t.u-tokyo.ac.jp/vision/BookFlipScan/
• [Remarks]
  • URL: http://www.k2.t.u-tokyo.ac.jp/vision/developable/Web
• [Remarks] Wired. com: "High-Speed Camera Scans Books in Seconds, " 2010
• [Remarks] Slashdot: "Japanese Researchers Develop World's Fastest Book Scanner, " 2010
• [Remarks] IEEE Spectrum: "Superfast Scanner Lets You Digitize a Book By Rapidly Flipping Pages", 2010
• [Remarks] You Tube: "Book Flipping Scanning, " 2010. 新聞掲載
• [Remarks] 日本経済新聞(電子版): "パラパラめくって丸ごとスキャン東大の高速複写機ユーチューブで世界が注目, " 2010
• [Remarks] 日本経済新聞: "本の内容、高速読み取り1冊250ページ1分で処理東大、デジタル化しやすく, " 2009
• [Remarks] 日刊工業新聞: "パラパラめくるだけ速読で書籍デジタル化東大がスキャンシステム, " 2009. マスメディア
• [Remarks] NHK: "おはよう日本「世界が注目するネット動画」, " 2010
• [Remarks] NHK: "特ダネ投稿Do画, " 2010
• [Remarks] Reuters: "Speedy scanner re-writes book on publishing technology, " 2010
• [Remarks] テレビ東京: "ワールドビジネスサテライトトレンドたまご「高速スキャンシステム」, " 2009. 8