Application of Vision Chip

2011 Fiscal Year Final Research Report

• Project/Area Number: 19100002
• Research Category: Grant-in-Aid for Scientific Research (S)
• Allocation Type: Single-year Grants
• Research Field: Perception information processing/Intelligent robotics
• Research Institution: The University of Tokyo
• Principal Investigator: ISHIKAWA Masatoshi 東京大学, 大学院・情報理工学系研究科, 教授 (40212857)
• Co-Investigator(Kenkyū-buntansha): NAMIKI Akio 東京大学, 大学院・情報理工学系研究科, 講師 (40376611) ; KOMURO Takashi 東京大学, 大学院・情報理工学系研究科, 講師 (10345118) ; OKU Hiromasa 東京大学, 大学院・情報理工学系研究科, 講師 (40401244) ; ALVARO Cassinelli 東京大学, 大学院・情報理工学系研究科, 助教 (60422408)
• Co-Investigator(Renkei-kenkyūsha): WATANABE Yoshihiro 東京大学, 大学院・情報理工学系研究科, 助教 (80456160)
• Project Period (FY): 2009 – 2011
• Keywords: センシングデバイス / システム / ビジュアルフィードバック

Research Abstract

We have developed a massively-parallel visual-information-processing chip called as Vision Chip. The developed chip has shown the effectiveness of the high-speed visual feedback at the speed of 1kHz which is largely increased in the speed compared with the conventional video-rate(30Hz). The fundamental technology for such high-speed visual feedback is now being established. This technology progress allows us to enter a new phase to challenge the application development for the real world. Based on this background, in this research project, we focus on two key applications, High-speed Visual Interface and High-speed Micro Visual Feedback. High-speed Visual Interface observes human motion in real-time by using high-speed vision and realizes new man-machine interaction systems. High-speed Micro Visual Feedback observes microorganism at high accuracy by controlling a microscope based on the feedback of the high-speed vision.

Research Products

• [Journal Article] 高速ビジョンとその応用 (2012)
  • Author(s): 石川正俊
  • Journal Title: 応用物理 Volume: Vol.81, No.2 Pages: 115-120
• [Journal Article] 高速画像処理による運動細胞トラッキング (2011)
  • Author(s): 奥寛雅, 石川正俊
  • Journal Title: O plus E Volume: Vol.33, No.3 Pages: 268-273
• [Journal Article] Surface Image Synthesis of Moving Spinning Cans Using a 1000-fps Area Scan Camera (2010)
  • Author(s): Tomohira Tabata, Takashi Komuro, Masatoshi Ishikawa
  • Journal Title: Machine Vision and Applications Volume: Vol.21, No.5 Pages: 643-652
• [Journal Article] Is There Real Fusion between Sensing and Network Technology? What are the Problems? (2010)
  • Author(s): Masatoshi Ishikawa
  • Journal Title: IEICE Trans. Commun Volume: Vol.E93, No.11 Pages: 2855-2858
• [Journal Article] ルスクリーンへの適応的映像投影を行うインタラクティブディスプレイシステム (2010)
  • Author(s): 渡辺義浩, アルバロカシネリ, 小室孝, 石川正俊
  • Journal Title: 日本バーチャルリアリティ学会論文誌 Volume: Vol.15, No.2 Pages: 173-182
• [Journal Article] A Reconfigurable Embedded System for 1000 f/s Real-Time Vision (2010)
  • Author(s): Takashi Komuro, Tomohira Tabata, and Masatoshi Ishikawa
  • Journal Title: IEEE Transactions on Circuits and Systems for Video Technology Volume: Vol.20, No.4 Pages: 496-504
• [Journal Article] 映像情報メディア年報1-1.情報センシング2. 6特殊性能・機能(超高速,レンジ画像,バイオ計測) (2010)
  • Author(s): 小室孝
  • Journal Title: 映像情報メディア学会誌 Volume: Vol.64, No.8 Pages: 1130-1131
• [Journal Article] 高速ビジョンによる微生物トラッキング顕微鏡 (2009)
  • Author(s): 奥寛雅, 尾川順子, 石川正俊
  • Journal Title: 生物物理 Volume: Vol.49 Pages: 11-14
• [Journal Article] 微生物との実世界インタラクションシステムの提案と初期検討 (2008)
  • Author(s): 尾川順子, 菊田恭平, 奥寛雅, 長谷川健史, アルバロ・カシネリ, 石川正俊
  • Journal Title: 情報処理学会論文誌 Volume: Vol.49 Pages: 3546-3552
• [Journal Article] 三次元空間内における微生物のマイクロロボット応用に向けた制御フレームワークの提案 (2008)
  • Author(s): 長谷川健史, 尾川順子, 奥寛雅, 石川正俊
  • Journal Title: 日本ロボット学会誌 Volume: Vol.26 Pages: 575-582
• [Presentation] 超並列・超高速ビジョンの開発とその応用展開 (2012)
  • Author(s): 石川正俊
  • Organizer: 第31回島津賞受賞記念講演/資料
  • Place of Presentation: 京都
  • Year and Date: 2012-02-21
• [Presentation] 三次元トラッキング顕微鏡を用いた鞭毛運動の定量解析 (2011)
  • Author(s): 山野隆志,清川博貴,奥寛雅,石川正俊,吉川雅英
  • Organizer: 2011年生体運動研究合同班会議
  • Place of Presentation: 大阪市立大学
  • Year and Date: 20110107-09
• [Presentation] 高速ジェスチャインタラクションのための動的変形モデルを用いた指先トラッキング (2011)
  • Author(s): 松谷淳史,新倉雄大,渡辺義浩,小室孝,石川正俊
  • Organizer: 第12回計測自動制御学会システムインテグレーション部門講演会
  • Place of Presentation: 京都
  • Year and Date: 2011-12-25
• [Presentation] 暗視野顕微鏡法における遊泳細胞の三次元トラッキング (2011)
  • Author(s): 荒井祐介,持地翔太,若林憲一,吉川雅英,奥寛雅,石川正俊
  • Organizer: 第12回計測自動制御学会システムインテグレーション部門講演会(SI2011)
  • Place of Presentation: 京都
  • Year and Date: 2011-12-24
• [Presentation] 3次元ジェスチャーUIのための魚眼ステレオを用いた手指検出手法 (2011)
  • Author(s): 久保伸太郎,小室孝,渡辺義浩,石川正俊
  • Organizer: ビジョン技術の実利用ワークショップViEW2011
  • Place of Presentation: 横浜
  • Year and Date: 2011-12-08
• [Presentation] The Volume Slicing Display : a tangible interface for slicing and annotation of volumetric data (2011)
  • Author(s): Alvaro Cassinelli, Yoshihiro Watanabe, and Masatoshi Ishikawa
  • Organizer: Optics & Photonics Japan 2011(OPJ 2011) Symposium(Recent Advance of Digital Opto-electronic Systems and Their Great Applications)
  • Place of Presentation: Osaka
  • Year and Date: 2011-11-29
• [Presentation] High Speed Vision for Gesture UI, Dynamic Image Control and Visual Feedback (2011)
  • Author(s): Masatoshi Ishikawa
  • Organizer: The 2011 Int. Conf. on Solid State Devices and Materials(SSDM2011)
  • Place of Presentation: Nagoya
  • Year and Date: 2011-09-28
• [Presentation] 高速動画像を用いた視覚音素織別手法の提案 (2011)
  • Author(s): 三浦洋平,小室孝,渡辺義浩,石川正俊
  • Organizer: ヒューマンインタフェースシンポジウム2011
  • Place of Presentation: 仙台
  • Year and Date: 2011-09-14
• [Presentation] High Speed Vision Opens New Era of Applications of Image Processing (2011)
  • Author(s): Masatoshi Ishikawa
  • Organizer: 2011 IEEE VAIL Computer Elements Workshop
  • Place of Presentation: Vail, USA
  • Year and Date: 2011-06-28
• [Presentation] Real Fusion between Sensing and Network Technology?-What are the Problem(Key Note) (2011)
  • Author(s): Masatoshi Ishikawa
  • Organizer: 8th Int. Conf. on Networked Sensing Systems(INSS2011)
  • Place of Presentation: Penghu, Taiwan
  • Year and Date: 2011-06-14
• [Presentation] New Application Areas Made Possible by High Speed Vision (2011)
  • Author(s): Masatoshi Ishikawa
  • Organizer: 2011 Int. Image Sensor Workshop(IISW)
  • Place of Presentation: Hakodate-Onuma
  • Year and Date: 2011-06-09
• [Presentation] 位相差顕微鏡法における遊泳細胞の三次元トラッキング (2011)
  • Author(s): 奥寛雅,清川博貴,山野隆志,吉川雅英,石川正俊
  • Organizer: 第17回画像センシングシンポジウム(SSII2011)
  • Place of Presentation: 横浜
  • Year and Date: 2011-06-09
• [Presentation] The Correspondence between Architecture and Application for High Speed Vision Chip (2011)
  • Author(s): Masatoshi Ishikawa
  • Organizer: IEEE Symp. on Low-Power and High-Speed Chips(COOL Chips XIV)
  • Place of Presentation: Yokohama
  • Year and Date: 2011-04-22
• [Presentation] Dynamic Information Space based on High-speed Sensor Technology (2011)
  • Author(s): Masatoshi Ishikawa
  • Organizer: JST Open Cafe
  • Place of Presentation: Singapore
  • Year and Date: 2011-03-21
• [Presentation] Human Gait Estimation Using a Wearable Camera (2011)
  • Author(s): Yoshihiro Watanabe, Tetsuo Hatanaka, Takashi Komuro and Masatoshi Ishikawa
  • Organizer: IEEE Workshop on Applications of Computer Vision(WACV 2011)
  • Place of Presentation: Hawaii
  • Year and Date: 2011-01-05
• [Presentation] Jussi Angesleva and Masatoshi Ishikawa, Camera-less Smart Laser Projector (2010)
  • Author(s): Alvaro Cassinelli, Alexis Zerroug, Yoshihiro Watanabe
  • Organizer: ACM International Conference on Computer Graphics and Interactive Techniques(SIGGRAPH 2010)
  • Place of Presentation: Los Angeles
  • Year and Date: 20100725-29
• [Presentation] Vision Chip and Its applications to human interface, inspection, bio/medical industry, and robotics (2010)
  • Author(s): Masatoshi Ishikawa
  • Organizer: ISSCC 2010 Forum on High Speed Image Sensor Technologies, Proceedings(2010)
  • Year and Date: 20100000
• [Presentation] ビジョンチップとその応用～ヒューマンインターフェイス、検査、医療・バイオ、ロボット～,映像情報メディア学会情報センシング研究会/コンシューマエレクトロニクス研究会 (2010)
  • Author(s): 石川正俊
  • Organizer: 映像情報メディア学会技術報告
  • Year and Date: 20100000
• [Presentation] 高速画像処理と高速光学デバイスによる光学顕微鏡の高機能化 (2010)
  • Author(s): 奥寛雅,石川正俊
  • Organizer: 定量生物学の会第2回年会
  • Year and Date: 20100000
• [Presentation] Vision-based 3D Input Interface Technologies (2010)
  • Author(s): Takashi Komuro
  • Organizer: The 17th International Display Workshops(IDW' 10)
  • Place of Presentation: Fukuoka
  • Year and Date: 2010-12-02
• [Presentation] 顕微鏡の高速制御技術とその生物学への応用 (2010)
  • Author(s): 奥寛雅
  • Organizer: 定量生物学の会第三回年会
  • Place of Presentation: 東京
  • Year and Date: 2010-11-27
• [Presentation] Dynamic Hand Manipulation Using High Speed Visual Feedback (2010)
  • Author(s): Masatoshi Ishikawa
  • Organizer: Workshop on Bridging Human Hand Research and the Development of Robotic Technology for Hands, 2010 IEEE/RAS-EMBS Int. Conf. on Biomedical Robotics and Biomechanics
  • Place of Presentation: Tokyo
  • Year and Date: 2010-09-26
• [Presentation] Volume Slicing Display (2009)
  • Author(s): Alvaro Cassinelli and Masatoshi Ishikawa
  • Organizer: SIGGRAPH ASIA 2009
  • Year and Date: 20090000
• [Presentation] score Light : a laser-based synesthetic experience (2009)
  • Author(s): Alvaro Cassinelli, Yusaku Kuribara, Daito Manabe and Masatoshi Ishikawa
  • Organizer: SIGGRAPH ASIA 2009
  • Year and Date: 20090000
• [Presentation] score Light (2009)
  • Author(s): Alvaro Cassinelli, Yusaku Kuribara, Daito Manabe and Masatoshi Ishikawa
  • Organizer: Digital Content Expo 2009 Symposium
  • Year and Date: 20090000
• [Presentation] Volume Slicing Display (2009)
  • Author(s): Alvaro Cassinelli and Masatoshi Ishikawa
  • Organizer: LAVAL VIRTUAL 2009
  • Year and Date: 20090000
• [Presentation] 微生物トラッキング顕微鏡?細胞運動の定量的な計測を実現する顕微鏡? (2009)
  • Author(s): 奥寛雅,石川正俊
  • Organizer: 定量生物学の会第一回年会
  • Year and Date: 20090000
• [Presentation] レーザー学会学術講演会第28回年次大会 (2008)
  • Author(s): 石川正俊,アルバロカシネリ,カーソンレノツ,メタ・パーセプション
  • Organizer: 講演予稿集
  • Year and Date: 20080000
• [Presentation] Sticky Light (2008)
  • Author(s): Alvaro Cassinelli, Yusaku Kuribara, Stephane Perrin and Masatoshi Ishikawa
  • Organizer: Ars Electronica-Tokyo University Campus Exhibition(HYBRID EGO)
  • Year and Date: 20080000
• [Presentation] How to Track Spermatozoa using High-Speed Visual Feedback (2008)
  • Author(s): Hiromasa Oku, Naoko Ogawa, Kogiku Shiba, Manabu Yoshida, and Masatoshi Ishikawa
  • Organizer: 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society(EMBC 2008)
  • Year and Date: 20080000
• [Presentation] Meta-perception : reflexes and bodies as part of the interface (2008)
  • Author(s): Carson Reynolds, Alvaro Cassinelli and Masatoshi Ishikawa
  • Organizer: Conference on Human Factors in Computing Systems 2008
  • Year and Date: 20080000
• [Presentation] Mobile microscope : A new concept for hand-held microscopes with image stabilization (2008)
  • Author(s): Takahiko Ishikawa, Hiromasa Oku, Masatoshi Ishikawa
  • Organizer: 2008 IEEE International Conference on Robotics and Automation(ICRA 2008)
  • Year and Date: 20080000
• [Presentation] A New Framework for Microrobotic Control of Motile Cells based on High-Speed Tracking and Forcusing (2008)
  • Author(s): Takeshi Hasegawa, Naoko Ogawa, Hiromasa Oku and Masatoshi Ishikawa
  • Organizer: 2008 IEEE International Conference on Robotics and Automation(ICRA 2008)
  • Year and Date: 20080000
• [Presentation] 運動する微生物の疑似静止観察-トラッキング映像のさらなる安定化- (2008)
  • Author(s): 奥村光平,長谷川健史,奥寛雅,石川正俊
  • Organizer: 第26回日本ロボット学会学術講演会
  • Year and Date: 20080000
• [Book] 高速ビジョン,ロボットテクノロジー(日本ロボット学会編) (2011)
  • Author(s): 妹尾拓,渡辺義浩,石川正俊
  • Total Pages: 202-205
  • Publisher: オーム社
• [Book] 技術編第1部門第3章スマートイメージセンサ,映像情報メディア工学大事典 (2010)
  • Author(s): 小室孝
  • Publisher: オーム社
• [Remarks] 東京大学石川奥研究室
  • URL: http://www.k2.t.u-tokyo.ac.jp/