Automatic ROI Setting for Moving Nerons in Fluorescent Observation

• Project/Area Number: 23650080
• Research Category: Grant-in-Aid for Challenging Exploratory Research
• Allocation Type: Multi-year Fund
• Research Field: Perception information processing/Intelligent robotics
• Research Institution: Tohoku University
• Principal Investigator: HASHIMOTO Koichi 東北大学, 大学院・情報科学研究科, 教授 (80228410)
• Project Period (FY): 2011 – 2012
• Project Status: Completed (Fiscal Year 2012)
• Budget Amount: ¥3,900,000 (Direct Cost: ¥3,000,000、Indirect Cost: ¥900,000); Fiscal Year 2012: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000); Fiscal Year 2011: ¥2,730,000 (Direct Cost: ¥2,100,000、Indirect Cost: ¥630,000)
• Keywords: コンピュータビジョン / ビジュアルサーボ / 変形推定 / 蛍光観察 / 蛍光画像処理 / フォーカストラッキング / ＲＯＩ自動設定

Research Abstract

We have developed a software to track ROI (Region of Interest) in a fluorescent video. The video is taken by a microscope system that tracks a target animal motion by using real-time control of motorized stage. The system can analyze and record the response of the target animal with high time and space resolutions. Especially, we have observed C. elegans in bright field as well as in fluorescence images simultaneously using tracking microscope. Moreover we have evaluated the usefulness of the software by analyzing the C. elegans neural image.

Research Products

• [Journal Article] Estimating Deformation of Neurons in Fluorescent Images (2012)
  • Author(s): Fei, X., Teramoto, T., Ishihara, T. and Hashimoto, K.
  • Journal Title: Interdisciplinary Information Sciences Volume: 18 Issue: 2 Pages: 113-122
  • DOI: 10.4036/iis.2012.113
  • NAID: 130002531672
  • ISSN: 1340-9050, 1347-6157
  • Peer Reviewed
• [Journal Article] GPU Acceleration in a Visual Servo System (2012)
  • Author(s): Chuantao Zang and Koichi Hashimoto
  • Journal Title: Journal of Robotics and Mechatronics Volume: 24 Pages: 105-114
  • NAID: 110009957683
  • Peer Reviewed
• [Journal Article] 細胞の個体差に適応する高速オートフォーカス顕微鏡 (2011)
  • Author(s): 小原健,五十嵐康伸,橋本浩一
  • Journal Title: 計測自動制御学会論文集 Volume: 47(1) Pages: 31-39
  • NAID: 10027787549
  • Peer Reviewed
• [Journal Article] A condition for better estimation using asynchronous sampling than synchronous sampling (2011)
  • Author(s): Arai, S., Iwatani, Y. and Hashimoto, K
  • Journal Title: SICE Journal of Control, Measurement, and System Integration Volume: 4(3) Pages: 249-253
  • NAID: 10031140078
  • Peer Reviewed
• [Journal Article] Stability of switched stochastic systems in discrete-time (2011)
  • Author(s): Iwatani, Y., Arai, S. and Hashimoto, K.
  • Journal Title: SICE Journalof Control, Measurement, and System Integration Volume: 3(5) Pages: 368-371
  • NAID: 10031140029
  • Peer Reviewed
• [Journal Article] Fast Sensor Scheduling for Spatially Distributed Sensors (2011)
  • Author(s): Arai, S., Iwatani Y. and Hashimoto, K.
  • Journal Title: IEEE Transactions on Automatic Control Volume: 56(8) Issue: 8 Pages: 1900-1905
  • DOI: 10.1109/tac.2011.2141450
  • Peer Reviewed
• [Presentation] Exploration of Brain Function through Behavior, Neural Activity Observation, and Optogenetic Manipulation. Invited Talk (2012)
  • Author(s): Hashimoto, K. and Fei, X.
  • Organizer: International Symposium Optomechatronic Technologies (ISOT2012)1-7
  • Place of Presentation: Paris, France
  • Year and Date: 2012-10-29
• [Presentation] A virtual reality running machine for worms - a highly integrated system for olfactory behavior (2012)
  • Author(s): Tanimoto, Y., Yamazoe, A., Hashimoto, K. and Kimura, K.
  • Organizer: 5th East Asia C. elegans Meeting, 4-O06
  • Place of Presentation: Taipei, Taiwan
  • Year and Date: 2012-06-28
• [Presentation] Neurite fluorescence imaging of freely moving individual C. elegans animals with high-speed tracking and autofocus system (2012)
  • Author(s): Yokoyama, G., Tsukada, Y., Chen, M., Hashimoto, K. and Mori, I.
  • Organizer: 5th East Asia C. elegans Meeting, P-56
  • Place of Presentation: Taipei, Taiwan
  • Year and Date: 2012-06-27
• [Presentation] A virtual reality running machine for worms - a highly integrated system for olfactory behavior (2012)
  • Author(s): Tanimoto, Y., Yamazoe, A., Hashimoto, K. and Kimura, K.
  • Organizer: EMBL Conference C. elegans Neurobiology, P-126
  • Place of Presentation: Heidelberg,Germany
  • Year and Date: 2012-06-17
• [Presentation] High-speed tracking system for neurite fluorescence imaging during freely moving C (2012)
  • Author(s): Tsukada, Y., Chen, M., Yokoyama, G., Hashimoto, K. and Mori, I.
  • Organizer: elegans. EMBL Conference C. elegans Neurobiology, P-196
  • Place of Presentation: Heidelberg, Germany
  • Year and Date: 2012-06-17
• [Presentation] Exploration of brain function through behavior, neural activity observation, and optogenetic manipulation (2012)
  • Author(s): Hashimoto, K., and Xianfeng Fei
  • Organizer: 2012 International Symposium on Optomechatronic Technologies (ISOT)
  • Place of Presentation: Paris, France
  • Invited
• [Presentation] Neurite fluorescence imaging of freely moving individual C. elegans animals with high-speed tracking and autofocus system (2012)
  • Author(s): Genta Yokoyama, Yuki Tsukada, Chen Min, Koichi Hashimoto, Ikue Mori
  • Organizer: 5th East Asia C. elegans Meeting
  • Place of Presentation: Taipei, Taiwan
• [Presentation] A virtual reality running machine for worms - a highly integrated tracking system for olfactory behavior (2012)
  • Author(s): Yuki Tanimoto, Akiko Yamazoe, Koichi Hashimoto, Kotaro Kimura
  • Organizer: 5th East Asia C. elegans Meeting
  • Place of Presentation: Taipei, Taiwan
• [Presentation] High-speed tracking system for neurite fluorescence imaging during freely moving C. elegans (2012)
  • Author(s): Yuki Tsukada, Chen Min, Genta Yokoyama, Koichiro Hashimoto, Ikue Mori
  • Organizer: EMBO Conference Series: C. elegans Neurobiology
  • Place of Presentation: Heidelberg, Germany
• [Presentation] A virtual reality running machine for worms - a highly integrated tracking system for olfactory behavior (2012)
  • Author(s): Yuki Tanimoto, Akiko Yamazoe, Koichiro Hashimoto, Kotaro Kimura
  • Organizer: EMBO Conference Series: C. elegans Neurobiology
  • Place of Presentation: Heidelberg, Germany
• [Presentation] Camera Localization by CAD Model Matching (2011)
  • Author(s): Zang, C. and Hashimoto, K.
  • Organizer: 2011 IEEE/SICE International Symposium on System Integration (SII 2011), 30-35
  • Place of Presentation: Kyoto, Japan
  • Year and Date: 2011-12-20
• [Presentation] Construction of a system for movement-dependent opticalstimulation in C. elegans (2011)
  • Author(s): Satoh, Y., Maru, M., Hashimoto, K. and Iino, Y.
  • Organizer: The 34th Annual Meeting of the Molecular Biology Society of Japan
  • Place of Presentation: Yokohama, Japan
  • Year and Date: 2011-12-13
• [Presentation] A visual tracking strategy using Computer Graphics and Edge (2011)
  • Author(s): Zang, C., Hashimoto, K. and Moon, J.J.
  • Organizer: 2011IEEE International Conference on Robotics and Biomimetics (IEEE-ROBIO 2011), 981-986
  • Place of Presentation: Phuket, Thailand
  • Year and Date: 2011-12-10
• [Presentation] Fast and adaptive auto-focusing algorithm for microscopic cell observation (2011)
  • Author(s): Obara, T., Igarashi, Y. and Hashimoto, K.
  • Organizer: IEEE Int. Conf.Intelligent Robots and Systems (IROS2011), 7-12
  • Place of Presentation: San Francisco, USA
  • Year and Date: 2011-09-25
• [Presentation] Camera Localization by CAD Model Matching (2011)
  • Author(s): Chuantao Zang and Koichi Hashimoto
  • Organizer: 2011 IEEE/SICE International Symposium on System Integration
  • Place of Presentation: Kyoto, Japan
• [Presentation] A Visual Tracking Strategy using Computer Graphics and Edge (2011)
  • Author(s): Chuantao Zang, Koichi Hashimoto and Jungjae Moon
  • Organizer: 2011 IEEE International Conference on Robotics and Biomimetics
  • Place of Presentation: Thailand
• [Presentation] Visual Servo Microscope for Locking on Single Neuron of a Worm (2011)
  • Author(s): Mitsunori Maru, Min Chen and Koichi Hashimoto
  • Organizer: 2011 IEEE International Conference on Robotics and Biomimetics
  • Place of Presentation: Thailand
• [Presentation] A Flexible Visual Inspection System Combining Pose Estimation and Visual Servo Approaches
  • Author(s): Chuantao Zang and Koichi Hashimoto
  • Organizer: 2012 IEEE International Conference on Robotics and Automation
  • Place of Presentation: Minnesota, USA
• [Remarks]
  • URL: http://www.ic.is.tohoku.ac.jp
• [Remarks] ロックオントラッキング顕微鏡
  • URL: http://www.ic.is.tohoku.ac.jp/ja/sysbio/