• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Robot Eye Control System and Its 3D Image Recognition Based on Optical Physiology

Research Project

Project/Area Number 17300060
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Perception information processing/Intelligent robotics
Research InstitutionTokyo Institute of Technology

Principal Investigator

ZHANG Xiaolin  Tokyo Institute of Technology, Precision and Intelligence Laboratory, Associate Professor (60280971)

Co-Investigator(Kenkyū-buntansha) SATO Makoto  Tokyo Institute of TechnologyTokyo Institute of Technology, Precision and Intelligence Laboratory, Professor (50114872)
KOIKE Yasuharu  Tokyo Institute of TechnologyTokyo Institute of Technology, Precision and Intelligence Laboratory, Associate Professor (10302978)
Project Period (FY) 2005 – 2007
Project Status Completed (Fiscal Year 2007)
Budget Amount *help
¥14,450,000 (Direct Cost: ¥13,100,000、Indirect Cost: ¥1,350,000)
Fiscal Year 2007: ¥5,850,000 (Direct Cost: ¥4,500,000、Indirect Cost: ¥1,350,000)
Fiscal Year 2006: ¥3,000,000 (Direct Cost: ¥3,000,000)
Fiscal Year 2005: ¥5,600,000 (Direct Cost: ¥5,600,000)
KeywordsImage Processing / System Control Engineering / Biology Engineering / Information Technology / Brain & Neuron / Robot Vision / Bio-robotics / Neural Network
Research Abstract

(1) A binocular motor system model based on human neural pathways of the binocular motor system was described and a camera movement control system using the model was presented. Although the complexity of real neural networks necessitated several restrictions on the proposed model, the system exhibited several characteristics specific to human-eye movement, such as "same point gazing tendency."
(2) A new mathematical model which shows the short-term signal processing functions of a neuron was proposed. This research demonstrates that the membrane of a neuron acts as an adder, and the synapses are signal processing units for the input pulses. The adder and signal processing units are related by the total postsynaptic currents of all synapses, i.e. the pulse frequency on the membrane is in proportion to the total postsynaptic currents, and the postsynaptic current of each synapse can be obtained through convolution integration by a one pulse postsynaptic current function and the pulse fre … More quency function of the synapse. This allows us to reach an interesting conclusion that the transfer function of a neuron, from the synapses to the axon, is the sum of the Laplace transform of the one pulse postsynaptic current function of each synapse.
(3) A binocular camera control system using only analog devices was developed. This analog robot demonstrated better dynamic performance than a similarly structured digital system.
(4) An active camera system based on hawk eye structure and neuron system was proposed. The system, for example, can be used for search and rescue helicopters.
(5) A binocular security system was developed. The system established that if a set of two active cameras (PTZ camera) uses the binocular model, not only can we easily obtain detailed information, such as 3D data of the imaged person, but can also improve the dynamic performance for target pursuit.
(6) Image processing algorithms for robot vision was proposed. The algorithms include the moving target search algorithms for saccade, and known target detection algorithms for smooth pursuit. Less

Report

(4 results)
  • 2007 Annual Research Report   Final Research Report Summary
  • 2006 Annual Research Report
  • 2005 Annual Research Report
  • Research Products

    (40 results)

All 2008 2007 2006 2005 Other

All Journal Article (12 results) (of which Peer Reviewed: 1 results) Presentation (13 results) Book (2 results) Remarks (1 results) Patent(Industrial Property Rights) (12 results) (of which Overseas: 3 results)

  • [Journal Article] An Active Stereo Vision System Based on Neural Pathways of Human Binocular Motor System2007

    • Author(s)
      Yuzhang GU, Makoto SATO, Xiaolin ZHANG
    • Journal Title

      Journal of Bionic Engineering 4

      Pages: 185-192

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Annual Research Report 2007 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] An Active Stereo Vision System Based on Neural Pathways of Human Binocular Motor System2007

    • Author(s)
      Yuzhang, GU, Makoto, SATO, Xiaolin, ZHANG
    • Journal Title

      Journal of Bionic Engineering Vol. 4

      Pages: 185-192

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] A Self-Distributing Software Environment for Immersive Multiprojector Displays2007

    • Author(s)
      Naoki Hashimoto, Yoshihiko Ishida, Makoto Sato
    • Journal Title

      Systems and Computers in Japan Vol. 38, No. 2

      Pages: 1-9

    • NAID

      110004669955

    • Related Report
      2006 Annual Research Report
  • [Journal Article] 安定性と忠実性を両立させる高解像度力覚レンダリングの開発2007

    • Author(s)
      赤羽 克仁, 小池 康晴, 佐藤 誠
    • Journal Title

      情報処理学会論文誌 Vol.48, No. 3

      Pages: 1316-1325

    • NAID

      110006223869

    • Related Report
      2006 Annual Research Report
  • [Journal Article] An Object Tracking System Based on Human Neural Pathways of Binocular Motor System2006

    • Author(s)
      Xiaolin Zhang
    • Journal Title

      IEEE-9th Int. Conf. Control, Automation, Robotics and Vision "Best Paper Award 受賞"

      Pages: 285-292

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Motor Control-Learning Model for Reaching Movements2006

    • Author(s)
      Hiroyuki Kambara, Kyoungsik Kim, Duk Shin, Makoto Sato, Yasuhara Koike
    • Journal Title

      IEEE WCCI 2006

      Pages: 1282-1289

    • Related Report
      2006 Annual Research Report
  • [Journal Article] A Proposal of Watershed Region Tracking for Image Sequence Analysis2006

    • Author(s)
      Tsuyoshi Kobayashi, Xiaolin Zhang, Makoto Sato
    • Journal Title

      IWAT2006

      Pages: 297-302

    • NAID

      110004082575

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Learning and control model of arm posture2006

    • Author(s)
      K.S.Kim, H.Kambara, D.Shin, M.Sato, Y.Koike
    • Journal Title

      Intelligent Autonomous Systems9

      Pages: 938-945

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 両眼固視微動を用いた立体エッジ画像生成法2005

    • Author(s)
      張暁林, 川合拓郎, 熊澤逸夫, 佐藤誠
    • Journal Title

      第11回画像センシングシンポジウム講演論文集(SSII05)

      Pages: 303-306

    • Related Report
      2005 Annual Research Report
  • [Journal Article] A Binocular Motor System Model for Humanoid Robotics2005

    • Author(s)
      Xiaolin ZHANG, Yuzhang Gu
    • Journal Title

      WMSCI2005 (CD-ROM)

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Watershed解析とグラフ解析によるトンネルひび割れの検出方法2005

    • Author(s)
      三輪道雄, 小林剛, 張暁林, 佐藤誠
    • Journal Title

      映像情報メディア学会技術報告 29・59

      Pages: 11-14

    • NAID

      10016894117

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 物理シミュレーションによるバーチャルヒューマンの運動制御2005

    • Author(s)
      高津勝, 長田陽介, 長谷川晶一, 小池康晴, 佐藤誠
    • Journal Title

      信学技法MVE2005-4 105・106

      Pages: 19-25

    • NAID

      10016588545

    • Related Report
      2005 Annual Research Report
  • [Presentation] 神経の電気的等価回路を用いた信号処理機能の実現2008

    • Author(s)
      草野玄, 張暁林
    • Organizer
      平成20年電気学会全国大会
    • Place of Presentation
      博多
    • Year and Date
      2008-03-20
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Annual Research Report 2007 Final Research Report Summary
  • [Presentation] A Neuron Equivalent Circuit and its Application2008

    • Author(s)
      Haruka, KUSANO, Xiaolin, ZHANG
    • Organizer
      2008 Conference of Electrical Engineering of Japan
    • Place of Presentation
      Hakata
    • Year and Date
      2008-03-20
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] Keynote, Recent advances in robot active vision based on physiology2007

    • Author(s)
      Xiaolin ZHANG
    • Organizer
      International Conference on Intelligent Unmanned Systems
    • Place of Presentation
      Bali,Indonesia
    • Year and Date
      2007-10-24
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] Keynote, Recent advances in robot active vision2007

    • Author(s)
      Xiaolin, ZHANG
    • Organizer
      International Conference on Unmanned Systems
    • Place of Presentation
      Bali, Indonesia
    • Year and Date
      2007-10-24
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] Keynote, Recent advances in robot active vision based on physiology2007

    • Author(s)
      Xiaolin ZHANG
    • Organizer
      International Conference on Intelligent Unmanned Systems
    • Place of Presentation
      Bali, Indonesia
    • Year and Date
      2007-10-24
    • Related Report
      2007 Annual Research Report
  • [Presentation] 神経細胞の数学モデル2007

    • Author(s)
      張 暁林
    • Organizer
      第2回医工連携・バイオメカニクス国際シンポジウム
    • Place of Presentation
      東京
    • Year and Date
      2007-10-22
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Annual Research Report 2007 Final Research Report Summary
  • [Presentation] A Mathematical Model of a Neuron Faithful to Neuron Physiology2007

    • Author(s)
      Xiaolin, ZHANG
    • Organizer
      2nd International Medical-Engineering Joint Biomechanics Symposium
    • Place of Presentation
      Tokyo
    • Year and Date
      2007-10-22
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] Robotic Eye Technology & Its Applications2007

    • Author(s)
      Xiaolin ZHANG
    • Organizer
      Avalent Design Technology Symposium
    • Place of Presentation
      Tokyo
    • Year and Date
      2007-10-05
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Annual Research Report 2007 Final Research Report Summary
  • [Presentation] Robotic Eye Technology and its Applications2007

    • Author(s)
      Xiaolin, ZHANG
    • Organizer
      Avalent Design Technology Symposium
    • Place of Presentation
      Tokyo
    • Year and Date
      2007-10-05
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] 招待講演:両眼だからもっと見える!高機能ロボット・アイ2007

    • Author(s)
      張 暁林
    • Organizer
      財団法人横浜企業経営支援財団, 第117回産学交流サロン
    • Place of Presentation
      横浜市
    • Year and Date
      2007-07-27
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Annual Research Report 2007 Final Research Report Summary
  • [Presentation] Invited lecture : High Grade Robot Eye System : With Binocular Eye Movements2007

    • Author(s)
      Xiaolin, ZHANG
    • Organizer
      117th Industry Liaison Salon, IDEC YOKOHAMA
    • Place of Presentation
      Yokohama
    • Year and Date
      2007-07-27
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] バーチャルヒューマンの眼球運動生成システム2007

    • Author(s)
      黄河, 長谷川昌一, 佐藤誠, 張暁林
    • Organizer
      第26回日本シミュレーション大会
    • Place of Presentation
      横浜
    • Year and Date
      2007-06-22
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Annual Research Report 2007 Final Research Report Summary
  • [Presentation] An Eye Movement System for a Virtual Human2007

    • Author(s)
      He HUANG, Shouichi HASEGAWA, Makoto SATO, Xiaolin ZHANG
    • Organizer
      26th Japan Conference of Simulation
    • Place of Presentation
      Yokohama
    • Year and Date
      2007-06-22
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Book] An Active Camera Control Device Based on the Principle of Vestibular Ocular Reflex2007

    • Author(s)
      Xiaolin, ZHANG, Satoru, ODAGAWA
    • Total Pages
      154612
    • Publisher
      Tokyo Institute of Technology
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Book] Bionic automatic vision and line of sight control system and method2007

    • Author(s)
      Xiaolin ZHANG ; Xiaolin ZHANG
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Remarks] 「研究成果報告書概要(和文)」より

    • URL

      http://www.zhang.pi.titech.ac.jp

    • Related Report
      2007 Final Research Report Summary
  • [Patent(Industrial Property Rights)] 前庭動眼反射の原理を用いる眼球運動制御装置2007

    • Inventor(s)
      張 暁林, 小田川 司
    • Industrial Property Rights Holder
      東京工業大学
    • Industrial Property Number
      2007-154612
    • Filing Date
      2007-06-12
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Patent(Industrial Property Rights)] Bionic automatic vision and line of sight control system and method2007

    • Inventor(s)
      Xiaolin ZHANG
    • Industrial Property Rights Holder
      Xiaolin ZHANG
    • Acquisition Date
      2007-09-18
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
    • Overseas
  • [Patent(Industrial Property Rights)] 前庭動眼反射の原理を用いる眼球運動制御装置2007

    • Inventor(s)
      張, 暁林, 小田川, 司
    • Industrial Property Rights Holder
      東京工業大学
    • Industrial Property Number
      2007-154612
    • Filing Date
      2007-06-12
    • Related Report
      2007 Annual Research Report
    • Overseas
  • [Patent(Industrial Property Rights)] Bionic automatic vision and line of sight control system and method2007

    • Inventor(s)
      Xiaolin ZHANG
    • Industrial Property Rights Holder
      Xiaolin ZHANG
    • Acquisition Date
      2007-09-18
    • Related Report
      2007 Annual Research Report
    • Overseas
  • [Patent(Industrial Property Rights)] 画像表示装置のための酔い防止装置2007

    • Inventor(s)
      張 暁林
    • Industrial Property Rights Holder
      東京工業大学
    • Industrial Property Number
      2007-098955
    • Filing Date
      2007-04-05
    • Related Report
      2006 Annual Research Report
  • [Patent(Industrial Property Rights)] 3次元形状と3次元地形計測法2006

    • Inventor(s)
      張 暁林, 松崎和敏, 加藤芳彦
    • Industrial Property Rights Holder
      東京工業大学
    • Industrial Property Number
      2006-100105
    • Filing Date
      2006-03-06
    • Related Report
      2006 Annual Research Report
  • [Patent(Industrial Property Rights)] 3自由度回転検出装置及びその方法2006

    • Inventor(s)
      加藤芳彦, 松崎和敏, 桜井 聡, 谷津信夫, 清水信吉, 藤原祐介, 佐藤 誠, 張 暁林
    • Industrial Property Rights Holder
      富士通コンポーネント株式会社
    • Industrial Property Number
      2006-068131
    • Filing Date
      2006-03-13
    • Related Report
      2006 Annual Research Report
  • [Patent(Industrial Property Rights)] 眼球結膜強膜撮影装置2006

    • Inventor(s)
      張 暁林
    • Industrial Property Rights Holder
      東京工業大学
    • Industrial Property Number
      2006-289922
    • Filing Date
      2006-10-25
    • Related Report
      2006 Annual Research Report
  • [Patent(Industrial Property Rights)] 眼球運動計測装置2006

    • Inventor(s)
      張 暁林, 宮下則俊, 佐藤 誠
    • Industrial Property Rights Holder
      東京工業大学
    • Industrial Property Number
      2006-282082
    • Filing Date
      2006-10-17
    • Related Report
      2006 Annual Research Report
  • [Patent(Industrial Property Rights)] 神経等価回路、シプナス等価回路及び神経細胞体等価回路2006

    • Inventor(s)
      張 暁林
    • Industrial Property Rights Holder
      東京工業大学
    • Industrial Property Number
      2006-060338
    • Filing Date
      2006-03-06
    • Related Report
      2005 Annual Research Report
  • [Patent(Industrial Property Rights)] 三次元座標測定方法2005

    • Inventor(s)
      張 暁林
    • Industrial Property Rights Holder
      東京工業大学
    • Industrial Property Number
      2005-285296
    • Filing Date
      2005-09-29
    • Related Report
      2005 Annual Research Report
  • [Patent(Industrial Property Rights)] 物体形状測定装置2005

    • Inventor(s)
      張 暁林
    • Industrial Property Rights Holder
      東京工業大学
    • Industrial Property Number
      2005-310483
    • Filing Date
      2005-10-25
    • Related Report
      2005 Annual Research Report

URL: 

Published: 2005-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi