• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Advanced eye tracking system to measure coordinated movements of eye and head

Research Project

Project/Area Number 15K12129
Research Category

Grant-in-Aid for Challenging Exploratory Research

Allocation TypeMulti-year Fund
Research Field Kansei informatics
Research InstitutionNational Institute of Advanced Industrial Science and Technology (2017-2018)
Kyoto University (2015-2016)

Principal Investigator

Kawano Kenji  国立研究開発法人産業技術総合研究所, 情報・人間工学領域, 客員研究員 (40134530)

Co-Investigator(Kenkyū-buntansha) 松田 圭司  国立研究開発法人産業技術総合研究所, 情報・人間工学領域, 主任研究員 (50358024)
Project Period (FY) 2015-04-01 – 2019-03-31
Project Status Completed (Fiscal Year 2018)
Budget Amount *help
¥3,510,000 (Direct Cost: ¥2,700,000、Indirect Cost: ¥810,000)
Fiscal Year 2017: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2016: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Fiscal Year 2015: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Keywords眼球運動 / 神経科学 / 計測装置 / 協調運動
Outline of Final Research Achievements

We advanced our eye tracking system and developed an eye-and-head tracking system that has adopted a wide-field, hi-resolution, hi-frame-rate USB-3.0 digital camera. The infrared light illuminates both eyes, and the black image of the pupil and corneal reflection of each eye are captured by the camera. The centers of the pupil and the corneal reflection are calculated and tracked over time. To measure the head movement simultaneously, we attached two LEDs on the top of the helmet and adopted the same video-capture system as for measuring eye movements.
We developed a passive calibration method which can be used on marmosets. A visual image, which attracts the animal's attention, is displayed and moved, leading the animal to track it. The comparison between the estimated gaze vectors relative to the camera and the corresponding visual angles of the visual image relative to the eye leads to a function that transforms the gaze vector in camera coordinates to the precise eye position.

Academic Significance and Societal Importance of the Research Achievements

本研究で開発した高精度の頭部ー眼球運動計測システムを用いることで、実世界環境の中での視覚情報処理の理解が進むと考えられる。また、訓練のできない動物や実験者の指示/説明を理解できない幼児、認知症の高齢者等からも精度の高い眼球運動の計測が可能な眼球運動計測システムは幅広い分野のユーザーのニーズに応え、行動解析の分野に貢献すると考えられる。

Report

(6 results)
  • 2018 Annual Research Report   Final Research Report ( PDF )
  • 2017 Research-status Report
  • 2016 Research-status Report
  • 2015 Research-status Report
  • Products Report
  • Research Products

    (18 results)

All 2021 2019 2018 2017 2016 2015

All Journal Article (9 results) (of which Int'l Joint Research: 1 results,  Peer Reviewed: 7 results,  Open Access: 4 results,  Acknowledgement Compliant: 1 results) Presentation (7 results) (of which Int'l Joint Research: 4 results) Patent(Industrial Property Rights) (2 results)

  • [Journal Article] Role of the Cerebellum in Motor Coordination2019

    • Author(s)
      河野憲二、松田圭司、竹村文
    • Journal Title

      The Japanese Journal of Rehabilitation Medicine

      Volume: 56 Issue: 2 Pages: 82-87

    • DOI

      10.2490/jjrmc.56.82

    • NAID

      130007623416

    • ISSN
      1881-3526, 1881-8560
    • Year and Date
      2019-02-18
    • Related Report
      2018 Annual Research Report
  • [Journal Article] A Widely Applicable Real-Time Mono/Binocular Eye Tracking System Using a High Frame-Rate Digital Camera2017

    • Author(s)
      Matsuda K., Nagami T., Sugase Y., Takemura A., Kawano K.
    • Journal Title

      Lecture Notes in Computer Science

      Volume: 10271 Pages: 593-608

    • Related Report
      2017 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Neural activity in the dorsal medial superior temporal area of monkeys represents retinal error during adaptive motor learning.2017

    • Author(s)
      Takemura A, Ofuji T, Miura K, Kawano K.
    • Journal Title

      Sci Rep.

      Volume: 7 Issue: 1 Pages: 40939-40939

    • DOI

      10.1038/srep40939

    • NAID

      120005997783

    • Related Report
      2016 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Contribution of color signals to ocular following responses.2016

    • Author(s)
      Matsuura K, Kawano K, Inaba N, Miura K.
    • Journal Title

      Eur J Neurosci.

      Volume: 44 Issue: 8 Pages: 2600-2613

    • DOI

      10.1111/ejn.13361

    • Related Report
      2016 Research-status Report
    • Peer Reviewed
  • [Journal Article] emporal impulse response function of the visual system estimated from ocular following responses in humans.2016

    • Author(s)
      Ohnishi Y. Kawano K, Miura K.
    • Journal Title

      Neurosci Res.

      Volume: 113 Pages: 56-62

    • DOI

      10.1016/j.neures.2016.08.001

    • Related Report
      2016 Research-status Report
    • Peer Reviewed
  • [Journal Article] 頭頂連合野と空間情報2016

    • Author(s)
      稲場直子,竹村文,河野憲二
    • Journal Title

      Brain and Nerve

      Volume: 68 Pages: 1321-1333

    • Related Report
      2016 Research-status Report
  • [Journal Article] Eye position effects on the remapped memory trace of visual motion in cortical area MST2016

    • Author(s)
      Inaba, N, Kawano, K.
    • Journal Title

      Scientific Reports

      Volume: 6 Issue: 1 Pages: 22013-22013

    • DOI

      10.1038/srep22013

    • NAID

      120005818275

    • Related Report
      2015 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Difference in perceptual and oculomotor responses revealed by apparent motion stimuli presented with an inter-stimulus interval.2015

    • Author(s)
      Nohara S, Kawano K, Miura K.
    • Journal Title

      J. Neurophysiology

      Volume: 113 Pages: 3219-3228

    • Related Report
      2015 Research-status Report
    • Peer Reviewed
  • [Journal Article] Role of the Mouse Retinal Photoreceptor Ribbon Synapse in Visual Motion Processing for Optokinetic Responses2015

    • Author(s)
      Sugita Y, Araki F, Chaya T, Kawano K, Furukawa T, Miura K
    • Journal Title

      PLOS ONE

      Volume: 印刷中 Issue: 5 Pages: e0124132-e0124132

    • DOI

      10.1371/journal.pone.0124132

    • NAID

      120005745666

    • Related Report
      2015 Research-status Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Presentation] 両眼眼球運動計測システム iRecHS2b について2018

    • Author(s)
      松田圭司,林 隆介,河野憲二
    • Organizer
      日本視覚学会 2018 年夏季大会
    • Related Report
      2018 Annual Research Report
  • [Presentation] An experimenter-friendly inexpensive eye tracking system using a high frame- rate digital camera.2017

    • Author(s)
      Kawano K., Matsuda K.
    • Organizer
      A scientific meeting of eye movements to honor David A. Robibnson
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] A Widely Applicable Real-Time Mono/Binocular Eye Tracking System Using a High Frame-Rate Digital Camera2017

    • Author(s)
      Matsuda K., Nagami T., Sugase Y., Takemura A., Kawano K.
    • Organizer
      Human-Computer Interaction 2017
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] An advanced real-time eye tracking system using a new calibration method for untrained marmosets2017

    • Author(s)
      Matsuda K., Sugase Y., Kawano K,. Kaneko M.
    • Organizer
      Society for Neuroscience
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Upright and inverted faces are separately represented in feed-forward processing in the visual cortex.2017

    • Author(s)
      Sugase-Miyamoto Y., Matsumoto N., Mototake Y., Kawano K., Okada M
    • Organizer
      Society for Neuroscience
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Vergence eye movements elicited by a new real 3-D display system for presenting visual stimuli of both near/far distances2016

    • Author(s)
      松田 圭司、竹村 文、三浦 健一郎、河野 憲二
    • Organizer
      第39回日本神経科学大会
    • Place of Presentation
      パシフィコ横浜(神奈川)
    • Year and Date
      2016-07-22
    • Related Report
      2016 Research-status Report
  • [Presentation] 新しいリアルタイム両眼眼球 運動計測システムによる輻輳開散運動の計測2015

    • Author(s)
      松田 圭司、竹村 文、河野 憲二
    • Organizer
      第38回日本神経科学大会
    • Place of Presentation
      兵庫県神戸市
    • Year and Date
      2015-07-28
    • Related Report
      2015 Research-status Report
  • [Patent(Industrial Property Rights)] 視線検出校正方法、システム、及びコンピュータプログラム2021

    • Inventor(s)
      松田 圭司, 河野 憲二, 兼子 峰明, 岡野 栄之
    • Industrial Property Rights Holder
      産業技術総合研究所, 国立研究開発法人理化学研究所
    • Industrial Property Rights Type
      特許
    • Industrial Property Number
      2017-144487
    • Acquisition Date
      2021
    • Related Report
      Products Report
  • [Patent(Industrial Property Rights)] 瞳孔部分を近似する楕円の検出を行う方法2016

    • Inventor(s)
      松田圭司
    • Industrial Property Rights Holder
      松田圭司
    • Industrial Property Rights Type
      特許
    • Filing Date
      2016-09-03
    • Related Report
      2016 Research-status Report

URL: 

Published: 2015-04-16   Modified: 2022-04-15  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi