• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

System for long-term measurement of rotational eye movement and gaze in the dark environment

Research Project

Project/Area Number 17K01071
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Research Field Educational technology
Research InstitutionUniversity of Tsukuba

Principal Investigator

Hoshino Kiyoshi  筑波大学, システム情報系, 教授 (80251528)

Project Period (FY) 2017-04-01 – 2021-03-31
Project Status Completed (Fiscal Year 2020)
Budget Amount *help
¥4,550,000 (Direct Cost: ¥3,500,000、Indirect Cost: ¥1,050,000)
Fiscal Year 2019: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2018: ¥1,820,000 (Direct Cost: ¥1,400,000、Indirect Cost: ¥420,000)
Fiscal Year 2017: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Keywords眼球回旋運動計測 / 視線推定 / 眼球白目領域の血管像 / キャリブレーション用注視点 / 眼球白目の血管像 / キャリブレーション用凝視点 / 眼の概ね横に設置した眼球撮影用カメラ / 眼球運動計測 / 眼球回旋運動推定 / 視線追跡 / テンプレートマッチング / 眼球結膜 / 眼球強膜 / 生体計測 / 眼球回旋運動 / 白目の血管像 / 青色補助光照射 / 眼球血管像追跡 / 青色補助光 / 血管像の濃淡コントラスト / 生体生命情報学 / 生物・生体工学 / 画像 / 認知科学 / 教育工学
Outline of Final Research Achievements

The purpose of this study is to develop an eye movement measurement system that can measure eye rotation and gaze for a long time. First, we examined an eye movement measurement system that can select an appropriate template blood vessel image and track it with high accuracy for users who have various shapes of the blood vessels. Second, we investigated a calibration gazing points that enable highly accurate gaze estimation no matter which direction the eye is captured from. As a result, first, we were able to propose a system that enables highly accurate eye rotation motion estimation without supplementary light irradiation to improve the contrast of the vessel image. Second, we were able to construct the presentation position and the order of the six gazing points for calibration that enabled highly accurate eye gaze estimation within a wide effective range of ±30 to 35 degrees in the vertical and horizontal directions.

Academic Significance and Societal Importance of the Research Achievements

本研究では,眼球のほぼ横に設置した小型カメラで,眼球回旋運動と視線の2反応を計測できる方法論を確立した.前者は,頭部を左右に傾けると,それと逆方向に眼球が回旋し,視界が傾かないようにする眼球運動であるが,映像酔いや車酔いなどでも起きる.スポーツ競技中も,頭部や体幹が傾くと非合理的な眼球回旋運動が生じ,運動パフォーマンスを低下させる.自動車運転中では,加速度の増加に伴い,非合理的な視線移動が発生するため,眼球回旋運動と視線の同時計測は生体情報センシングに有益な技術となる.

Report

(5 results)
  • 2020 Annual Research Report   Final Research Report ( PDF )
  • 2019 Research-status Report
  • 2018 Research-status Report
  • 2017 Research-status Report
  • Research Products

    (38 results)

All 2021 2020 2019 2018 2017 Other

All Journal Article (4 results) (of which Peer Reviewed: 4 results,  Open Access: 3 results) Presentation (23 results) (of which Int'l Joint Research: 23 results,  Invited: 16 results) Book (4 results) Remarks (1 results) Patent(Industrial Property Rights) (6 results) (of which Overseas: 3 results)

  • [Journal Article] Calibration fixation points that enable accurate gaze estimation with pupil image capturing camera installed almost next to eye2021

    • Author(s)
      Hoshino Kiyoshi、Kawamoto Keisuke、Nakai Yuya
    • Journal Title

      Proc. Intl. Conf. on Image, Video and Signal Processing

      Volume: 3 Pages: 1-8

    • DOI

      10.1145/3459212.3459219

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Voluntary fNIRS Waveform Change to Hot Taste Stimulus by Repeated Experience of Licking a Source of Strong Hot Taste2020

    • Author(s)
      Nakai Yuya、Nie Shangshang、Fukida Yuto、Tomida Motomasa、Kotani Hajime、Hoshino Kiyoshi
    • Journal Title

      Proc. Intl. Conf. on Digital Medicine and Image Processing

      Volume: 3 Pages: 7-12

    • DOI

      10.1145/3441369.3441371

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Introducing Swordsman Robot Defensing2020

    • Author(s)
      Ozone Yoshimasa、Zhao Chenyang、Hoshino Kiyoshi
    • Journal Title

      Proc. Intl. Conf. on Digital Medicine and Image Processing

      Volume: 3 Pages: 33-39

    • DOI

      10.1145/3441369.3441375

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Eye Tracking and Measurement of Eye Rotation Using a Small Camera Installed roughly next to the Eye2020

    • Author(s)
      Hoshino Kiyoshi、Noguchi Yuki、Ono Nayuta
    • Journal Title

      Proc. 2020 13th International Conference on Human System Interaction

      Volume: 13 Pages: 1-6

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed
  • [Presentation] Gaze Estimation and Eye Rotation Measurement by a Small Camera Installed almost next to the Eyeball2021

    • Author(s)
      Hoshino Kiyoshi
    • Organizer
      International Conference on Image, Video and Signal Processing
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Eye Tracking and Eye Rotation Measurement by a Small Camera Installed almost at the Side of the Eyeball2020

    • Author(s)
      Hoshino Kiyoshi
    • Organizer
      International Conference on Biomedical and Bioinformatics Engineering
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Eye Tracking and Measurement of Eye Rotation by a Small Camera Installed almost by the Side of the Eye2020

    • Author(s)
      Hoshino Kiyoshi
    • Organizer
      International Conference on Computing and Artificial Intelligence
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] [Keynote Speech] Eye Tracking and Measurement of Eye Rotation by a Small Camera Installed almost by the Side of the Eye2020

    • Author(s)
      Kiyoshi Hoshino
    • Organizer
      International Conference on Computing and Artificial Intelligence (ICCAI 2020)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] [Keynote Speech] Eye Tracking and Measurement of Eye Rotation2020

    • Author(s)
      Kiyoshi Hoshino
    • Organizer
      International Conference on Image, Video and Signal Processing (IVSP 2020)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] Gaze Estimation with Easy Calibration Method2020

    • Author(s)
      Kiyoshi Hoshino, Yuki Noguchi, Yuya Nakai
    • Organizer
      International Conference on Intelligent Information Technology (ICIIT 2020)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Estimation of rotational eye movement based on intensity gradients in the eye images2020

    • Author(s)
      Kiyoshi Hoshino, Yuya Nakai, Yuki Noguchi, Nnayuta Ono
    • Organizer
      International Conference on Intelligent Information Technology (ICIIT 2020)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Estimation of the Line of Sight from Eye Images with Eyelashes2020

    • Author(s)
      Kiyoshi Hoshino, Satoshi Shimanoe, Yuya Nakai, Yuki Noguchi, Maki Nakamura
    • Organizer
      International Conference on Intelligent Information Technology (ICIIT 2020)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] [Keynote Speech] Simultaneous Estimation of the Line-of-Sight and Rotational Eye Movement by Tracking of Blood Vessel Images of the Eye2019

    • Author(s)
      Kiyoshi Hoshino
    • Organizer
      International Conference on Machine Learning and Intelligent Systems (MLIS 2019)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] [Keynote Speech] Eye Movement Estimation Based on the Intensity Gradients of Blood Vessels in the Eye2019

    • Author(s)
      Kiyoshi Hoshino
    • Organizer
      International Conference on Biomedical and Bioinformatics Engineering (ICBBE 2019)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] [Keynote Speech] Measurement of Eye Movement Using a Small Camera Installed Roughly next to the Human Eye2019

    • Author(s)
      Kiyoshi Hoshino
    • Organizer
      International Conference on Computing and Artificial Intelligence (ICCAI 2019)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] [Keynote Speech] Measurement of line-of-sight and eye rotation using a small camera installed roughly next to the eye2019

    • Author(s)
      Kiyoshi Hoshino
    • Organizer
      International Conference on Image, Video and Signal Processing (IVSP 2019)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] A Compact Wearable Eye Movement Measurement System for Support of Safe Driving2019

    • Author(s)
      Kiyoshi Hoshino, Nayuta Ono
    • Organizer
      2019 IEEE International Conference on Mechatronics (ICM)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Measurement of line-of-sight and eye rotation using a small camera installed roughly next to the eye2019

    • Author(s)
      K.Hoshino
    • Organizer
      International Conference on Image, Video and Signal Processing (IVSP 2019)
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] A Compact Wearable Eye Movement Measurement System for Support of Safe Driving2019

    • Author(s)
      K.Hoshino and N.Ono
    • Organizer
      2019 IEEE International Conference on Mechatronics (ICM)
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Estimation of the Line-of-Sight and Rotational Eye Movement by Tracking of Blood Vessel Images on the Eyeball Sclera2018

    • Author(s)
      K.Hoshino
    • Organizer
      International Conference on Digital Medicine and Image Processing (DMIP 2018)
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] Simultaneous estimation of the line-of-sight and rotational eye movement2018

    • Author(s)
      K.Hoshino
    • Organizer
      2018 International Conference on Biomedical Signal and Image Processing (ICBIP 2018)
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] A new method for high-accuracy eye movement measurement2018

    • Author(s)
      K.Hoshino
    • Organizer
      2018 International Conference on Medical and Health Informatics (ICMHI 2018)
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] Method for Measuring Rotational Eye Movement by Tracking Eye Vascular Images Using Luminance Gradient Information2018

    • Author(s)
      N.Ono and K.Hoshino
    • Organizer
      International Conference on Network, Communication and Computing (ICNCC)
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] [Keynote Speech] Technology for acquiring biosignals generated during eye movements2018

    • Author(s)
      K.Hoshino
    • Organizer
      2018 International Conference on Computing and Artificial Intelligence
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] [Keynote Speech] Measurement of rotational eye movements in the dark environment2017

    • Author(s)
      K.Hoshino
    • Organizer
      Intl. Conf. on Biomedical Signal and Image Processing
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] Measurement of eyeball rotational movements in the dark environment2017

    • Author(s)
      K.Hoshino and N.Ono
    • Organizer
      WACV2017 Workshop on Human Activity Analysis with Highly Diverse Cameras
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] [Invited Talk] Wearable Eye Movement Measurement Device2017

    • Author(s)
      K.Hoshino
    • Organizer
      2017 International Conference for Leading and Young Computer Scientists
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research / Invited
  • [Book] “眼のほぼ横に設置した小型カメラによる視線推定と眼球回旋運動計測” 生体情報センシングと人の状態推定への応用2020

    • Author(s)
      星野 聖
    • Total Pages
      11
    • Publisher
      技術情報協会
    • ISBN
      9784861048005
    • Related Report
      2020 Annual Research Report
  • [Book] “短剣道の動作計測と技予測” 生体情報センシングと人の状態推定への応用2020

    • Author(s)
      星野 聖
    • Total Pages
      7
    • Publisher
      技術情報協会
    • ISBN
      9784861048005
    • Related Report
      2020 Annual Research Report
  • [Book] 生体情報センシングと人の状態推定への応用:眼のほぼ横に設置した小型カメラによる視線推定と眼球回旋運動計測,” 生体情報センシングと人の状態推定への応用2020

    • Author(s)
      星野 聖
    • Total Pages
      11
    • Publisher
      技術情報協会
    • Related Report
      2019 Research-status Report
  • [Book] 生体情報センシングと人の状態推定への応用:短剣道の動作計測と技予測2020

    • Author(s)
      星野 聖
    • Total Pages
      12
    • Publisher
      技術情報協会
    • Related Report
      2019 Research-status Report
  • [Remarks] 眼のほぼ横に設置した小型カメラによる視線推定と眼球回旋運動計測

    • URL

      https://youtu.be/tq_cP0yRxQI

    • Related Report
      2020 Annual Research Report
  • [Patent(Industrial Property Rights)] 動き学習装置、制御装置及びプログラム2020

    • Inventor(s)
      星野聖、野口勇気
    • Industrial Property Rights Holder
      筑波大学
    • Industrial Property Rights Type
      特許
    • Filing Date
      2020
    • Related Report
      2020 Annual Research Report
    • Overseas
  • [Patent(Industrial Property Rights)] 眼球運動測定装置、キャリブレーションシステム、眼球運動測定方法及び眼球運動測定プログラム2020

    • Inventor(s)
      星野聖, 野口勇気
    • Industrial Property Rights Holder
      筑波大学
    • Industrial Property Rights Type
      特許
    • Industrial Property Number
      2020-025640
    • Filing Date
      2020
    • Related Report
      2019 Research-status Report
  • [Patent(Industrial Property Rights)] 眼球運動測定装置、眼球運動測定方法及び眼球運動測定プログラム2019

    • Inventor(s)
      星野 聖, 小野那由他
    • Industrial Property Rights Holder
      筑波大学
    • Industrial Property Rights Type
      特許
    • Filing Date
      2019
    • Related Report
      2019 Research-status Report
    • Overseas
  • [Patent(Industrial Property Rights)] 面防具、動作記録システムおよび動作記録方法2018

    • Inventor(s)
      星野 聖, 島ノ江聡
    • Industrial Property Rights Holder
      筑波大学
    • Industrial Property Rights Type
      特許
    • Industrial Property Number
      2018-248113
    • Filing Date
      2018
    • Related Report
      2018 Research-status Report
  • [Patent(Industrial Property Rights)] 眼球運動測定装置、眼球運動測定方法及び眼球運動測定プログラム2018

    • Inventor(s)
      星野 聖, 小野那由他
    • Industrial Property Rights Holder
      筑波大学
    • Industrial Property Rights Type
      特許
    • Industrial Property Number
      2018-111535
    • Filing Date
      2018
    • Related Report
      2018 Research-status Report
  • [Patent(Industrial Property Rights)] 眼球回旋測定装置、眼球回旋測定方法、及び眼球回旋測定プログラム2017

    • Inventor(s)
      星野 聖, 中込広幸
    • Industrial Property Rights Holder
      筑波大学
    • Industrial Property Rights Type
      特許
    • Filing Date
      2017
    • Acquisition Date
      2019
    • Related Report
      2019 Research-status Report
    • Overseas

URL: 

Published: 2017-04-28   Modified: 2022-01-27  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi