• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Gaze Estimation without IR-emission using Display Reflection on Corneal Surface

Research Project

Project/Area Number 18H03279
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Review Section Basic Section 61020:Human interface and interaction-related
Research InstitutionTokai University

Principal Investigator

Takemura Kentaro  東海大学, 情報理工学部, 教授 (30435440)

Co-Investigator(Kenkyū-buntansha) 松本 吉央  国立研究開発法人産業技術総合研究所, 情報・人間工学領域, 研究チーム長 (00314534)
長松 隆  神戸大学, 海事科学研究科, 准教授 (80314251)
Project Period (FY) 2018-04-01 – 2021-03-31
Project Status Completed (Fiscal Year 2020)
Budget Amount *help
¥17,290,000 (Direct Cost: ¥13,300,000、Indirect Cost: ¥3,990,000)
Fiscal Year 2020: ¥5,590,000 (Direct Cost: ¥4,300,000、Indirect Cost: ¥1,290,000)
Fiscal Year 2019: ¥6,630,000 (Direct Cost: ¥5,100,000、Indirect Cost: ¥1,530,000)
Fiscal Year 2018: ¥5,070,000 (Direct Cost: ¥3,900,000、Indirect Cost: ¥1,170,000)
Keywords視線計測 / 角膜
Outline of Final Research Achievements

In order to improve the accuracy of eye gaze estimation using visible light, we realized remote corneal imaging by integrating a 3D facial model and a 3D eyeball model. Additionally, we proposed a cross-ratio eye gaze estimation using a polarized camera system, and the point-of-gaze is estimated without installing NIR-LEDs to display corners.

Academic Significance and Societal Importance of the Research Achievements

リモート型の視線計測装置は,カメラシステムとして市販されているが,より高精度に注視点を推定するには,近赤外LEDが取り付けられた特殊なディスプレイが必要であった.一方,本研究で実現した手法は,ディスプレイ反射像を歪みなく抽出することや,偏光を用いてディスプレイ反射像の四隅を安定に計測することが可能であり,近赤外LEDをディスプレイに配置する必要がない.これは,一般に普及しているディスプレイをそのまま利用することを可能とし,高度な計測技術の普及に貢献できる成果となっている.

Report

(4 results)
  • 2020 Annual Research Report   Final Research Report ( PDF )
  • 2019 Annual Research Report
  • 2018 Annual Research Report
  • Research Products

    (24 results)

All 2021 2020 2019 2018 Other

All Journal Article (3 results) (of which Peer Reviewed: 3 results,  Open Access: 1 results) Presentation (19 results) (of which Int'l Joint Research: 9 results) Remarks (2 results)

  • [Journal Article] A Literature Review on Calibration-free Gaze Estimation2021

    • Author(s)
      長松 隆、菅野 裕介、竹村 憲太郎
    • Journal Title

      The Transactions of Human Interface Society

      Volume: 23 Issue: 1 Pages: 73-88

    • DOI

      10.11184/his.23.1_73

    • NAID

      130007991292

    • ISSN
      1344-7262, 2186-8271
    • Year and Date
      2021-02-25
    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] 偏光カメラシステムを用いた可視光Cross-Ratio Methodによる注視点推定2021

    • Author(s)
      佐々木政人,長松隆,竹村憲太郎
    • Journal Title

      画像電子学会誌

      Volume: 50 Pages: 180-186

    • NAID

      40022513803

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed
  • [Journal Article] RGB-IRカメラを用いたハイブリッドな瞳孔・虹彩同時追跡2019

    • Author(s)
      山岸健太,竹村憲太郎
    • Journal Title

      計測自動制御学会論文集

      Volume: 55 Issue: 8 Pages: 491-498

    • DOI

      10.9746/sicetr.55.491

    • NAID

      130007689476

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Presentation] Polarized Near-Infrared Light Emission for Eye Gaze Estimation2020

    • Author(s)
      Kouki Koshikawa, Masato Sasaki, Takamasa Utsu, and Kentaro Takemura,
    • Organizer
      Proceedings of the 12th ACM Symposium on Eye Tracking Research & Applications
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Estimating Point-of-Gaze using Smooth Pursuit Eye Movements without Implicit and Explicit User-Calibration2020

    • Author(s)
      Yuto Tamura and Kentaro Takemura
    • Organizer
      Proceedings of the 12th ACM Symposium on Eye Tracking Research & Applications
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 視線計測のための偏光近赤外線の照射による角膜反射像の識別2020

    • Author(s)
      越川洸希,佐々木政人,宇都貴将,竹村憲太郎
    • Organizer
      第21回 計測自動制御学会 システムインテグレーション部門講演会
    • Related Report
      2020 Annual Research Report
  • [Presentation] 角膜表面に反射したディスプレイ像の偏光情報を用いたモデルベースの注視点推定2020

    • Author(s)
      佐々木政人,長松隆,竹村憲太郎
    • Organizer
      第21回 計測自動制御学会 システムインテグレーション部門講演会
    • Related Report
      2020 Annual Research Report
  • [Presentation] 偏光Cross-Ratio Methodによる複数画面に対する注視点推定2020

    • Author(s)
      佐々木政人,長松隆,竹村憲太郎
    • Organizer
      第38回 日本ロボット学会学術講演会
    • Related Report
      2020 Annual Research Report
  • [Presentation] Screen corner detection using polarization camera for cross-ratio based gaze estimation2019

    • Author(s)
      Masato Sasaki, Takashi Nagamatsu, and Kentaro Takemura
    • Organizer
      Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Remote corneal imaging by integrating a 3D face model and an eyeball model2019

    • Author(s)
      Takamasa Utsu and Kentaro Takemura
    • Organizer
      Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Indoor human localization based on the corneal reflection of illumination2019

    • Author(s)
      Kenji Numakura and Kentaro Takemura
    • Organizer
      Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Semantic 3D gaze mapping for estimating focused objects2019

    • Author(s)
      Ryusei Matsumoto and Kentaro Takemura
    • Organizer
      Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Cross-Ratio Based Gaze Estimation for Multiple Displays using a Polarization Camera2019

    • Author(s)
      Masato Sasaki, Takashi Nagamatsu, and Kentaro Takemura
    • Organizer
      The Adjunct Publication of the 32nd Annual Symposium on User Interface Software and Technology
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Estimating Focused Object using Smooth Pursuit Eye Movements and Interest Points in the Real World2019

    • Author(s)
      Yuto Tamura and Kentaro Takemura
    • Organizer
      The Adjunct Publication of the 32nd Annual Symposium on User Interface Software and Technology
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 偏光カメラシステムによるディスプレイ反射領域検出を用いた可視光 Cross-Ratio Method2019

    • Author(s)
      佐々木政人,長松隆,竹村憲太郎
    • Organizer
      ロボティクスメカトロニクス講演会2019
    • Related Report
      2019 Annual Research Report
  • [Presentation] 複数人の注視行動理解に向けたセマンティックマップによる三次元注視点推定2019

    • Author(s)
      松本龍晟,竹村憲太郎
    • Organizer
      ロボティクスメカトロニクス講演会2019
    • Related Report
      2019 Annual Research Report
  • [Presentation] 角膜上に映る照明情報を用いた人の位置推定2019

    • Author(s)
      沼倉健二,竹村憲太郎
    • Organizer
      ロボティクスメカトロニクス講演会2019
    • Related Report
      2019 Annual Research Report
  • [Presentation] 偏光カメラを用いた Cross-Ratio Method による注視点推定2019

    • Author(s)
      佐々木政人,長松隆,竹村憲太郎
    • Organizer
      第20回 計測自動制御学会 システムインテグレーション部門講演会
    • Related Report
      2019 Annual Research Report
  • [Presentation] 滑動性眼球運動を用いた実空間での注視対象推定2019

    • Author(s)
      田村祐人,竹村憲太郎
    • Organizer
      第20回 計測自動制御学会 システムインテグレーション部門講演会
    • Related Report
      2019 Annual Research Report
  • [Presentation] ディスプレイ反射像を用いた可視光Cross-Ratio Methodによる注視点推定2018

    • Author(s)
      佐々木政人,竹村憲太郎
    • Organizer
      ロボティクスメカトロニクス講演会2018
    • Related Report
      2018 Annual Research Report
  • [Presentation] 3次元顔モデルを用いた非装着型角膜イメージング法2018

    • Author(s)
      宇都貴将,竹村憲太郎
    • Organizer
      第19回 計測自動制御学会 システムインテグレーション部門講演会
    • Related Report
      2018 Annual Research Report
  • [Presentation] Cross-Ratio Based Gaze Estimation using Polarization Camera System2018

    • Author(s)
      Masato Sasaki, Takashi Nagamatsu, and Kentaro Takemura
    • Organizer
      Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Remarks] 研究室HP

    • URL

      https://takemura-lab.org/wordpress/

    • Related Report
      2020 Annual Research Report
  • [Remarks] 東海大学 情報理工学部 竹村研究室

    • URL

      https://takemura-lab.org/wordpress/

    • Related Report
      2019 Annual Research Report

URL: 

Published: 2018-04-23   Modified: 2022-01-27  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi