• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Gaze measurement technology that does not require calibration using geometric constraints, screen information, and changes in pupil diameter

Research Project

Project/Area Number 20H04229
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Review Section Basic Section 61020:Human interface and interaction-related
Research InstitutionKobe University

Principal Investigator

Nagamatsu Takashi  神戸大学, 海事科学研究科, 教授 (80314251)

Co-Investigator(Kenkyū-buntansha) 竹村 憲太郎  東海大学, 情報理工学部, 教授 (30435440)
中山 実  東京工業大学, 工学院, 教授 (40221460)
鎌原 淳三  大阪成蹊大学, データサイエンス学部, 教授 (60283917)
山本 倫也  関西学院大学, 工学部, 教授 (60347606)
田中 直樹  神戸大学, 海事科学研究科, 名誉教授 (90188318)
Project Period (FY) 2020-04-01 – 2024-03-31
Project Status Completed (Fiscal Year 2023)
Budget Amount *help
¥17,290,000 (Direct Cost: ¥13,300,000、Indirect Cost: ¥3,990,000)
Fiscal Year 2023: ¥2,340,000 (Direct Cost: ¥1,800,000、Indirect Cost: ¥540,000)
Fiscal Year 2022: ¥4,810,000 (Direct Cost: ¥3,700,000、Indirect Cost: ¥1,110,000)
Fiscal Year 2021: ¥7,930,000 (Direct Cost: ¥6,100,000、Indirect Cost: ¥1,830,000)
Fiscal Year 2020: ¥2,210,000 (Direct Cost: ¥1,700,000、Indirect Cost: ¥510,000)
Keywords視線計測 / キャリブレーション
Outline of Research at the Start

視線計測技術は、次世代のヒューマンインタフェースに重要・不可欠な技術として注目を集めているが、使用前にユーザ毎に既知の点を注視する校正作業が必要という課題があった。最新の研究で、校正作業は、眼球の光軸と視軸(視線)とのずれであるカッパ角を求めることに帰着している。しかし、これまで校正作業なしでカッパ角を正確に求めることはできなかった。本研究では、3つのアプローチでの解決を試みる。

Outline of Final Research Achievements

In order to make the gaze measurement technology calibration-free, we proposed methods that use three clues (geometric constraints, screen information, and changes in pupil diameter). (1) In order to improve the estimation accuracy of the optical axis of the eye, which is necessary for methods using geometric constraints, we developed three methods to improve the accuracy of estimating the optical axis of the eye using an aspherical model, a polarization camera, and an event-based camera. (2) As a method using screen information, we proposed a calibration-free method using the latest saliency maps and achieved an accuracy of 1.54 degree. (3) As a method based on changes in pupil diameter, we have developed a method to find pixels whose brightness always changes in correlation with changes in pupil diameter even when the eyeball moves, and to estimate that pixel as the fixation point.

Academic Significance and Societal Importance of the Research Achievements

学術的意義は、最新の顕著性マップを用いた画面情報に基づく手法が安定して精度よくキャリブレーションを実現できたことである。これにより、視線計測装置の応用範囲が非常に広がると考えられる。例えば、博物館等で展示物との自由なインタラクションが実現でき、乗り物でのドライバー状態の確認にも応用可能である。店舗、自動販売機、広告等での、注目度の解析等にも利用可能である。また、心理学の実験装置として使う場合は、被験者に意識させない計測が可能であり、拘束時間が減少し、大量なデータ取得、コスト削減の効果が期待できる。さらに、キャリブレーションが困難な子供や猿などの動物の計測も容易になる。

Report

(5 results)
  • 2023 Annual Research Report   Final Research Report ( PDF )
  • 2022 Annual Research Report
  • 2021 Annual Research Report
  • 2020 Annual Research Report
  • Research Products

    (15 results)

All 2024 2023 2022 2021 2020

All Journal Article (5 results) (of which Peer Reviewed: 5 results,  Open Access: 4 results) Presentation (7 results) (of which Int'l Joint Research: 5 results) Book (1 results) Patent(Industrial Property Rights) (2 results)

  • [Journal Article] Model-based Gaze Estimation with Transparent Markers on Large Screens2022

    • Author(s)
      Koshikawa Koki、Nagamatsu Takashi、Takemura Kentaro
    • Journal Title

      Proceedings of the ACM on Human-Computer Interaction

      Volume: 6 Issue: ETRA Pages: 1-16

    • DOI

      10.1145/3530888

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Implicit User Calibration Method for Gaze-tracking Systems using Saliency Maps around the Optical Axis of Eye2021

    • Author(s)
      廣江 葵、山本 倫也、長松 隆
    • Journal Title

      The Transactions of Human Interface Society

      Volume: 23 Issue: 4 Pages: 431-442

    • DOI

      10.11184/his.23.4_431

    • NAID

      130008120499

    • ISSN
      1344-7262, 2186-8271
    • Year and Date
      2021-11-25
    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Extending the Measurement Angle of a Gaze Estimation Method Using an Eye Model Expressed by a Revolution about the Optical Axis of the Eye2021

    • Author(s)
      NAGAMATSU Takashi、HIROE Mamoru、ARAI Hisashi
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E104.D Issue: 5 Pages: 729-740

    • DOI

      10.1587/transinf.2020EDP7072

    • NAID

      130008032904

    • ISSN
      0916-8532, 1745-1361
    • Year and Date
      2021-05-01
    • Related Report
      2021 Annual Research Report 2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] A Literature Review on Calibration-free Gaze Estimation2021

    • Author(s)
      長松 隆、菅野 裕介、竹村 憲太郎
    • Journal Title

      The Transactions of Human Interface Society

      Volume: 23 Issue: 1 Pages: 73-88

    • DOI

      10.11184/his.23.1_73

    • NAID

      130007991292

    • ISSN
      1344-7262, 2186-8271
    • Year and Date
      2021-02-25
    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Effectiveness of viewer’s exeperience for features of eye movement in viewing football games2021

    • Author(s)
      篠田 瑞生、中山 実、伊藤 泉
    • Journal Title

      The Transactions of Human Interface Society

      Volume: 23 Issue: 1 Pages: 47-50

    • DOI

      10.11184/his.23.1_47

    • NAID

      130007991302

    • ISSN
      1344-7262, 2186-8271
    • Year and Date
      2021-02-25
    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Presentation] Implicit User Calibration for Gaze-tracking Systems Using Saliency Maps Filtered by Eye Movements2023

    • Author(s)
      Mamoru Hiroe, Michiya Yamamoto, Takashi Nagamatsu
    • Organizer
      2023 Symposium on Eye Tracking Research and Applications (ETRA2023)
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Modelling Attention Levels with Ocular Responses in a Speech-in-Noise Recall Task2023

    • Author(s)
      Mateusz Dubiel, Minoru Nakayama, Xin Wang
    • Organizer
      2023 Symposium on Eye Tracking Research and Applications (ETRA2023)
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Research on Time Series Evaluation of Cognitive Load Factors using Features of Eye Movement2022

    • Author(s)
      Okano Tomomi、Nakayama Minoru
    • Organizer
      Symposium on Eye Tracking Research and Applications 2022
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Estimation of Older Driver's Cognitive Performance and Workload Using Features of Eye movement and Pupil Response on Test Routes2022

    • Author(s)
      Nakayama Minoru、Sun Qian Chayn、Xia Jianhong Cecilia
    • Organizer
      26th International Conference Information Visualisation (IV)
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] モデルベース視線計測装置のインプリシットキャリブレーション手法の改良2022

    • Author(s)
      廣江 葵,山本 倫也,長松 隆
    • Organizer
      インタラクション2023 (2023.3)
    • Related Report
      2022 Annual Research Report
  • [Presentation] Effects of measurement time and presentation size conditions on biometric identification using eye movements2021

    • Author(s)
      Yudai Niitsu, Minoru Nakayama
    • Organizer
      ACM Symposium on Eye Tracking Research & Applications
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] モデルベースの視線計測装置における瞳孔径の変化を用いたインプリシットなキャリブレーション手法2020

    • Author(s)
      満永彰吾, 廣江葵, 陳昌昊, 長松隆
    • Organizer
      第175回ヒューマンインタフェース学会研究会
    • Related Report
      2020 Annual Research Report
  • [Book] 生体センシング技術の開発とヘルスケア、遠隔診断への応用2024

    • Author(s)
      長松 隆 他62名
    • Total Pages
      559
    • Publisher
      技術情報協会
    • Related Report
      2023 Annual Research Report
  • [Patent(Industrial Property Rights)] 瞳孔径変化を用いた視線計測用キャリブレーション方法及び装置、並びに視線計測装置及びカメラ装置2020

    • Inventor(s)
      長松隆, 満永彰吾, 廣江葵, 梅田民樹, 陳昌昊, 中山 実
    • Industrial Property Rights Holder
      長松隆, 満永彰吾, 廣江葵, 梅田民樹, 陳昌昊, 中山 実
    • Industrial Property Rights Type
      特許
    • Filing Date
      2020
    • Acquisition Date
      2024
    • Related Report
      2023 Annual Research Report
  • [Patent(Industrial Property Rights)] 瞳孔径変化を用いた視線計測用キャリブレーション方法及び装置、並びに視線計測装置及びカメラ装置2020

    • Inventor(s)
      長松隆, 満永彰吾, 廣江葵, 梅田民樹, 陳昌昊, 中山 実
    • Industrial Property Rights Holder
      神戸大学、東京工業大学
    • Industrial Property Rights Type
      特許
    • Industrial Property Number
      2020-084816
    • Filing Date
      2020
    • Related Report
      2020 Annual Research Report

URL: 

Published: 2020-04-28   Modified: 2025-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi