• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Development of head-free remote eye gaze detection system

Research Project

Project/Area Number 14550415
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field Measurement engineering
Research InstitutionShizuoka University

Principal Investigator

EBISAWA Yoshinobu  Shizuoka Univ., Fac.of Engineering, Professor, 工学部, 教授 (40213574)

Project Period (FY) 2002 – 2004
Project Status Completed (Fiscal Year 2004)
Budget Amount *help
¥2,900,000 (Direct Cost: ¥2,900,000)
Fiscal Year 2004: ¥700,000 (Direct Cost: ¥700,000)
Fiscal Year 2003: ¥1,200,000 (Direct Cost: ¥1,200,000)
Fiscal Year 2002: ¥1,000,000 (Direct Cost: ¥1,000,000)
Keywordseye gaze detection / ultrasonic distance measurement / real time image processing / remote detection / pupil detection / head motion detection / stereo camera / infrared light / 視線検出 / 頭部運動追尾 / 超音波距離計測 / 画像処理 / ズーム・フォーカス制御
Research Abstract

Studies for development of non-contact, remote video-based, high-precision eye-gaze detection systems in which users can move their head around 10 cm were conducted for information input into a computer using light of sight. In the principle of the final eye gaze detection system, the precise 3-D pupil position was detected by two stereo wide cameras which can grab whole image of users' face. Another narrow camera fixed on a pan-tilt unit was directed toward user's eye, and grabbed a magnified eye image. In the image, the center of the pupil image and the center of the corneal reflection of the light source were detected. Using their relative positions, the angle of the light of sight relative to the light axis of the narrow camera was determined. The intersection between the light of sight and the visual object was detected as the eye gaze point.
Until 2003 fiscal year, the infrared LEDs were arranged in a ring shape around the aperture of each of the stereo cameras. The two rings of t … More he LEDs were switched on synchronously with an odd/even signal of the video and, the pupil and dark pupil images were alternately obtained in each camera. Diffentiating these images eased pupil detection. The 3D positions of the pupil was calculated and the narrow camera was made to direct toward the pupil. On the narrow camera, the rings of LEDs having a different wavelength from that of the stereo wide cameras were attached to near the aperture and a little far from there, and the pupil was detected in the same fashion, and the carnal reflection was detected in the bright eye image.
In 2004 fiscal year, an eye gaze calibration method was proposed, which utilized an assumption that the optics of eye ball has a shape of axial symmetry around the visual axis of the eyeball. This could easily calibrate eye gaze point by just looking at one known point on a PC screen and the narrow camera. The experimental results indicated that the detected eye gaze points showed the systematic errors in some positions of the screen. However, the change of the distance between the screen and the face of the subject did not influence the eye gaze detection results. This result showed the efibctiveness of this eye gaze detection method. In addition, it was difficult to estimate the pupil center in the image obtained from the narrow camera when the oarneal reflection was located at the edge of the pupil. The improvement of this problem made the dispersion of the eye gaze point on the screen less than 1.5 cm. Less

Report

(4 results)
  • 2004 Annual Research Report   Final Research Report Summary
  • 2003 Annual Research Report
  • 2002 Annual Research Report
  • Research Products

    (46 results)

All 2005 2004 2003 2002 Other

All Journal Article (23 results) Patent(Industrial Property Rights) (12 results) Publications (11 results)

  • [Journal Article] 瞳孔と鼻孔の三次元位置による顔の方向検出2005

    • Author(s)
      塗壁悠治, 海老澤嘉伸
    • Journal Title

      映像情報メディア学会2005年次大会講演 (発表予定)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] 瞳孔マウスの改善2005

    • Author(s)
      塗壁悠治, 海老澤嘉伸
    • Journal Title

      第11回画像センシングシンポジウム (発表予定)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] ステレオ広角カメラと狭角カメラによる視線検出2005

    • Author(s)
      遠西昭和, 海老澤嘉伸
    • Journal Title

      映像情報メディア学会2005年次大会講演 (発表予定)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Face Pose Estimation by 3D Position Detection of Pupils and Nostrils2005

    • Author(s)
      Y.Nurikabe, Y.Ebisawa
    • Journal Title

      Proceeding of ITE Annual Convention 2005

      Pages: 2-2

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Eye Gaze Detection Using Stereo Wide Cameras and a Narrow Camera2005

    • Author(s)
      A.Tonishi, Y.Ebisawa
    • Journal Title

      Proceeding of ITE Annual Convention 2005

      Pages: 2-2

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] ステレオカメラ法による瞳孔の三次元位置実時間計測2004

    • Author(s)
      海老澤嘉伸, 石間大典
    • Journal Title

      第10回画像センシングシンポジウム講演論文集

      Pages: 167-172

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Annual Research Report 2004 Final Research Report Summary
  • [Journal Article] 瞳孔マウスの提案2004

    • Author(s)
      海老澤嘉伸, 石間大典, 井上信太郎, 村山泰子
    • Journal Title

      第10回画像センシングシンポジウム講演論文集

      Pages: 167-172

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Annual Research Report 2004 Final Research Report Summary
  • [Journal Article] Pupil Mouse : Cursor control by head rotation using pupil detection technique2004

    • Author(s)
      Y.Ebisawa, D.Ishima, S.Inoue, Y.Murayama
    • Journal Title

      Proceedings of International Conference on Computing, Communications and Control Technologies : CCCT'04

      Pages: 209-214

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Annual Research Report 2004 Final Research Report Summary
  • [Journal Article] Realtime 3D Position Detection of Human Pupil2004

    • Author(s)
      Y.Ebisawa
    • Journal Title

      Proceedings of 2004 IEEE International Conference on Virtual Environments, Human-Computer Interfaces, and Measurement Systems

      Pages: 8-12

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Annual Research Report 2004 Final Research Report Summary
  • [Journal Article] Detection of 3D Position of Pupils by Stereo Camera Method2004

    • Author(s)
      Y.Ebisawa, D.Ishima
    • Journal Title

      Proceedings of 10th Symposium on sensing via image information

      Pages: 173-178

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Proposal of Pupil Mouse2004

    • Author(s)
      Y.Ebisawa, D.Ishima, S.Inoue, Y.Murayama
    • Journal Title

      Proceedings of 10th Symposium on sensing via image information

      Pages: 167-172

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] 超音波位置計測に基づく頭部運動によるポインティングシステム2003

    • Author(s)
      布下正意, 海老澤嘉伸, 石間大典
    • Journal Title

      映像情報メディア学会誌 57・3

      Pages: 58-63

    • NAID

      130004598974

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Eye tracking based on ultrasonic position measurement in head free video-based eye-gaze detection2003

    • Author(s)
      D.Ishima, Y.Ebisawa
    • Journal Title

      Proceedings of IEEE EMBS Asian-Pacific Conference on Biomedical Engineering

    • NAID

      130004598973

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Pointing System by Head Movement based on Ultrasonic Position Measurement2003

    • Author(s)
      M.Nunoshita, Y.Ebisawa, D.Ishima
    • Journal Title

      The Journal of the Institute of Image Information and Television Engineers 57, 32

      Pages: 58-63

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] A Pilot Study on Ultrasonic Sensor-Based Measurement of Head Movement2002

    • Author(s)
      Yoshinobu Ebisawa
    • Journal Title

      IEEE Transactions on Instrumentation and Measurement 51・5

      Pages: 1109-1115

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Detection of Feature Points in Video-Based Eye-Gaze Detection2002

    • Author(s)
      Y.Ebisawa, S.Tsukahara, D.Ishima
    • Journal Title

      Proceedings of the Second Joint EMBS/BMES Conference

      Pages: 1764-1765

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] ビデオ式遠隔注視点検出における実時間特徴点検出2002

    • Author(s)
      海老澤嘉伸, 塚原伸一, 高橋公之, 石間大典
    • Journal Title

      映像情報メディア学会2002年年次大会講演予稿集

    • NAID

      130004598972

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] 頭部運動を許容するビデオ式注視点検出における超音波位置計測に基づく眼の追尾2002

    • Author(s)
      石間大典, 海老澤嘉伸, 布下正意
    • Journal Title

      映像情報メディア学会2002年年次大会講演予稿集

    • NAID

      130004598973

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Head Pointer Based on Ultrasonic Position Measurement2002

    • Author(s)
      M.Nunoshita, Y.Ebisawa
    • Journal Title

      Proceedings of the Second Joint EMBS/BMES Conference

      Pages: 1732-1733

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] A Pilot Study on Ultrasonic Sensor-Based Measurement of Head Movement2002

    • Author(s)
      Yoshinobu Ebisawa
    • Journal Title

      IEEE Transactions on Instrumentation and Measurement 51, 5

      Pages: 1109-1115

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Real Time Detection of Feature Points in Video-Based Remote Eye-Gaze Detection2002

    • Author(s)
      Y.Ebisawa, S.Tsukahara, K.Takahashi, D.Ishima
    • Journal Title

      Proceeding of ITE Annual Convention 2002

      Pages: 2-2

    • NAID

      130004598972

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Eye Tracking Based on Ultrasonic Position Measurement in Head Free Video-Based Eye Gaze Detection2002

    • Author(s)
      D.Ishima, Y.Ebisawa, M.Nunoshita
    • Journal Title

      Proceeding of ITE Annual Convention 2002

      Pages: 2-2

    • NAID

      130004598973

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Improvement of PupilMouse

    • Author(s)
      Y.Nurikabe, Y.Ebisawa
    • Journal Title

      Proceedings of 11th Symposium on sensing via image information

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Patent(Industrial Property Rights)] 瞳孔検出に基づくポインティング装置及び方法2005

    • Inventor(s)
      海老澤 嘉伸
    • Industrial Property Rights Holder
      静岡大学
    • Industrial Property Number
      2005-127386
    • Filing Date
      2005-04-26
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Patent(Industrial Property Rights)] 三次元視点計測装置2004

    • Industrial Property Rights Holder
      静岡大学
    • Industrial Property Number
      2004-006359
    • Filing Date
      2004-01-14
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Patent(Industrial Property Rights)] 距離イメージセンサを用いた視線検出装置2004

    • Industrial Property Rights Holder
      静岡大学
    • Industrial Property Number
      2004-039495
    • Filing Date
      2004-02-17
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Patent(Industrial Property Rights)] 瞳孔と鼻孔を用いた頭部の方向を検出する方法2004

    • Industrial Property Rights Holder
      静岡大学
    • Industrial Property Number
      2004-073998
    • Filing Date
      2004-03-16
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Patent(Industrial Property Rights)] 実時間瞳孔位置検出システム2004

    • Inventor(s)
      海老澤 嘉伸
    • Industrial Property Rights Holder
      静岡大学
    • Industrial Property Number
      2004-170506
    • Filing Date
      2004-06-08
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Patent(Industrial Property Rights)] ポインタ制御信号発生方法及び装置2004

    • Inventor(s)
      海老澤 嘉伸
    • Industrial Property Rights Holder
      静岡大学
    • Industrial Property Number
      2004-170173
    • Filing Date
      2004-06-08
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Patent(Industrial Property Rights)] 瞳孔検出装置2004

    • Inventor(s)
      海老澤 嘉伸
    • Industrial Property Rights Holder
      静岡大学
    • Industrial Property Number
      2004-365546
    • Filing Date
      2004-12-17
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Patent(Industrial Property Rights)] 実時間瞳孔位置検出システム2004

    • Inventor(s)
      海老澤嘉伸
    • Industrial Property Rights Holder
      静岡大学
    • Industrial Property Number
      2004-170506
    • Filing Date
      2004-06-08
    • Related Report
      2004 Annual Research Report
  • [Patent(Industrial Property Rights)] ポインタ制御信号発生方法及び装置2004

    • Inventor(s)
      海老澤嘉伸
    • Industrial Property Rights Holder
      静岡大学
    • Industrial Property Number
      2004-170173
    • Filing Date
      2004-06-08
    • Related Report
      2004 Annual Research Report
  • [Patent(Industrial Property Rights)] 瞳孔検出装置2004

    • Inventor(s)
      海老澤嘉伸
    • Industrial Property Rights Holder
      静岡大学
    • Industrial Property Number
      2004-365546
    • Filing Date
      2004-12-17
    • Related Report
      2004 Annual Research Report
  • [Patent(Industrial Property Rights)] 瞳孔位置検出によるポインティング装置及び方法2003

    • Inventor(s)
      海老澤 嘉伸
    • Industrial Property Rights Holder
      静岡大学
    • Industrial Property Number
      2003-419110
    • Filing Date
      2003-12-17
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Patent(Industrial Property Rights)] 視線検出方法および視線検出装置2003

    • Industrial Property Rights Holder
      静岡大学
    • Industrial Property Number
      2003-429344
    • Filing Date
      2003-12-25
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Publications] D.Ishima, Y.Ebisawa: "Eye tracking based on ultrasonic position measurement in head free video-based eye-gaze detection"Proceedings of IEEE EMBS Asian-Pacific Conference on Biomedical Engineering. (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 海老澤嘉伸, 石間大典: "ステレオカメラ法による瞳孔の三次元位置実時間計測"第10回画像センシングシンポジウム講演論文集. (予定). (2004)

    • Related Report
      2003 Annual Research Report
  • [Publications] 海老澤嘉伸, 石間大典, 井上信太郎, 村山泰子: "瞳孔マウスの提案"第10回画像センシングシンポジウム講演論文集. (予定). (2004)

    • Related Report
      2003 Annual Research Report
  • [Publications] Y.Ebisawa, D.Ishima, S.Inoue, Y.Murayama: "Pupil Mouse : Cursor control by head rotation using pupil detection technique"Proceedings of International Conference on Computing, Communications and Control Technologies : CCCT'04. (予定). (2004)

    • Related Report
      2003 Annual Research Report
  • [Publications] Y.Ebisawa: "Realtime 3D Position Detection of Human Pupil"Proceedings of 2004 IEEE International Conference on Virtual Environments, Human-Computer Interfaces, and Measurement System. (予定). (2004)

    • Related Report
      2003 Annual Research Report
  • [Publications] Yoshinobu Ebisawa: "A Pilot Study on Ultrasonic Sensor-Based Measurement of Head Movement"IEEE Transactions on Instrumentation and Measurement. 51・5. 1109-1115 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] Y.Ebisawa, S.Tsukahara, D.Ishima: "Detection of Feature Points in Video-Based Eye-Gaze Detection"Proceedings of the Second Joint EMBS/BMES Conference. 1764-1765 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] 海老澤嘉伸, 塚原伸一, 高橋公之, 石間大典: "ビデオ式遠隔注視点検出における実時間特徴点検出"映像情報メディア学会2002年年次大会講演予稿集. 2 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] 石間大典, 海老澤嘉伸, 布下正意: "頭部運動を許容するビデオ式注視点検出における超音波位置計測に基づく眼の追尾"映像情報メディア学会2002年年次大会講演予稿集. 2 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] M.Nunoshita, Y.Ebisawa: "Head Pointer Based on Ultrasonic Position Measurement"Proceedings of the Second Joint EMBS/BMES Conference. 1732-1733 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] 布下正意, 海老澤嘉伸, 石間大典: "超音波位置計測に基づく頭部運動によるポインティングシステム"映像情報メディア学会誌. 57・3. 58-63 (2003)

    • Related Report
      2002 Annual Research Report

URL: 

Published: 2002-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi