• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Research on eye contact recognition with active camera

Research Project

Project/Area Number 16200014
Research Category

Grant-in-Aid for Scientific Research (A)

Allocation TypeSingle-year Grants
Section一般
Research Field Perception information processing/Intelligent robotics
Research InstitutionWakayama University

Principal Investigator

WADA Toshikazu  Wakayama University, Faculty of System Engineering, professor, システム工学部, 教授 (00231035)

Co-Investigator(Kenkyū-buntansha) WU Haiyuan  Wakayama University, Faculty of System Engineering, associate professor, システム工学部, 准教授 (70283695)
NAKAMURA Takayuki  Wakayama University, Faculty of System Engineering, associate professor, システム工学部, 准教授 (50291969)
CHEN Qien  Wakayama University, Faculty of System Engineering, associate professor, システム工学部, 准教授 (70263233)
KATO Takekazu  Wakayama University, Faculty of System Engineering, instructor, システム工学部, 講師 (30362859)
Project Period (FY) 2004 – 2006
Project Status Completed (Fiscal Year 2006)
Budget Amount *help
¥48,100,000 (Direct Cost: ¥37,000,000、Indirect Cost: ¥11,100,000)
Fiscal Year 2006: ¥11,050,000 (Direct Cost: ¥8,500,000、Indirect Cost: ¥2,550,000)
Fiscal Year 2005: ¥17,810,000 (Direct Cost: ¥13,700,000、Indirect Cost: ¥4,110,000)
Fiscal Year 2004: ¥19,240,000 (Direct Cost: ¥14,800,000、Indirect Cost: ¥4,440,000)
KeywordsView direction estimation / Two circle method / PaLM-tree / K-means tracker / Distinctiveness / Active stereo tracking / K-d decision tree / Principal component tree / PaLm-tree / 色ターゲット検出・追跡 / 色弁別度 / 能動ステレオカメラ / アイモデル / PaLM-Tree / 視線認識 / 顔検出 / 対象追跡 / 能動追跡 / 視線方向の推定 / 実時間黒目追跡
Research Abstract

In this research, we address "eye contact recognition problem", i.e., estimating a human gaze direction from a single image. This problem can be positioned in the field of Computer Vision, which was initiated by imitating human visual functions, because this problem can also be regarded as an imitation of a visual function that people are sensitive to those who watching them.
The possible approaches for realizing this peculiar function are classified into two types : 1) gaze recognition based on the iris contour shape and 2) gaze recognition based on the positional arrangement of pupils and other face organs. We investigated and compared both approaches. According to the first approach, we developed a gaze estimation algorithm based on ellipse fitting to the iris contours using an eye-model. Of course, each person has different eye ball diameter and distance between eye balls. These personal parameters can be estimated from short image sequence less than 5 seconds. After that, precise e … More ye direction estimation can be performed within NTSC video interval (33[ms]). On the other hand, we developed a gaze estimation algorithm according to the second approach. For this algorithm, we developed a learning algorithm for non-linear mapping named "PaLM-tree". By using this algorithm, we can estimate the viewing direction from the positional arrangement of face organs, to visual direction, it requires large training data and the accuracy of the vertical direction is less than the first one.
Also, we investigated problems of 3) active visual tracking for capturing high quality eye image of moving objective person and 4) recognition method for eye contact recognition. For the third problem, we developed a visual tracking algorithm adaptive to color change named "k-means tracker". This algorithm is robust against the color shift and shape deformation of the object. And we extend it to "reliability based k-means tracker" for further improvement of the robustness. We also developed another very fast tracking algorithm based on the distinctiveness of target colors. By using these algorithms, high performance active stereo tracking system have been constructed. For the fourth problem, we developed an accelerated algorithm of nearest neighbor classification named "k-d decision tree". Currently, this is the world fastest nearest neighbor classifier. Less

Report

(4 results)
  • 2006 Annual Research Report   Final Research Report Summary
  • 2005 Annual Research Report
  • 2004 Annual Research Report
  • Research Products

    (50 results)

All 2007 2006 2005 2004

All Journal Article (49 results) Patent(Industrial Property Rights) (1 results)

  • [Journal Article] 高速追従型能動カメラシステム2007

    • Author(s)
      大池洋史, 呉海元, 華春生, 和田俊和
    • Journal Title

      システム制御情報学会論文誌 Vol.20, No.3

      Pages: 114-121

    • NAID

      10020046748

    • Related Report
      2006 Annual Research Report
  • [Journal Article] K-means tracker : A General Algorithm for Tracking People2006

    • Author(s)
      Chunsheng Hua, Haiyuan Wu, Qian Chen, Toshikazu Wada
    • Journal Title

      Journal of Multimedia Vol. 1 Issue. 4

      Pages: 46-53

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] 高速追従型能動カメラシステム2006

    • Author(s)
      大池洋史, 呉海元, 華春生, 和田俊和
    • Journal Title

      システム制御情報学会論文誌 Vol. 20, No. 3

      Pages: 114-121

    • NAID

      10020046748

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] K-means tracker : A General Algorithm for Tracking People.2006

    • Author(s)
      Chunsheng Hua, Haiyuan Wu, Qian Chen, Toshikazu Wada
    • Journal Title

      Journal of Multimedia Vol.1 Issue.4

      Pages: 46-53

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] High-speed Object Tracking System using Active Camera2006

    • Author(s)
      Hiroshi Oike, Haiyuan Wu, Chunsheng Hua, Toshikazu Wada
    • Journal Title

      Transactions of ISCIE Vol.20, No.3

      Pages: 114-121

    • NAID

      10020046748

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] K-means tracker : A General Algorithm for Tracking People2006

    • Author(s)
      Chunsheng Hua, Haiyuan Wu, Qian Chen, Toshikazu Wada
    • Journal Title

      Journal of Multimedia Vol.1 Issue.4

      Pages: 46-53

    • Related Report
      2006 Annual Research Report
  • [Journal Article] General Framework for Tracking People.2006

    • Author(s)
      Chunsheng Hua, Haiyuan Wu, Qian Chen, Toshikazu Wada
    • Journal Title

      Proc. of 7th IEEE International Conference, Automatic Face and Gesture Recognition Vol.1

      Pages: 511-516

    • Related Report
      2006 Annual Research Report
  • [Journal Article] 色弁別度を用いた実時間ステレオ対象検出・追跡2006

    • Author(s)
      飯塚健男, 和田俊和
    • Journal Title

      画像の認識・理解シンポジウム(MIRU2006)予稿集

      Pages: 1072-1077

    • Related Report
      2006 Annual Research Report
  • [Journal Article] 分離度フィルタとPaLM-treeを用いた視線方向の推定2006

    • Author(s)
      松本拓也, 呉海元, 和田俊和, 中村恭之
    • Journal Title

      画像の認識・理解シンポジウム(MIRU2006)予稿集

      Pages: 1042-1047

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Pixel-wise Object Tracking Algorithm with Target and Background Sample2006

    • Author(s)
      Chunsheng Hua, Haiyuan Wu, Qian Chen, Toshikazu Wada
    • Journal Title

      Proc. of 18th International Conference on Pattern Recognition Vol.1

      Pages: 379-382

    • Related Report
      2006 Annual Research Report
  • [Journal Article] オプティカルフローの無相関化によるエゴモーション解析2006

    • Author(s)
      高田亮, 呉海元, 和田俊和
    • Journal Title

      情報処理学会研究報告 2006-CVIM-153-6

      Pages: 33-40

    • NAID

      110004788320

    • Related Report
      2005 Annual Research Report
  • [Journal Article] マーカの軌跡を用いた非同期カメラの幾何学的・時間的キャリブレーション2006

    • Author(s)
      野口真身, 加藤丈和
    • Journal Title

      情報処理学会論文誌:コンピュータビジョンとイメージメデイア Vol.47, No.SIG5(CVIM13)

      Pages: 59-68

    • NAID

      110004709480

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 空間分割と直交変換の統合による高次元最近傍探索の高速化.2006

    • Author(s)
      荒井英剛, 加藤丈和, 和田俊和
    • Journal Title

      情報処理学会研究報告 2006-CVIM-153-7

      Pages: 41-48

    • NAID

      110004788321

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 効率的な距離計算戦略による高次元最近傍探索の高速化2006

    • Author(s)
      武本浩二, 加藤丈和, 和田俊和
    • Journal Title

      情報処理学会研究報告 2006-DVIM-153-8

      Pages: 49-56

    • NAID

      110004788322

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 事例ベース対象追跡・認識のための近さ優先探索グラフの対話的構築アルゴリズム2006

    • Author(s)
      坂平星弘, 和田俊和, 坂垣内洵也, 加藤丈和
    • Journal Title

      情報処理学会研究報告 2006-CVIM-153-13

      Pages: 85-92

    • NAID

      110004788327

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Chamfer Matchingを利用した有向NFTGとその応用2006

    • Author(s)
      岡田大輝, 和田俊和, 坂垣内洵也
    • Journal Title

      情報処理学会研究報告 2006-CVIM-153-14

      Pages: 93-100

    • NAID

      110004788328

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 連続特徴空間における決定木構築法と顔検出への応用2006

    • Author(s)
      林拓, 和田俊和, 加藤丈和
    • Journal Title

      情報処理学会研究報告 2006-CVIM-153-

      Pages: 125-130

    • NAID

      110004788333

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 複数カメラを用いたCondensationによる複数人物頭部の実時間検出・追跡2006

    • Author(s)
      松元郁佑, 加藤丈和, 和田俊和
    • Journal Title

      情報処理学会研究報告 2006-CVIM-153-45

      Pages: 293-300

    • NAID

      110004788359

    • Related Report
      2005 Annual Research Report
  • [Journal Article] K-D Decision Tree とその応用-最近傍識別器の高速化と省メモリ化2005

    • Author(s)
      柴田智行, 加藤丈和, 和田俊和
    • Journal Title

      電子情報通信学会論文誌 D-II Vol. J88-D2 No. 8

      Pages: 1367-1377

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] 非線形写像学習のためのPaLM-treeの提案2005

    • Author(s)
      中村恭之, 加藤丈和, 和田俊和
    • Journal Title

      日本ロポット学会誌 Vol. 23

      Pages: 732-742

    • NAID

      10019037777

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] High Performance Control of Active Camera Head Using PaLM-Tree2005

    • Author(s)
      T.Nakamura, Y.Sakata, T.Wada, H.Wu
    • Journal Title

      IEEE/ASME International Conference on Advanced Intelligent Mechatronics 2005

      Pages: 963-968

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Visual Direction Estimation from a Monocular Image2005

    • Author(s)
      Haiyuan WU, Qian CHEN, Toshikazu Wada
    • Journal Title

      IEICE TRANSACTIONS on Information and Systems Vol. E88-D, No. 10

      Pages: 2277-2285

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] K-means tracking with variable ellipse model2005

    • Author(s)
      Chunsheng Hua, Haiyuan Wu, Toshikazu Wada, Qian Chen
    • Journal Title

      情報処理学会論文誌(トランザクション) コンピュータビジョンとイメージメディア Vol. 46 No. SIG15 CVIM12

      Pages: 59-68

    • NAID

      110003274080

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] K-D Decision Tree : An accelerated and Memory Efficient Nearest Neighbor Classifier2005

    • Author(s)
      Tomoyuki Shibata, Takekazu Kato, Toshikazu Wada
    • Journal Title

      IEICE TRANSACTIONS on Information and Systems Vol.J88-D2 No.8

      Pages: 1367-1377

    • NAID

      10016796339

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] A Novel Nonlinear Mapping Algorithm (PaLM Tree)2005

    • Author(s)
      Takayuki Nakamura, Takekazu Kato, Toshikazu Wada
    • Journal Title

      Journal of the Robotics Society of Japan Vol.23

      Pages: 732-742

    • NAID

      10019037777

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Visual Direction Estimation from a Monocular Image2005

    • Author(s)
      Haiyuan WU, Qian CHEN, Toshikazu Wada
    • Journal Title

      IEICE TRANSACTIONS on Information and Systems Vol.E88-D, No.10

      Pages: 2277-2285

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] K-means tracking with variable ellipse model2005

    • Author(s)
      Chunsheng Hua, Haiyuan Wu, Toshikazu Wada, Qian Chen
    • Journal Title

      WSJ Transactions on Computer Vision and Image Media Vol.46 No.SIG15 CVIM12

      Pages: 59-68

    • NAID

      110003274080

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] アイモデルを用いた視線推定のための黒目追跡2005

    • Author(s)
      北川洋介, 加藤丈和, 呉海元, 和田俊和
    • Journal Title

      画像の認識・理解シンポジウム(MIRU'05) Vol.2005・No.7

      Pages: 1343-1350

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Visual Direction Estimation from a Monocular Image2005

    • Author(s)
      H.WU, Q.CHEN, T.Wada
    • Journal Title

      Journal of The Transactions of the Institute of Electronics, Information and Communication Engineers Vol.E88-D・No.10

      Pages: 2277-2285

    • Related Report
      2005 Annual Research Report
  • [Journal Article] K-means tracking with variable ellipse model2005

    • Author(s)
      C.HUA, H.WU, T.WADA, Q.CHEN
    • Journal Title

      Information Processing Society of Japan Vol.46・No.SIG15

      Pages: 59-68

    • NAID

      110003274080

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 事例を用いた弁別性マップの構築とその応用2005

    • Author(s)
      飯塚健男, 和田俊和, 華春生, 中村恭之
    • Journal Title

      情報処理学会研究報告 2005-CVIM・151

      Pages: 65-70

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 非線形写像学習のためのPaLM-treeの提案2005

    • Author(s)
      中村恭之, 加藤丈和, 和田俊和
    • Journal Title

      日本ロボット学会誌 Vol.23・No.9

      Pages: 732-742

    • NAID

      10019037777

    • Related Report
      2005 Annual Research Report
  • [Journal Article] K-D Decision Treeとその応用-最近傍識別器の高速化と省メモリ化2005

    • Author(s)
      柴田智行, 加藤丈和, 和田俊和
    • Journal Title

      電子情報通信学会論文誌D-II VOL.J88-D2・No.8

      Pages: 1367-1377

    • Related Report
      2005 Annual Research Report
  • [Journal Article] High Performance Control of Active Camera Head Using PaLM-Tree2005

    • Author(s)
      T.Nakamura, Y.Sakata, T.Wada, H.Wu
    • Journal Title

      IEEE/ASME International Conference on Advance Intelligent Mechatronics 2005

      Pages: 963-968

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 近さ優先探索グラフを用いた実時間対象追跡2005

    • Author(s)
      坂垣内洵也, 加藤丈和, 和田俊和
    • Journal Title

      画像の認識・理解シンポジウム(MIRU'05)

      Pages: 16-23

    • Related Report
      2005 Annual Research Report
  • [Journal Article] マーカーの軌跡を用いた非同期カメラの幾何学的・時間的キャリブレーション2005

    • Author(s)
      野口真身, 加藤丈和
    • Journal Title

      画像の認識・理解シンポジウム(MIRU'05)

      Pages: 32-39

    • NAID

      110004709480

    • Related Report
      2005 Annual Research Report
  • [Journal Article] NAMA-CON:ネットワーク結合された複数センサを用いたCondensationによる人物頭部追跡2005

    • Author(s)
      松元郁佑, 加藤丈和, 和田俊和
    • Journal Title

      画像の認識・理解シンポジウム(MIRU'05)

      Pages: 411-418

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 一般化K-D Decision Tree-近接性グラフによるEditingを利用した最近傍識別器の高速化-2005

    • Author(s)
      柴田智行, 和田俊和, 加藤丈和
    • Journal Title

      画像の認識・理解シンポジウム(MIRU'05)

      Pages: 886-893

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 視点固定型パン・チルトステレオカメラによるリアルタイム3次元計測システム2005

    • Author(s)
      飯塚健男, 和田俊和, 中村恭之, 加藤丈和, 吉岡悠一
    • Journal Title

      画像の認識・理解シンポジウム(MIRU'05)

      Pages: 1620-1620

    • Related Report
      2005 Annual Research Report
  • [Journal Article] アイモデルを用いたConDensationによる視線推定2005

    • Author(s)
      北川洋介, 加藤丈和, 呉海元, 和田俊和.
    • Journal Title

      情報処理学会研究報告 2005-CVIM-150-3

      Pages: 17-24

    • NAID

      110002702264

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Network Augmented Multisensor Association-Condensaion : Condensationの自然な拡張による3次元空間内での人物頭部の実時間追跡2005

    • Author(s)
      松元郁佑, 加藤丈和, 和田俊和
    • Journal Title

      情報処理学会研究報告 2005-CVIM-150-20

      Pages: 161-168

    • Related Report
      2005 Annual Research Report
  • [Journal Article] アイモデルを用いたCondensationによる黒目追跡2005

    • Author(s)
      北川洋介, 加藤丈和, 呉海元, 和田俊和
    • Journal Title

      信学技報 PRMU2005-200

      Pages: 13-18

    • NAID

      10014508601

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Camera Calibration with Two Arbitrary Coplanar Circles2004

    • Author(s)
      Q.Chen, H.Wu, T.Wada
    • Journal Title

      Proc. IEEE Conf. ECCV'04

      Pages: 521-532

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Conic-Based Algorithm for Visual Line Estimation from One Image2004

    • Author(s)
      H.Wu, Q.Chen, T.Wada
    • Journal Title

      Proc. of IEEE Conf. on FG'04

      Pages: 260-265

    • NAID

      110003314242

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary 2004 Annual Research Report
  • [Journal Article] Direct Condensing : An Efficient Voronoi Condensing Algorithm for Nearest Neighbor Classifiers2004

    • Author(s)
      T.Kato, T.Wada
    • Journal Title

      Proc. of 17th IAPR International Conference on Pattern Recognition (ICPR04)

      Pages: 135-139

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary 2004 Annual Research Report
  • [Journal Article] Direct Condensing : An Efficient Voronoi Condensing Algorithm for Nearest Neighbor Classifiers2004

    • Author(s)
      T.Kato, T.Wada
    • Journal Title

      Proc. of 17th IAPR International Conference on Pattern Recognition ICPRO4

      Pages: 135-139

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Camera Calibration with Two Arbitrary Coplanar Circles2004

    • Author(s)
      Q.Chen, H.Wu, T.Wada
    • Journal Title

      Proc.IEEE Conf.ECCV'04

      Pages: 521-532

    • Related Report
      2004 Annual Research Report
  • [Journal Article] 最近傍識別による背景差分と色検出の統合 -事例に基く情報統合-2004

    • Author(s)
      加藤丈和, 和田俊和
    • Journal Title

      情報処理学会論文誌:コンピュータビジョンとイメージメディア 45・SIG13(CVIM10)

      Pages: 110-117

    • Related Report
      2004 Annual Research Report
  • [Journal Article] 可変楕円モデルを用いたK-meansトラッキング2004

    • Author(s)
      華春生, 和田俊和, 呉海元
    • Journal Title

      情処研報, CVIM145-16

      Pages: 113-120

    • NAID

      110003274080

    • Related Report
      2004 Annual Research Report
  • [Patent(Industrial Property Rights)] 非線形写像学習コンピュータプログラム,および記録媒体2005

    • Inventor(s)
      中村恭之, 和田俊和
    • Industrial Property Rights Holder
      国立大学法人和歌山大学
    • Patent Publication Number
      2006-338123
    • Filing Date
      2005-05-31
    • Acquisition Date
      2006-12-14
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary

URL: 

Published: 2004-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi