• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Human Interface that detects user's intentions and emotions from their gestures and facial expressions

Research Project

Project/Area Number 11832012
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research InstitutionShizuoka University

Principal Investigator

NAKATANI Hiromasa  Shizuoka University, Department of Computer Science ; Professor, 情報学部, 教授 (80109131)

Co-Investigator(Kenkyū-buntansha) ITOH Toshihiko  Shizuoka University, Department of Computer Science ; Assistant, 情報学部, 助手 (20313926)
SAJI Hitoshi  Shizuoka University, Department of Computer Science ; Associate Professor, 情報学部, 助教授 (10283334)
Project Period (FY) 1999 – 2001
Project Status Completed (Fiscal Year 2001)
Budget Amount *help
¥3,700,000 (Direct Cost: ¥3,700,000)
Fiscal Year 2001: ¥1,000,000 (Direct Cost: ¥1,000,000)
Fiscal Year 2000: ¥1,100,000 (Direct Cost: ¥1,100,000)
Fiscal Year 1999: ¥1,600,000 (Direct Cost: ¥1,600,000)
KeywordsInterface / Face / Gesture / Finger / Hand / Motion / Image / 3D / 顔
Research Abstract

Conventional interactions between humans and machines are performed mainly by keyboards or special pointing devices. In this project, we have investigated human interface that analyzes user's gestures and facial expressions and identifies their intentions and emotions. The main subjects of this projects are as follows :
1. 3D facial motion measuring system
We have developed a method for measuring three- dimensional moving facial shapes. The system uses two light sources and a slit pattern projector. Natural facial motions can be entered to the system with the sampling rate up to 2/15 sec.
2. Human detection
We have investigated human detection techniques for the system to know the presence of the users. We have presented a moving objects detection technique using edge vectors and edge reliability measures, and a human detection technique using color indexing.
3. Tracking and recognizing facial expressions
We have investigated techniques for tracking and recognizing user's facial expressions. The technique is based on anatomical knowledge on locations and orientations of facial muscles, so that the system can enter the image features from natural facial motions.
4. Gesture analysis
Hands and fingers play an important role in indicating an object. We have developed a stereo method for tracking three-dimensional motions of a hand, and a method for identifying which fingers are stretched.

Report

(4 results)
  • 2001 Annual Research Report   Final Research Report Summary
  • 2000 Annual Research Report
  • 1999 Annual Research Report
  • Research Products

    (15 results)

All Other

All Publications (15 results)

  • [Publications] 杉山岳弘: "エッジベクトルとエッジの信頼度を用いた移動物体の検出"電子情報通信学会技術研究報告. 101,58. 57-62 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] INAGUMA, Takanao: "Efficient search technique for hand gesture tracking in three dimensions"Lecture Notes in Computer Science 1811,Biologically Motivated Computer Vision, Springer. 594-601 (2000)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 萩本憲俊: "色と動き情報を用いた人物の腕の動作追跡"電子情報通信学会技術研究報告. 99,448. 25-30 (1999)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] SUGIYAMA Takahiro: "Detection of moving objects by using edge vector and edge reliability (in Japanese)"Technical Report of IEICE, PRMU2001-16. 57-62 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] INAGUMA Takanao: "Efficient search technique for hand gesture tracking in three dimensions"Lecture Notes in Computer Science 1811, Biologically Motivated Computer Vision, Springer. 594-601 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] HAGIMOTO Noritoshi: "Human arm tracking using color and motion information (in Japanese)"Technical Report of IEICE, PRMU99-104. 25-30 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 杉山 岳弘: "エッジベクトルとエッジの信頼度を用いた移動物体の検出"電子情報通信学会技術研究報告. 101・58. 57-62 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] 内田 達也: "指示動作認識のための指領域解析"2001年度電気関係学会東海支部連合大会講演論文集. 258 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] 安藤 勝己: "カラーインデクシング法を用いた人物検出"電子情報通信学会2002年総合大会. (発表予定). (2002)

    • Related Report
      2001 Annual Research Report
  • [Publications] 稲熊孝直: "Efficient search technique for hand gesture tracking in three dimensions"S.W.Lee et.al.Eds.: Biologically Motivated Computer Vision. 594-601 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] 渡辺和久: "エッジベクトルとエッジの信頼度を用いた移動物体の検出"電子情報通信学会2001年総合大会情報・システム講演論文集. 2(発表予定). (2001)

    • Related Report
      2000 Annual Research Report
  • [Publications] 上口善明: "三次元空間での手の動作の追跡と認識"電子情報通信学会2001年総合大会情報・システム講演論文集. 2(発表予定). (2001)

    • Related Report
      2000 Annual Research Report
  • [Publications] 一丸勇二: "幾何学的拘束を用いた両眼ステレオ法による手の追跡"電子情報通信学会2001年総合大会情報・システム講演論文集. 2(発表予定). (2001)

    • Related Report
      2000 Annual Research Report
  • [Publications] 太田寛志: "顔面筋に基づいた顔構成要素モデルによる表情変化の認識"電子情報通信学会論文詩D-II. J82-D-II・7. 1129-1139 (1999)

    • Related Report
      1999 Annual Research Report
  • [Publications] 萩本憲俊: "色と動き情報を用いた人物の腕の動作追跡"電子情報通信学会技術研究報告PRMU99-104. 99・448. 25-30 (1999)

    • Related Report
      1999 Annual Research Report

URL: 

Published: 1999-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi