• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

CONSTRUCTION OF QUANTITATIVE ESTIMATION SYSTEM OF FACE EXPRESSION BASED ON 3D HUMAN HEAD STRUCTURAL MODEL

Research Project

Project/Area Number 06555111
Research Category

Grant-in-Aid for Scientific Research (A)

Allocation TypeSingle-year Grants
Section試験
Research Field 情報通信工学
Research InstitutionSEIKEI UNIVERSITY

Principal Investigator

OOKURA Motohiro  SEIKEI UNIVERSITY,DEPARTMENT OF ENGINEERING,ASSOCIATE PROFESSOR, 工学部, 助教授 (30119341)

Co-Investigator(Kenkyū-buntansha) HARASHIMA Hiroshi  UNIVERSITY OF TOKYO,DEPARTMENT OF ENGINEERING PROFESSOR, 工学部, 教授 (60011201)
CHIBA Hirohiko  SYUKUTOKU UNIVERSITY,DEPARTMENT OF SOCIETY,ASSOCIATE PROFESSOR, 社会学部, 助教授 (40207296)
YAMADA Hiroshi  KAWAMURA WOMAN'S UNIVERSITY,DEPARTMENT OF BASICS,ASSOCIATE PROFESSOR, 教養科目, 助教授 (80191328)
MORISHIMA Shigeo  SEIKEI UNIVERSITY,DEPARTMENT OF ENGINEERING,ASSOCIATE PROFESSOR, 工学部, 助教授 (10200411)
Project Period (FY) 1994 – 1996
Project Status Completed (Fiscal Year 1996)
Budget Amount *help
¥12,100,000 (Direct Cost: ¥12,100,000)
Fiscal Year 1996: ¥2,200,000 (Direct Cost: ¥2,200,000)
Fiscal Year 1995: ¥3,600,000 (Direct Cost: ¥3,600,000)
Fiscal Year 1994: ¥6,300,000 (Direct Cost: ¥6,300,000)
KeywordsEXPRESSION SYNTHESIS / EMOTION SPACE / EXPRESSION RECOGNITION / EXPRESSION ESTIMATION / ACTION UNIT / TEXTURE MAPPING / NEURAL NETWORK / LIP SYNCHRONIZATION / コンピュータグラフィックス / 表情分析 / 3次元モデル / モーションキャプチャ / コンピュータビジョン / ヒューマンコンピュータインタラクション / 感性情報処理 / FACS / モデリング / エージェント / 3次元グラフィックス
Research Abstract

In this research, firstly a system for measuring 3d struction of face is constructed. In this system, markers are located on surface of the face and geometry is captured by 2 cameras located on front and side by tracking each marker. By using this system, quantitative description of Facial Action Coding System and feature of lip shape when utterance are realized. And this system make it possible to synthesized facial expression as it is by modifying 3d wireframe and texture mapping of frontal face image.
Next, six basic expression are realized by combination of action unit and 3d emotion space is constructed by neural network for identity mapping. Specific facial expression is described by the point in 3d emotion space and this emotion space can realize both analysis and synthesis of facial expression. By estimation of this emotion space, expression is defined continuously in this space and it is approved this emotion space is good in psychological meanings.
Finaly, automatic face expression recognition is realized without any markers. In this system, spatial frequency in mouth and eye region is calculated and converted to one of the emotion categories by neural network. This system is running in real time and recognition performance is similar to human subjective recognition.

Report

(4 results)
  • 1996 Annual Research Report   Final Research Report Summary
  • 1995 Annual Research Report
  • 1994 Annual Research Report
  • Research Products

    (38 results)

All Other

All Publications (38 results)

  • [Publications] 坂口竜己、山田寛、森島繁生: "顔画像を基にした3次元感情モデルの構築とその評価" 電子情報通信学会論文誌A. J80-A. 1279-1284 (1997)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] 坂口竜己、森島繁生: "画像の2次元離散コサイン変換を利用した実時間顔表情認識" 電子情報通信学会論文誌DII. J80-DII. 1547-1554 (1997)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] 森島繁生: "表情筋の3次元物理モデルに基づく人物表情の分析・合成" 3D映像. 11. 7-18 (1997)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] Shigeo Morishima: "Modeling of Facial Expression and Emotion for Human Communication System" International Journal of Display. 17. 15-25 (1996)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] 川上文雄、大倉元宏、山田寛 原島博、森島繁生: "3D Emotion Space for Interactive Communication" Lecture Notes in Computer Science. 471-478 (1995)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] 川上文雄、森島繁生、山田寛 原島博: "Construction and Psychological Evaluation of 3-D Emotion Space" Journal of Biomedical Fuzzy Systems Association. 1. 33-42 (1995)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] Nobuo Ueki, Shigeo Morishima, Hiroshi Yamada, Hiroshi Harashima: "Expression Analysis/Synthesis System Based on Emotion Space Constructed by Multilayered Neural Network" Systems and Computers in Japan, Scripta Technica, INC.Vol.25, No.13. 95-107 (1995)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] Fumio Kawakami, Shigeo Morishima, Hiroshi Yamada, Hiroshi Harashima: "Construction and Psychological Evaluation of 3-D Emotion Space" Journal of Biomedical Fuzzy Systems Association, Biomedical Fuzzy and HUman Sciences. Vol.1, No.1. 33-42 (1995)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] Shigeo Morishima: "Modeling of Facial Expression and Emotion for Human Communication System" International Journal of Display (Elsevier). Vol.17. 15-25 (1996)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] Fumio Kawakami, Shigeo Morishima, Hiroshi Yamada, Hiroshi Harashima: "Construction of 3-D Emotion Space Based on Parameterized Faces" Proceedings of 3rd IEEE International Workshop on Robot and Human Communication. 216-221 (1994)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] Fumio Kawakami, Shigeo Morishima, Hiroshi Yamada and Hiroshi Harashima: "Construction of 3-D Emotion Space using Neural Network" Proceedings of the 3rd International Conference on Fuzzy Logic, Neural Nets and Soft Computing. 309-310 (1994)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] Shigeo Morishima, Shoichiro Iwasawa, Tatsumi Sakaguchi, Fumio Kawakami Makoto Ando: "Better Face Communication" Visual Proceedings of ACM SIGGRAPH'95, Interactive Communities. 117 (1995)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] Tatsumi Sakaguchi, Shigeo Morishima, Jun Ohya, Fumio Kishino: "Facial Expression Recognition from Image Sequences using Hidden Markov Model" Proceedings of 2nd Asian Conference on Computer Vision (ACCV'95). Vol.3. 713-717 (1995)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] Fumio Kawakami, Motohiro Ohkura, Hiroshi Yamada, Hiroshi Harashima, and Shigeo Morishima: "3-D Emotion Space for Interactive Communication, Proceedings of International Computer Science Conference, Lecture Note in Computer Science" Image Analysis Application and Computer Graphics, Springer. 471-478 (1995)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] H.Nakamura, N.Matsuzaki, S.Morishima, H.Yamada: "A Psychophysical Study on Perception of Facial Expressions Expecially on the Perceived Strengths of Expressions" Proceedings of International Conference of Psychology. 484.80 (1996)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] Tatsumi Sakaguchi, Shigeo Morishima: "Face Feature Extraction from Spatial Frequency for Dynamic Expression Recognition" Proceedings of International Conference on Pattern Recognition. C451-455 (1996)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] Jun Sato, Shigeo Morishima: "Emotion Modeling in Speech Production using Emotion Space" Proceedings of IEEE International Workshop on Robot and Human Communication. 472-477 (1996)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] Naoya Miyashita, Tatsumi Sakaguchi, Shigeo Morishima: "A Face to Face Communication using Real-Time Media Conversion System" Proceedings of IEEE International Workshop on Robot and Human Communication. 543-544 (1996)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] Hajime Sera, Shigeo Morishima, Demetri Terzopoulos: "Physics-based Muscle Model for Mouth Shape Control" Proceedings of IEEE International Workshop on Robot and Human Communication. 207-212 (1996)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] Shigeo Morishima, Fumio Kawakami, Hirosh Yamada, Hiroshi Harashima: A Modeling of Facial Expression and Emotion for Recognition and Synthesis Symbiosis of Human and Artifact : Future Computing and Design for Human Computer Interaction. Elsevier, 251-256 (1995)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] 森島繁生: "Modeling of Facial Expression and Emotion for Human Communication System" International Journal of Display. 17. 15-25 (1996)

    • Related Report
      1996 Annual Research Report
  • [Publications] 坂口竜己、森島繁生: "Face Feature Extraction from Spatial Frequency for Dynamic Expression Recognition" Proceedings of ICPR (Pattern Recognition). 13. 451-455 (1996)

    • Related Report
      1996 Annual Research Report
  • [Publications] 中村宏信、森島繁生、山田寛: "A psychological Study on Perception of Facial Expression Especially on the Perceived Strengths of Expressions" Proceedings of International Conference of Psychology. 484.80- (1996)

    • Related Report
      1996 Annual Research Report
  • [Publications] 川上文雄、大倉元宏、山田寛 他: "3-D Emotion Space for Interactive Communication" Proceedings of ICSC (Computer Science Conference). 471-481 (1995)

    • Related Report
      1996 Annual Research Report
  • [Publications] 坂口竜己、森島繁生 他: "Facial Expression Recognition from Image Sequences Using Hidden Markov Model" Proceedings of Asian Conference on Computer Vision. 2. 713-717 (1995)

    • Related Report
      1996 Annual Research Report
  • [Publications] 川上文雄、大倉元宏、原島博 他: "An Evaluation of 3D Emotion Space" Proceedings of IEEE Roman 95. 4. 1060-1067 (1995)

    • Related Report
      1996 Annual Research Report
  • [Publications] 川上文雄、大倉元宏、山田寛、森島繁生 他: "3-D Emotion Space for Interactive Communication" Image Analysis Application and Computer Graphics,Springer. 471-478 (1995)

    • Related Report
      1996 Annual Research Report
  • [Publications] 共著: "知能情報メディア" 総研出版, 263 (1995)

    • Related Report
      1996 Annual Research Report
  • [Publications] Motohiro Ohkura et. al: "3-D Emotion Space for Interactive Communication" Image Analysis Application and Computer Graphics. 471-478 (1995)

    • Related Report
      1995 Annual Research Report
  • [Publications] Motohiro Ohkura et. al.: "An Evaluation of 3-D Emotion Space" Proc. of IEEE Roman '95. 269-274 (1995)

    • Related Report
      1995 Annual Research Report
  • [Publications] Hiroshi Yamada et. al: "A Modeling of Facial Expression and Emotion for Recognition and Synthesis" Future Computing and Design for HCI. 251-256 (1995)

    • Related Report
      1995 Annual Research Report
  • [Publications] 山田寛 他: "顔面表情知覚の心理物理学的研究" 日本心理学会第59回大会講演論文集. (1995)

    • Related Report
      1995 Annual Research Report
  • [Publications] 山田寛 他: "ニューラルネットを用いた表情パラメータ推定の試み" テレビジョン学会映像メディア部門冬季大会講演集. 50 (1995)

    • Related Report
      1995 Annual Research Report
  • [Publications] 山田寛 他: "仮想現実的顔画像処理システムを用いた顔面表情知覚の精神物理学的研究" 電子情報通信学会 技術研究報告. 15-20 (1995)

    • Related Report
      1995 Annual Research Report
  • [Publications] 原島博他: "レンジデータ基づく顔モデルの生成とリアルな表情合成" NICOGRAPH論文コンテンス論文集. 10. 11-21 (1994)

    • Related Report
      1994 Annual Research Report
  • [Publications] Hiroshi Yamada et.al.: "Construction of 3-D Emotion Space using Neural Network" Proceedings of Fuzzy Logic,Neural Nets and Soft Computing. 3. 309-310 (1994)

    • Related Report
      1994 Annual Research Report
  • [Publications] Hiroshi Harashima et.al.: "Construction of 3-D Emotion Space Based on Parameterized Faces" Proceedings of 3rd IEEE Roman′94. 3. 216-221 (1994)

    • Related Report
      1994 Annual Research Report
  • [Publications] 原島博他: "顔画像の3次元計測によるAU定量化の試み" 電子情報通信学会全国大会講演論文集. A332 (1994)

    • Related Report
      1994 Annual Research Report

URL: 

Published: 1994-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi