• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to project page

1991 Fiscal Year Final Research Report Summary

Development of the dynamic system of analyzing and synthezising images of facial expressions in terms of image processing and computer graphics techniques, and its application for human behavioral researches.

Research Project

Project/Area Number 01880007
Research Category

Grant-in-Aid for Developmental Scientific Research

Allocation TypeSingle-year Grants
Research Field Informatics
Research InstitutionUniversity of Tokyo

Principal Investigator

HARASHIMA Hiroshi  University of Tokyo, Faculty of Engineering Professor, 工学部, 教授 (60011201)

Co-Investigator(Kenkyū-buntansha) SUZUKI Naoto  Doshisha University, Faculty of Letters Associate Professor, 文学部, 助教授 (30094428)
MAIYA Kiyoshi  Nara University, Faculty of Sociology Assistant Professor, 社会学部, 講師 (70157121)
CHIBA Hirohiko  Shukutoku University, Faculty of Social Welfare Assistant Professor, 社会福祉学部, 講師 (40207296)
YAMADA Hiroshi  Kawamura Junior College, Assistant Professor, 講師 (80191328)
MORISHIMA shigeo  Seikei University, Faculty of Engineering Associate Professor, 工学部, 助教授 (10200411)
Project Period (FY) 1989 – 1991
KeywordsFace / Facial expressions / Image processing / Knowledge-based image coding / Image synthesizing / Computer graphics
Research Abstract

The achievements of our research during last three years are listed as followings.
1. Basic design of the system of analyzing and synthesizing inases of facial expressions.
In the first place, the architecture of the system was examined. Secondly, softwares including ones for image processing and computer graphics to be necessary for developing the system were implenented into the graphic work station. Then, the method of systematic descriptions of inases of face, and facial expressions in terns of knowledge-based lmase codins approach developed by this head investigator and his co-workers. As a result, the advantage of the knowledge-based inase coding approach was verified.
2. Development of application softwares for analyzing iiiages of facial expressions.
The software of detecting the head notion and extracting parameters of shape concerning expressions was developed.
3. Development of application softwares for synthesizing images of facial expressions.
To synthesize natural images of facial expressions only in terms of parameters of shape concerning expressions, the way of deforming a model of face of the system was examined from psychological point of view, so that it can simulate real facial actions. Consequently, based on FACS, the generation rules for synthesizing images of facial expressions were constructed.
4. Psychological Assessment
Extracted facial parameters of expressions and synthesized images of facial expressions were assessed by the psychological experiments. As a result, the validity of our developmental system of analyzing and synthesizins images of facial expressions were confirmed.
5. Examination of the application of our' system for the researches in Psychology and Behay ioral Science.
Significant researches on facial expressions and nonverbal communication in Psychology and Behavioral Science were surveyed. And the role of our developmental svstell to take in those research areas was examined.

  • Research Products

    (33 results)

All Other

All Publications (33 results)

  • [Publications] 原島 博: "3次元モデルを用いた表情の合成と顔形状の変形" 計測自動制御学会 Human Interface N&R. 4. 157-166 (1989)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Aizawa,K.: "Model-based analysis synthesis image coding system for a person's face." Signal Processing:IMAGE COMMUNICATION. 1. 139-152 (1989)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] 崔 昌石: "3次元構造モデルを用いた顔画像の中割り" 第20回画像工学コンファレンス. 33-36 (1989)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Harashima,H.: "Model-based analysis synthesis coding of videotelephone images-Conception and basic study of intelligent image coding-" The Trans.of IEICE. E72. 452-459 (1989)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] 森島 繁生: "知的インタフェ-スのための顔の表情合成法の一検討" 信学論(DーII). J73ーDーII. 351-359 (1990)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] 崔 昌石: "顔の3次元モデルに基づく表情の記述と合成" 信学論(A). J73ーA. 1270-1280 (1990)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] 森島 繁生: "マルチプロセッサ構成による知的画像符号化のためのリアルタイム表情合成の試み" 信学論(DーII). J73ーDーII. 1647-1654 (1990)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Morishima,S.: "A realtime facial action image synthesis system driven by speech and text." SPIE Visual Communication and Image Processing. Oct.(1990)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Choi,C.S.: "Analysis and synthesis of facial image sequence in Knowledge-based image coding" JC-CNSS. Dec. 80-84 (1990)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] 山田 寛: "表情のカテゴリ-化と認識" バイオメカニズム学会誌. 14. 222-228 (1990)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] 原島 博: "知的画像符号化と映像ロボット技術" 計測と制御. 30. 478-484 (1991)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] 原島 博: "顔の表情の人工現実感" 精密工学会誌. 57. 27-30 (1991)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] 崔 昌石: "顔の3次元モデルを用いた顔面表情の分析" 信学論. J74ーDーII. 766-777 (1991)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Morishima,S.: "A natural human-machine interface with model-based image synthesis scheme" Picture Coding Symposium. PCS91. 319-322 (1991)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] 米谷 淳: "MASCで合成した表情の評価" 計測自動制御学会 Human Interface,N&R. 6. 379-388 (1991)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Suzuki,N.: "An attempt to measure facial expressions using image processing analysis" Proceedings of the 22nd International Congress of Applied Psychology.

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] 田多 英興,山田 冨美雄,福田 恭介: "まばたきの心理学" 北大路書房, 291 (1991)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Harashima, H.: "3-D Model-Based Synthesis of Facial Expressions and Shape Deformation." Human Interface, News and Reports. 4. 157-166 (1989)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Aizawa, K.: "Model-Based Analysis Synthesis Image Coding (MBASIC) System for a Person's Face." Image Comm.1. 139-152 (1989)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Choi, C. S.: "Inbetween Method of Facial Images using 3-D Structure Model." Proc. 20nd Conf. Image Eng.33-36 (1989)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Harashima, H.: "Model-Based Analysis Synthesis Coding of Videotelephone Images." Trans. IEICE Japan. E72. 452-459 (1989)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Morishima, S.: "A Facial Motion Synthesis for Intelligent Man-Machine Interface." Trans. IEICE(D-II). J73-D-II. 351-359 (1990)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Choi, C. S.: "3-Dimensional Facial Model-Based Description and Synthesis of Facial Expressions." Trans. IEICE(A). J73-A. 1270-1280 (1990)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Morishima, S.: "A Real Time Model-Based Facial Image Synthesis Based on the Multiple-Processor Network." Trans. IEICE(D-II). J73-D-II. 1647-1654 (1990)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Morishima, S.: "A Real Time Facial Action Image Synthesis System Driven by Speech and Text." SPIE Vol. 1360 Visual Communication and Image Processing '90. 1151-1158 (1990)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Choi, C. S.: "Analysis and Synthesis of Facial Image Sequence in Knowledge-Based Image Coding." 3rd Joint Conf. Comm. Networks Switching Satellite Comm. (JCCNSS). 80-84 (1990)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Yamada, H.: "The Categorization and Recognition of Facial Expressions of Emotions." J. Soc. Biomechanisms. 14. 222-228 (1990)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Harashima, H.: "Intelligent Image Coding and Video-Robot Technology." J. Soc. Inst. Cont. Eng.30. 478-484 (1991)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Harashima, H.: "Artificial Reality in Facial Expressions." JSPE. 57. 27-30 (1991)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Choi, C. S.: "Analysis of Facial Expressions using Three-Dimensional Facial Model." Trans. IEICE(D-II). J74-D-II. 766-777 (1991)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Morishima, S.: "A Natural Human-Machine Interface with Model-Based Image Synthesis Scheme." Picture Coding Symposium. PCS91. 319-322 (1991)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Maiya, K.: "Evaluations of Facial Expressions Synthesized bu MASC." Human Interface, News and Report. 6. 379-388 (1991)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Suzuki N.: "An attempt to measure facial expressions using image processing analysis." Proc. 22nd Inter. Cong. App. Psycho.

    • Description
      「研究成果報告書概要(欧文)」より

URL: 

Published: 1993-03-16  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi