• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Development of the dynamic system of analyzing and synthezising images of facial expressions in terms of image processing and computer graphics techniques, and its application for human behavioral researches.

Research Project

Project/Area Number 01880007
Research Category

Grant-in-Aid for Developmental Scientific Research

Allocation TypeSingle-year Grants
Research Field Informatics
Research InstitutionUniversity of Tokyo

Principal Investigator

HARASHIMA Hiroshi  University of Tokyo, Faculty of Engineering Professor, 工学部, 教授 (60011201)

Co-Investigator(Kenkyū-buntansha) SUZUKI Naoto  Doshisha University, Faculty of Letters Associate Professor, 文学部, 助教授 (30094428)
MAIYA Kiyoshi  Nara University, Faculty of Sociology Assistant Professor, 社会学部, 講師 (70157121)
CHIBA Hirohiko  Shukutoku University, Faculty of Social Welfare Assistant Professor, 社会福祉学部, 講師 (40207296)
YAMADA Hiroshi  Kawamura Junior College, Assistant Professor, 講師 (80191328)
MORISHIMA shigeo  Seikei University, Faculty of Engineering Associate Professor, 工学部, 助教授 (10200411)
水上 啓子  国立小児病院, 小児医療センター, 室長 (30192355)
Project Period (FY) 1989 – 1991
Project Status Completed (Fiscal Year 1991)
Budget Amount *help
¥11,600,000 (Direct Cost: ¥11,600,000)
Fiscal Year 1991: ¥1,900,000 (Direct Cost: ¥1,900,000)
Fiscal Year 1990: ¥3,500,000 (Direct Cost: ¥3,500,000)
Fiscal Year 1989: ¥6,200,000 (Direct Cost: ¥6,200,000)
KeywordsFace / Facial expressions / Image processing / Knowledge-based image coding / Image synthesizing / Computer graphics
Research Abstract

The achievements of our research during last three years are listed as followings.
1. Basic design of the system of analyzing and synthesizing inases of facial expressions.
In the first place, the architecture of the system was examined. Secondly, softwares including ones for image processing and computer graphics to be necessary for developing the system were implenented into the graphic work station. Then, the method of systematic descriptions of inases of face, and facial expressions in terns of knowledge-based lmase codins approach developed by this head investigator and his co-workers. As a result, the advantage of the knowledge-based inase coding approach was verified.
2. Development of application softwares for analyzing iiiages of facial expressions.
The software of detecting the head notion and extracting parameters of shape concerning expressions was developed.
3. Development of application softwares for synthesizing images of facial expressions.
To synthesize natural images of facial expressions only in terms of parameters of shape concerning expressions, the way of deforming a model of face of the system was examined from psychological point of view, so that it can simulate real facial actions. Consequently, based on FACS, the generation rules for synthesizing images of facial expressions were constructed.
4. Psychological Assessment
Extracted facial parameters of expressions and synthesized images of facial expressions were assessed by the psychological experiments. As a result, the validity of our developmental system of analyzing and synthesizins images of facial expressions were confirmed.
5. Examination of the application of our' system for the researches in Psychology and Behay ioral Science.
Significant researches on facial expressions and nonverbal communication in Psychology and Behavioral Science were surveyed. And the role of our developmental svstell to take in those research areas was examined.

Report

(4 results)
  • 1991 Annual Research Report   Final Research Report Summary
  • 1990 Annual Research Report
  • 1989 Annual Research Report
  • Research Products

    (51 results)

All Other

All Publications (51 results)

  • [Publications] 原島 博: "3次元モデルを用いた表情の合成と顔形状の変形" 計測自動制御学会 Human Interface N&R. 4. 157-166 (1989)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] Aizawa,K.: "Model-based analysis synthesis image coding system for a person's face." Signal Processing:IMAGE COMMUNICATION. 1. 139-152 (1989)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] 崔 昌石: "3次元構造モデルを用いた顔画像の中割り" 第20回画像工学コンファレンス. 33-36 (1989)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] Harashima,H.: "Model-based analysis synthesis coding of videotelephone images-Conception and basic study of intelligent image coding-" The Trans.of IEICE. E72. 452-459 (1989)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] 森島 繁生: "知的インタフェ-スのための顔の表情合成法の一検討" 信学論(DーII). J73ーDーII. 351-359 (1990)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] 崔 昌石: "顔の3次元モデルに基づく表情の記述と合成" 信学論(A). J73ーA. 1270-1280 (1990)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] 森島 繁生: "マルチプロセッサ構成による知的画像符号化のためのリアルタイム表情合成の試み" 信学論(DーII). J73ーDーII. 1647-1654 (1990)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] Morishima,S.: "A realtime facial action image synthesis system driven by speech and text." SPIE Visual Communication and Image Processing. Oct.(1990)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] Choi,C.S.: "Analysis and synthesis of facial image sequence in Knowledge-based image coding" JC-CNSS. Dec. 80-84 (1990)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] 山田 寛: "表情のカテゴリ-化と認識" バイオメカニズム学会誌. 14. 222-228 (1990)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] 原島 博: "知的画像符号化と映像ロボット技術" 計測と制御. 30. 478-484 (1991)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] 原島 博: "顔の表情の人工現実感" 精密工学会誌. 57. 27-30 (1991)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] 崔 昌石: "顔の3次元モデルを用いた顔面表情の分析" 信学論. J74ーDーII. 766-777 (1991)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] Morishima,S.: "A natural human-machine interface with model-based image synthesis scheme" Picture Coding Symposium. PCS91. 319-322 (1991)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] 米谷 淳: "MASCで合成した表情の評価" 計測自動制御学会 Human Interface,N&R. 6. 379-388 (1991)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] Suzuki,N.: "An attempt to measure facial expressions using image processing analysis" Proceedings of the 22nd International Congress of Applied Psychology.

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] 田多 英興,山田 冨美雄,福田 恭介: "まばたきの心理学" 北大路書房, 291 (1991)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] Harashima, H.: "3-D Model-Based Synthesis of Facial Expressions and Shape Deformation." Human Interface, News and Reports. 4. 157-166 (1989)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] Aizawa, K.: "Model-Based Analysis Synthesis Image Coding (MBASIC) System for a Person's Face." Image Comm.1. 139-152 (1989)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] Choi, C. S.: "Inbetween Method of Facial Images using 3-D Structure Model." Proc. 20nd Conf. Image Eng.33-36 (1989)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] Harashima, H.: "Model-Based Analysis Synthesis Coding of Videotelephone Images." Trans. IEICE Japan. E72. 452-459 (1989)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] Morishima, S.: "A Facial Motion Synthesis for Intelligent Man-Machine Interface." Trans. IEICE(D-II). J73-D-II. 351-359 (1990)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] Choi, C. S.: "3-Dimensional Facial Model-Based Description and Synthesis of Facial Expressions." Trans. IEICE(A). J73-A. 1270-1280 (1990)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] Morishima, S.: "A Real Time Model-Based Facial Image Synthesis Based on the Multiple-Processor Network." Trans. IEICE(D-II). J73-D-II. 1647-1654 (1990)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] Morishima, S.: "A Real Time Facial Action Image Synthesis System Driven by Speech and Text." SPIE Vol. 1360 Visual Communication and Image Processing '90. 1151-1158 (1990)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] Choi, C. S.: "Analysis and Synthesis of Facial Image Sequence in Knowledge-Based Image Coding." 3rd Joint Conf. Comm. Networks Switching Satellite Comm. (JCCNSS). 80-84 (1990)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] Yamada, H.: "The Categorization and Recognition of Facial Expressions of Emotions." J. Soc. Biomechanisms. 14. 222-228 (1990)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] Harashima, H.: "Intelligent Image Coding and Video-Robot Technology." J. Soc. Inst. Cont. Eng.30. 478-484 (1991)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] Harashima, H.: "Artificial Reality in Facial Expressions." JSPE. 57. 27-30 (1991)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] Choi, C. S.: "Analysis of Facial Expressions using Three-Dimensional Facial Model." Trans. IEICE(D-II). J74-D-II. 766-777 (1991)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] Morishima, S.: "A Natural Human-Machine Interface with Model-Based Image Synthesis Scheme." Picture Coding Symposium. PCS91. 319-322 (1991)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] Maiya, K.: "Evaluations of Facial Expressions Synthesized bu MASC." Human Interface, News and Report. 6. 379-388 (1991)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] Suzuki N.: "An attempt to measure facial expressions using image processing analysis." Proc. 22nd Inter. Cong. App. Psycho.

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1991 Final Research Report Summary
  • [Publications] 原島 博: "知的符号化と映像ロボット技術" 計測と制御. 30. 478-484 (1991)

    • Related Report
      1991 Annual Research Report
  • [Publications] 原島 博: "顔の表情の人工現実感" 精密工学会誌. 57. 27-30 (1991)

    • Related Report
      1991 Annual Research Report
  • [Publications] 崔 昌石: "顔の3次元モデルを用いた顔面表情の分析" 信学論. J74-D-II. 766-777 (1991)

    • Related Report
      1991 Annual Research Report
  • [Publications] Morishima,S.: "A National Human-Machine Interface with Model-Based Image Synthesis Scheme" Picture Coding Symposium. PCS91. 319-322 (1991)

    • Related Report
      1991 Annual Research Report
  • [Publications] 米谷 淳: "MASCで合成した表情の評価" 計測自動制御学会 Human Interface,N&R. 6. 379-388 (1991)

    • Related Report
      1991 Annual Research Report
  • [Publications] Suzuki,N.: "An Attempt to Measure Facial Expressions Using Image Processing Analysis" Proceedings of the 22nd International Congress of Applied Psychology.

    • Related Report
      1991 Annual Research Report
  • [Publications] 森島 繁生: "知的インタ-フェ-スのための顔の表情合成法の一検討" 信学論(DーII). J73ーDーII. 351-359 (1990)

    • Related Report
      1990 Annual Research Report
  • [Publications] 森島 繁生: "マルチプロセッサ構成による知的画像符号化のためのリアルタイム表情合成の試み" 信学論(DーII). J73ーDーII. 1647-1654 (1990)

    • Related Report
      1990 Annual Research Report
  • [Publications] 崔 昌石: "顔の3次元モデルに基づく表情の記述と合成" 信学論(A). J73ーA. 1270-1280 (1990)

    • Related Report
      1990 Annual Research Report
  • [Publications] Morishima,S.: "A realーtime facial action image symthesis system driven by speech and text" SPIE Visual Communication and Image Processing. 1360. 1151-1158 (1990)

    • Related Report
      1990 Annual Research Report
  • [Publications] Choi,C.S.: "Analysis and synthesis of facial image sequence in knowledgebased image coding" JCーCNSS. 80-84 (1990)

    • Related Report
      1990 Annual Research Report
  • [Publications] 山田 寛: "表情のカテゴリ-化と認識" バイオメカニズム学会誌. 14. 222-228 (1990)

    • Related Report
      1990 Annual Research Report
  • [Publications] 原島博: "3次元モデルを用いた表情の合成と顔形状の変形" 計測自動制御学会Human Interface N&R. 4. 157-166 (1989)

    • Related Report
      1989 Annual Research Report
  • [Publications] Aizawa,K.: "Model-based analysis synthesis image coding system for a person's face" Signal Processing:IMAGE COMMUNICATION. 1. 139-152 (1989)

    • Related Report
      1989 Annual Research Report
  • [Publications] 崔昌石: "3次元構造モデルを用いた顔画像の中割り" 第20回画像工学コンファレンス. 33-36 (1989)

    • Related Report
      1989 Annual Research Report
  • [Publications] Harashima,H.: "Model-based analysis synthesis coding of videotelephone images-Conception and basic study of intelligent image coding-" The Trans.of IEICE. E72. 452-459 (1989)

    • Related Report
      1989 Annual Research Report
  • [Publications] Mizukami,K.: "First Selective Attachment Beings in Early Infancy:A Study Using Telethermography." Infant Behavior&Development. (1990)

    • Related Report
      1989 Annual Research Report
  • [Publications] Suzuki,N.: "An attempt to measure facial expressions using image processing analysis." The 22nd International Congress of Applied Psychology. (1990)

    • Related Report
      1989 Annual Research Report

URL: 

Published: 1989-04-01   Modified: 2019-02-15  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi