• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

A Common Platform for Analysis and Synthesis of Face to Realize a Kansei Communication

Research Project

Project/Area Number 11555097
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section展開研究
Research Field 情報通信工学
Research InstitutionThe University of Tokyo

Principal Investigator

HARASHIMA Hiroshi  Interfaculty Initiative in Information Studies, The University of Tokyo, Professor, 大学院・情報学環, 教授 (60011201)

Co-Investigator(Kenkyū-buntansha) HASHIMOTO Shuji  Waseda University, Dept. of Applied Physics, Professor, 理工学部, 教授 (60063806)
HARA Fumio  Faculty of Engineering, Department of Mechanical Engineering, Science University of Tokyo, Professor, 工学部, 教授 (90084376)
YACHIDA Masahiko  Department of Systems and Human Science, Graduate School of Engineering Science, OSAKA University, Professor, 大学院・基礎工学研究科, 教授 (20029531)
YAMADA Hiroshi  Nihon University, College of Humanities and Sciences, Associate Professor, 文理学部, 助教授 (80191328)
MORISHIMA Shigeo  Seikei University, Faculty of Engineering, Professor, 工学部, 教授 (10200411)
Project Period (FY) 1999 – 2001
Project Status Completed (Fiscal Year 2001)
Budget Amount *help
¥12,800,000 (Direct Cost: ¥12,800,000)
Fiscal Year 2001: ¥3,600,000 (Direct Cost: ¥3,600,000)
Fiscal Year 2000: ¥4,100,000 (Direct Cost: ¥4,100,000)
Fiscal Year 1999: ¥5,100,000 (Direct Cost: ¥5,100,000)
KeywordsFace recognition / Face image synthesis / Face model fitting / Common software / Face animation / Kansei communication / Life-like agent / Face-to-face interface / 顔分析 / 表情合成 / 平均顔 / 感性処理 / 3次元モデル / 顔情報処理 / 顔合成 / 特徴抽出 / 表情変形 / GUI
Research Abstract

Until now, several research institutes and university have tried a face recognition and face image synthesis schemes and they just have come to produce a commercial product. However, most of the elemental technologies are realized about case by case requirement and they don't have a common interface with other technologies and extension function. In this background, our project tried to realize to construct a common software system about face image processing with generalized hierarchical function. The major element of this software system is composed of a common face processing library which can treat both face recognition and face synthesis. In the face recognition system, an extraction and parameterization of face and face parts, tracking of face in video sequence, basic tool for person identification and expression recognition are included. And also API is produced to make generalization of system. In the face image synthesis system, 3D model and facial expression rule to generate a natural and real face image and animation are constructed. A generic face model is modified to be fitted automatically to face frontal picture based on feature points extraction result by face recognition system to make customization of face model. One new point of our research is a combination of each algorithm produced independently by several research institutes to make generalization of system. A major improvement of animation quality of facial expression is second point. As an interaction technology, a treatment of emotion condition and communication through narrow band network is also considered, and common markup language to realize a communication on WEB page is also proposed as a new result. By psychological analysis, facial expression animation rule on time scale is exactly treated.

Report

(4 results)
  • 2001 Annual Research Report   Final Research Report Summary
  • 2000 Annual Research Report
  • 1999 Annual Research Report
  • Research Products

    (31 results)

All Other

All Publications (31 results)

  • [Publications] Masataka Doi: "Real-time Vision System for Autonomous Mobile Robot"Proc. of 2001 IEEE International Workshop on Robot and Human Interaction. Roman'01. 442-449 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Yasushi Yagi: "Facial feature extraction from frontal face image"WCC2000 Proc. Int. Conf. Signal Processing. 2. 1225-1232 (2000)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Dadet Pramadihant: "Integrated Person Identification and Expression Recognition from Facial Images"IEICE Trans. on Information and Systems. E84-D・7. 850-866 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Yoshimitsu Aoki: "Simulation of Postoperative 3D Facial Morphology using Physics-base Head Model"The Visual Computer. 17・Issue2. 121-131 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Naiwala P.Chandrasiri: "Real Time Facial Expression Recognition System with Applications to Facial Animation in MPEG-4"JEICE Trans. Inf. & Syst.. E84-D・8. 1007-1017 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Barakonyi. M: "A 3D Agent with Synthetic Face and Semiautonomous Behavior for Multimodal Presentations"Proc.Multimedia Technology and Applications Conference (MTAC2001, IEEE Computer Soc.). 21-25 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 山田 寛: "表情によるコミュニケーション"岩波書店. 253 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Masataka Doi: "Real-time Vision System for Autonomous Mobile Robot"Proc. of 2001 IEEE International Workshop on Robot and Human Interaction, Roman '01. 442-449 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Yasushi Yagi: "Facial feature extraction from frontal face image"WCC2000 Proc. Int. Conf. Signal Processing. 2. 1225-1232 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Dadet Pramadihant: "Integrated Person Identification and Expression Recognition from Facial Images"IEICE Trans. on Information and Systems. E84-D ・ 7. 850-866 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Yoshimitsu Aoki: "Simulation of Postoperative 3D Facial Morphology using Physics-base Head Model"The Visual Computer. 17 Issue 2. 121-131 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Naiwala P.: "Chandrasiri Real Time Facial Expression Recognition System with Applications to Facial Animation in MPEG-4"IEICE Trans. Inf. & Syst.. E84-D ・ 8. 1007-1017 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Barakonyi, M.: "A 3D Agent with Synthetic Face and Semiautonomous Behavior for Multimodal Presentations"Proc.Multimedia Technology and Applications Conference (MTAC2001, IEEE Computer Soc.). 21-25 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Masataka Doi: "Real-time Vision System for Autonomous Mobile Robot"Proc. of 2001 IEEE International Workshop on Robot and Human Interaction. Roman 'Ol. 442-449 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] Yasushi Yagi: "Facial feature extraction from frontal face image"WCC2000 Proc. Int. Conf. Signal Processing. 2. 1225-1232 (2000)

    • Related Report
      2001 Annual Research Report
  • [Publications] Dadet Pramadihant: "Integrated Person Identification and Expression Recognition from Facial Images"IEICE Trans. on Information and Systems. E84-D・7. 850-866 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] Yoshimitsu Aoki: "Simulation of Postoperative 3D Facial Morphology using Physics-base Head Model"The Visual Comuter. 17・Issue 2. 121-131 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] Naiwala, P., Chandrasiri: "Real Time Facial Expression Recognition System with Applications to Facial Animation in MPEG-4"IEICE Trans. Inf. & Syst.. E84-D・8. 1007-1017 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] Barakonyi, M: "A 3D Agent with Synthetic Face and Semiautonomous Behavior for Multimodal Presentations"Proc. Multimedia Technology amd Applications Conference (MTAC2001, IEEE Computer Soc.). 21-25 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] 山田寛: "表情によるコミュニケーション"岩波書店. 253 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] 森島繁生: "擬人化音声対話エージェント開発と周辺技術(3)対話における顔画像生成"情報処理学会研究報告. 2000. 13-18 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] S.Morishima: "HYPERMASK : Talking Head Projected onto Real Object"MULTIMEDIA MODELING Modeling Multimedia Information and Systems. 403-412 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] N.P.Chandrasiri: "Analysis and Synthesis of Facial Expressions based on Presonal Facial Expression Space"電子情報通信学会大会論文集. A-14-20. (2001)

    • Related Report
      2000 Annual Research Report
  • [Publications] 森島繁生: "顔の認識・合成のための標準ツール"システム/制御/情報. 44・3. 119-126 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] 緒方信: "ビデオ翻訳システム-自動翻訳合成音声とのモデルベースリップシンクの実現-"情報処理学会シンポジウム、インタラクション2001. 2001・5. 203-210 (2001)

    • Related Report
      2000 Annual Research Report
  • [Publications] 横山太郎: "正面顔画像からの輪郭特徴抽出,映像"情報メデイア学会誌. 53・11. 1605-1614 (1999)

    • Related Report
      1999 Annual Research Report
  • [Publications] 青木義満: "分散協調処理を用いたロバストな能動的人物追跡システム"画像電子学会誌. 28・5. 596-604 (1999)

    • Related Report
      1999 Annual Research Report
  • [Publications] M. C. Park: "Analysis and Synthesis of 3-D Face Image Sequence Based on Model-Based, Image Coding Scheme with Internet Browser"IEEE Int'l. Conf. on Image Process. (ICIP'99). IV. 207-211 (1999)

    • Related Report
      1999 Annual Research Report
  • [Publications] Hara,F.: "Computer-aided creation of visual impression on CG face"Proc. Inter. Workshop on Robot and Human Interaction. 159-164 (1999)

    • Related Report
      1999 Annual Research Report
  • [Publications] 森島繁生: "顔認識・合成のための標準ツール"システム制御情報学会誌. 44・3. 23-30 (2000)

    • Related Report
      1999 Annual Research Report
  • [Publications] 山田 寛: "顔面表情の知覚:その心理物理的説明モデルの提案"脳の科学. 22・2. 159-164 (2000)

    • Related Report
      1999 Annual Research Report

URL: 

Published: 1999-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi