Dynamic facial expression analysis using multivariate sequential analysis

• Project/Area Number: 22730591
• Research Category: Grant-in-Aid for Young Scientists (B)
• Allocation Type: Single-year Grants
• Research Field: Experimental psychology
• Research Institution: Osaka Electro-Communication University
• Principal Investigator: KOMORI Masashi 大阪電気通信大学, 情報通信工学部, 教授 (60352019)
• Project Period (FY): 2010 – 2012
• Project Status: Completed (Fiscal Year 2012)
• Budget Amount: ¥3,770,000 (Direct Cost: ¥2,900,000、Indirect Cost: ¥870,000); Fiscal Year 2012: ¥650,000 (Direct Cost: ¥500,000、Indirect Cost: ¥150,000); Fiscal Year 2011: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000); Fiscal Year 2010: ¥1,690,000 (Direct Cost: ¥1,300,000、Indirect Cost: ¥390,000)
• Keywords: 表情 / モーションキャプチャ / 幾何学的形態測定学 / 時系列解析 / 表情表出 / 形態測定学 / 多変量解析 / 3次元モーフィング / 薄板スプライン法 / インタラクション / コミュニケーション / 多変量分析

Research Abstract

This study aims at developing a novel method for analyzing dynamic facial expressions by using motion capture system, geometric morphometrics and multivariate analysis. During this research period, we have carried out the followings; (1) Applications of geometric morphometrics to dynamic facial expression analyses, (2) Extraction of components of dynamic facial expressions by using three-mode parallel factor analysis (PARAFAC), (3) Investigations on congruence of facial expressions during face-to-face interactions.

Research Products

• [Journal Article] 共感による表情模倣と意図的な表情模倣における表情表出の違い (2013)
  • Author(s): 大西佳太郎・内野早基・小森政嗣
  • Journal Title: 電子情報通信学会技術研究報告 Volume: HCS113(72) Pages: 81-84
• [Journal Article] 3 相主成分分析によるダンス動作の個人特徴分析 ～Perfumeのモーションデータを例に ～ (2013)
  • Author(s): 前田和甫・大西佳太郎・小森政嗣
  • Journal Title: 電子情報通信学会技術研究報告 Volume: HCS112(412) Pages: 113-118
• [Journal Article] 3相主成分分析によるダンス動作の個人特徴分析- Perfume のモーションデータを例に- (2013)
  • Author(s): 前田和甫
  • Journal Title: 電子情報通信学会技術研究報告 Volume: 112(412) Pages: 113-118
• [Journal Article] 共感による表情模倣と意図的な表情模倣における表情表出の違い (2013)
  • Author(s): 大西佳太郎
  • Journal Title: 電子情報通信学会技術研究報告 Volume: 未定
• [Journal Article] Multiple Mechanisms in the Perception of Face Gender:Effect of Sex-Irrelevant Features (2011)
  • Author(s): Komori, M., Kawamura, S., Ishihara, S.
  • Journal Title: Journal of Experimental Psychology: HumanPerception and Performance Volume: 37(3) Issue: 3 Pages: 626-633
  • DOI: 10.1037/a0020369
  • Peer Reviewed
• [Journal Article] 対面場面における表情の同調的表出に関する形態測定学的検討 (2011)
  • Author(s): 小森政嗣・福井正昇・長岡千賀
  • Journal Title: 対人社会心理学研究 Volume: 11 Pages: 73-79
  • NAID: 120004843925
  • Peer Reviewed
• [Journal Article] 日中韓の表情の分析:形態測定学的アプローチによる検討 (2010)
  • Author(s): 上出寛子・長岡千賀・ 小森政 嗣
  • Journal Title: 電子情報通信学会技術研究報告 Volume: HCS110(247) Pages: 17-22
  • NAID: 110008106592
• [Journal Article] モーションキャプチャによる表情の時系列変化の定量的分析 (2010)
  • Author(s): 福井正昇・長岡千賀・小森政嗣
  • Journal Title: 電子情報通信学会技術研究報告 Volume: HCS110(33) Pages: 69-72
  • NAID: 110008004406
• [Journal Article] 日中韓の表情の分析:形態測定学的アプローチによる検討 (2010)
  • Author(s): 上出寛子・長岡千賀・小森政嗣
  • Journal Title: 電子情報通信学会技術研究報告 Volume: 110 Pages: 17-22
  • NAID: 110008106592
• [Journal Article] Multiple Mechanisms in the Perception of Face Gender : Effect of Sex-Irrelevant Features
  • Author(s): Komori, M., Kawamura, S., Ishihara, S.
  • Journal Title: Journal of Experimental Psychology : Human Perception and Performance Volume: (in press)
  • Peer Reviewed
• [Presentation] Applicability of geometric morphometrics to analyze human motion data (2013)
  • Author(s): Komori, M., Miyamoto, Y., Maeda, K., & Onishi, Y.
  • Organizer: The 3rd International Symposium on Biological Shape Analysis
  • Place of Presentation: Tokyo, Japan
• [Presentation] 日中韓の表情の分析:形態測定学的アプローチによる検討 (2010)
  • Author(s): 上出寛子・長岡千賀・小森政嗣
  • Organizer: フォーラム顔学2010
  • Place of Presentation: 東京医科歯科大学M&Dタワー
  • Year and Date: 2010-10-23
• [Presentation] Sequential patterns of facial expressions: A preliminary study (2010)
  • Author(s): Fukui, M., Nagaoka, C., & Komori, M.
  • Organizer: The 7th International Conference on Cognitive Science
  • Place of Presentation: Beijing, China
• [Presentation] Facial expression analysis using motion capture and generalized Procrustes analysis (2010)
  • Author(s): Komori, M., Fukui, M., Nagaoka, C., Katsumata, G., & Kawamura, S.
  • Organizer: The 27th International Congress of Applied Psychology
  • Place of Presentation: Melbourne,Victoria, Australia.
• [Presentation] Facial expression analysis using motion capture and generalized Procrustes analysis (2010)
  • Author(s): Komori, M., Fukui, M., Nagaoka, C., Katsumata, G., Kawamura, S.
  • Organizer: The 27th International Congress of Applied Psychology (ICAP2010) pp.1152-1153.
  • Place of Presentation: Melbourne, Victoria, Australia
• [Presentation] Sequential patterns of facial expressions : A preliminary study (2010)
  • Author(s): Fukui, M., Nagaoka, C., Komori, M.
  • Organizer: the 7th International Conference on Cognitive Science (ICCS2010), pp.354-355
  • Place of Presentation: 北京,中華人民共和国