Cross-cultural study on avatar's facial expression interpretation and non-verbal behaviors

• Project/Area Number: 20500196
• Research Category: Grant-in-Aid for Scientific Research (C)
• Allocation Type: Single-year Grants
• Section: 一般
• Research Field: Sensitivity informatics/Soft computing
• Research Institution: Osaka Institute of Technology
• Principal Investigator: KODA Tomoko Osaka Institute of Technology, 情報科学部, 准教授 (80434786)
• Project Period (FY): 2008 – 2010
• Project Status: Completed (Fiscal Year 2010)
• Budget Amount: ¥4,420,000 (Direct Cost: ¥3,400,000、Indirect Cost: ¥1,020,000); Fiscal Year 2010: ¥780,000 (Direct Cost: ¥600,000、Indirect Cost: ¥180,000); Fiscal Year 2009: ¥1,690,000 (Direct Cost: ¥1,300,000、Indirect Cost: ¥390,000); Fiscal Year 2008: ¥1,950,000 (Direct Cost: ¥1,500,000、Indirect Cost: ¥450,000)
• Keywords: 感性インタフェース / 異文化コミュニケーション / 国際研究者交流 / 多国籍 / アバタ / キャラクタ / 表情 / CSCW / エージェント

Research Abstract

This research focuses on the importance of cultural adaptation of avatars' appearance and behaviors. We conducted a series of cross-cultural experiments in order to investigate cultural differences in interpreting avatar facial expressions. The result of the first experiment (2008) implied there are cultural differences of perception of avatar facial expressions between Western countries and Japan. The results of the second and third experiments (2009-10) showed the facial regions used to interpret avatar faces also have cultural differences. Japanese focused on the eyes while Hungarian focused on the mouth. In addition to enculturated facial expressions, our experimental results showed enculturated behavior of avatars also improves the friendliness and familiarity of the avatar (2010).

Research Products

• [Journal Article] HAI研究事例紹介-エージェントの表情解釈の文化差- (2010)
  • Author(s): 神田智子
  • Journal Title: 人工知能学会誌 Vol.25, No.6 Pages: 850-857
  • NAID: 110007880921
  • Peer Reviewed
• [Journal Article] Cross-cultural Study on Facial Regions as Cues to Recognize Emotions of Virtual Agents. (2010)
  • Author(s): Koda T., Ruttkay Z., Nakagawa Y., Tabuchi K.
  • Journal Title: Culture and Computing, Lecture Notes in Computer Science(Springer-verlag) Vol.6259 Pages: 16-27
  • Peer Reviewed
• [Journal Article] Cross-cultural Study on Facial Regions as Cues to Recognize Emotions of Virtual Agents. (2010)
  • Author(s): Koda, T., Ruttkay, Z., Nakagawa, Y., Tabuchi, K.
  • Journal Title: Culture and Computing Volume: LNCS6259 Pages: 16-27
  • Peer Reviewed
• [Journal Article] HAI研究事例紹介-エージェントの表情解釈の文化差- (2010)
  • Author(s): 神田智子
  • Journal Title: 人工知能学会誌 Volume: 25(6) Pages: 850-857
  • NAID: 110007880921
• [Journal Article] Avatar culture : cross-cultural evaluations of avatar facial expressions. (2009)
  • Author(s): Tomoko Koda, Toru Ishida, Matthias Rehm, Elisabeth Andre
  • Journal Title: Journal of AI & Society(Springer London) Vol.24, No.3 Pages: 237-250
  • Peer Reviewed
• [Journal Article] Avatar culture : cross-cultural evaluations of avatar facial expressions (2009)
  • Author(s): Tomoko Koda, Toru Ishida, Matthias Rehm, Elisabeth Andre
  • Journal Title: Journal of AI & Society 24(3) Pages: 237-250
  • Peer Reviewed
• [Presentation] From Cartoons to Robots Part 2 : Facial Regions as Cues to Recognize Emotions. (2011)
  • Author(s): Tomoko Koda, Zsofia Ruttkay
  • Organizer: International Conference on Human-Robot Interaction
  • Place of Presentation: スイス・ローザンヌ
  • Year and Date: 2011-03-07
• [Presentation] From Cartoons to Robots Part 2 : Facial Regions as Cues to Recognize Emotions. (2011)
  • Author(s): Tomoko Koda, Zsofia Ruttkay, Tomoharu Sano
  • Organizer: International Conference on Human-Robot Interaction (HRI2011)
  • Place of Presentation: Lausanne, Switzerland
• [Presentation] 対話エージェントによるあいづちの文化間比較 (2010)
  • Author(s): 濱元貴範, 鈴木洋太, 脇坂昌志, 神田智子
  • Organizer: HAIシンポジウム
  • Place of Presentation: 日本・神奈川
  • Year and Date: 2010-12-12
• [Presentation] アバタ表情解釈の手がかりとなる顔部位の文化間比較(日本アバタ版) (2010)
  • Author(s): 中川由香, 田渕喬多, 神田智子
  • Organizer: HAIシンポジウム
  • Place of Presentation: 日本・神奈川
  • Year and Date: 2010-12-12
• [Presentation] 身体操作を実装した仮想エージェントとの持続的インタラクション評価 (2010)
  • Author(s): 中川由香, 田渕喬多, 神田智子
  • Organizer: HAIシンポジウム2010
  • Place of Presentation: 日本・神奈川
  • Year and Date: 2010-12-12
• [Presentation] あいづちの文化間比較とエージェントへの実装 (2010)
  • Author(s): 濱元貴範, 鈴木洋太, 脇坂昌志, 神田智子
  • Organizer: 顔学フォーラム
  • Place of Presentation: 日本・東京
  • Year and Date: 2010-10-23
• [Presentation] アバタ表情解釈の手がかりとなる顔部位の文化間比較 (2010)
  • Author(s): 東野寛志, 神田智子
  • Organizer: 顔学フォーラム
  • Place of Presentation: 日本・東京
  • Year and Date: 2010-10-23
• [Presentation] Cultural Differences on Facial Regions Used as Cues to Recognize Emotions of Animated Virtual Agents. (2010)
  • Author(s): Tomoko Koda, Zsofia Ruttkay
  • Organizer: International Conference on Intelligent Virtual Agents
  • Place of Presentation: アメリカ・フィラデルフィア
  • Year and Date: 2010-09-20
• [Presentation] 身体操作を実装した仮想エージェントとの持続的インタラクション評価 (2010)
  • Author(s): 東野寛志, 神田智子
  • Organizer: 第9回情報科学技術フォーラム
  • Place of Presentation: 日本・福岡
  • Year and Date: 2010-09-07
• [Presentation] Cultural differences in perception of facial expressions (2010)
  • Author(s): Zofia Ruttkay, Tomoko Koda
  • Organizer: 3rd COST International Training School
  • Place of Presentation: イタリア・カゼルタ
  • Year and Date: 2010-03-15
• [Presentation] Communicating with Virtual Agents-Does Culture Matter? (2010)
  • Author(s): Tomoko Koda
  • Organizer: Tech-Tea talk at Moholy-Nagy University of Art and Design
  • Place of Presentation: ハンガリー・ブダペスト
  • Year and Date: 2010-03-10
• [Presentation] From Cartoons to Robots : Facial Regions as Cues to Recognize Emotions (2010)
  • Author(s): Tomoko Koda, Zsofia Ruttkay, Yuka Nakagawa, Kyota Tabuchi
  • Organizer: International Conference on Human-Robot Interaction
  • Place of Presentation: 日本・大阪
  • Year and Date: 2010-03-03
• [Presentation] Cross-cultural Study on Facial Regions as Cues to Recognize Emotions of Virtual Agents (2010)
  • Author(s): Tomoko Koda, Zsofia Ruttkay, Yuka Nakagawa, Kyota Tabuchi
  • Organizer: First International Workshop on Agents in Cultural Context
  • Place of Presentation: 日本・京都
  • Year and Date: 2010-02-22
• [Presentation] 対話エージェントによるあいづちの文化間比較 (2010)
  • Author(s): 濱元貴範,鈴木洋太,脇坂昌志,神田智子
  • Organizer: HAIシンポジウム2010
  • Place of Presentation: 神奈川
• [Presentation] アバタ表情解釈の手がかりとなる顔部位の文化間比較(日本アバタ版) (2010)
  • Author(s): 中川由香,田渕喬多,神田智子
  • Organizer: HAIシンポジウム2010
  • Place of Presentation: 神奈川
• [Presentation] 身体操作を実装した仮想エージェントとの持続的インタラクション評価 (2010)
  • Author(s): 東野寛志,神田智子
  • Organizer: HAIシンポジウム2010
  • Place of Presentation: 神奈川
• [Presentation] あいづちの文化間比較とエージェントへの実装 (2010)
  • Author(s): 濱元貴範,鈴木洋太,脇坂昌志,神田智子
  • Organizer: 顔学フォーラム2010
  • Place of Presentation: 東京
• [Presentation] アバタ表情解釈の手がかりとなる顔部位の文化間比較 (2010)
  • Author(s): 中川由香,田渕喬多,神田智子
  • Organizer: 顔学フォーラム2010
  • Place of Presentation: 東京
• [Presentation] 身体操作を実装した仮想エージェントとの持続的インタラクション評価 (2010)
  • Author(s): 東野寛志,神田智子
  • Organizer: 第9回情報科学技術フォーラム(FIT2010)
  • Place of Presentation: 福岡
• [Presentation] Cultural Differences on Facial Regions Used as Cues to Recognize Emotions of Animated Virtual Agents. (2010)
  • Author(s): Tomoko Koda, Zsofia Ruttkay
  • Organizer: Intelligent Virtual Agents (IVA2010)
  • Place of Presentation: Philadelphia, USA
• [Presentation] Cultural differences in perception of facial expressions. (2010)
  • Author(s): Zofia Ruttkay, Tomoko Koda
  • Organizer: 3rd COST International Training School
  • Place of Presentation: Caserta, Italy
• [Presentation] Communicating with Virtual Agents-Does Culture Matter? (2010)
  • Author(s): 神田智子
  • Organizer: Tech-Tea talk at Moholy-Nagy University of Art and Design
  • Place of Presentation: Budapest, Hungary
• [Presentation] From Cartoons to Robots : Facial Regions as Cues to Recognize Emotions. (2010)
  • Author(s): Tomoko Koda, Zsofia Ruttkay, Yuka Nakagawa, Kyota Tabuchi
  • Organizer: International Conference on Human-Robot Interaction (HRI 2010)
  • Place of Presentation: Osaka
• [Presentation] Cross-cultural Study on Facial Regions as Cues to Recognize Emotions of Virtual Agents. (2010)
  • Author(s): Tomoko Koda, Zsofia Ruttkay, Yuka Nakagawa, Kyota Tabuchi
  • Organizer: International Workshop on Agents in Cultural Context.
  • Place of Presentation: Kyoto
• [Presentation] アバタの表情解釈の手がかりとなる顔部位の文化間比較 (2009)
  • Author(s): 中川由香, 田渕喬多, 神田智子
  • Organizer: HAIシンポジウム
  • Place of Presentation: 日本・東京
  • Year and Date: 2009-12-04
• [Presentation] Cultural Differences in Using Facial Parts as Cues to Recognize Emotions in Avatars (2009)
  • Author(s): Tomoko Koda, Zsofia Ruttkay
  • Organizer: 9th International Conference on Intelligent Virtual Agents
  • Place of Presentation: オランダ・アムステルダム
  • Year and Date: 2009-09-14
• [Presentation] Cultural Differences in Using Facial Parts as Cues to Recognize Emotions in Avatars. (2009)
  • Author(s): Tomoko Koda, Zsofia Ruttkay
  • Organizer: 9th International Conference on Intelligent Virtual Agents (IVA2009)
  • Place of Presentation: Amsterdam, the Netherlands
• [Presentation] Cross-cultural Evaluations of avatar facial expressions designed by Western Designers. (2008)
  • Author(s): Tomoko Koda, Matthias Rehm, Elisabeth Andre
  • Organizer: 8^<th> International Conference on Intelligent Virtual Agents (IVA 2008)
  • Place of Presentation: 東京・国立情報学研究所
  • Year and Date: 2008-09-02
• [Presentation] Cross-cultural Evaluations of avatar facial expressions designed by Western Designers. (2008)
  • Author(s): Tomoko Koda, Matthias Rehm, Elisabeth Andre
  • Organizer: Intelligent Virtual Agents (IVA 2008)(Springer-Verlag)(LNAI 5208 245-252)
  • Place of Presentation: Tokyo
• [Remarks] 研究成果一覧ページ
• [Remarks] 日本語
  • URL: http://www.is.oit.ac.jp/~koda/server/index.html
• [Remarks] 英語
  • URL: http://www.is.oit.ac.jp/~koda/server/profilee.html
• [Remarks] ユニバーサルキャラクタ実験2008:(2008年度実施のWeb実験)
• [Remarks] 日本語
  • URL: http://www.is.oit.ac.jp/~koda/server/~koda/character/Japanese_Instruction.html
• [Remarks] 英語
  • URL: http://www.is.oit.ac.jp/~koda/server/~koda/character/
• [Remarks] 表情解釈の顔部位の文化差検証実験:日本アバタ版(2009年度実施のweb実験)
• [Remarks] 日本語
  • URL: http://www.is.oit.ac.jp/~koda/server/~ynakagawa/chartoon_test/process.html
• [Remarks] 英語
  • URL: http://www.is.oit.ac.jp/~koda/server/~ynakagawa/e_chartoon_test/e_process.html
• [Remarks] 表情解釈の顔部位の文化差検証実験:ハンガリーアバタ版(2010年度実施のweb実験)
• [Remarks] 日本語
  • URL: http://www.is.oit.ac.jp/~koda/seiya/chartoon2010/chartoon_test/process.html
• [Remarks] 英語
  • URL: http://www.is.oit.ac.jp/~koda/seiya/chartoon2010/e_chartoon_test/e_process.html
• [Remarks] 研究室
  • URL: http://www.is.oit.ac.jp/~koda/server/index.html
• [Remarks] 表情解釈実験サイト
  • URL: http://www.is.oit.ac.jp/~koda/seiya/chartoon2010/chartoon_test/process.html
• [Remarks] 研究室
  • URL: http://www.is.oit.ac.jp/~koda/server/index.html
• [Remarks] 表情解釈実験サイト
  • URL: http://www.is.oit.ac.jp/~koda/server/~ynakagawa/chartoon_test/process.html
• [Remarks]
  • URL: http://www.is.oit.ac.jp/~koda/server/~koda/character/