Embodied avatar-mediated communication system with self-referable substitute character

2021 Fiscal Year Final Research Report

• Project/Area Number: 19K12067
• Research Category: Grant-in-Aid for Scientific Research (C)
• Allocation Type: Multi-year Fund
• Section: 一般
• Review Section: Basic Section 61020:Human interface and interaction-related
• Research Institution: Okayama Prefectural University
• Principal Investigator: Ishii Yutaka 岡山県立大学, 情報工学部, 准教授 (30372642)
• Project Period (FY): 2019-04-01 – 2022-03-31
• Keywords: 身体的インタラクション / アバタコミュニケーション / コミュニケーション支援 / Web面接

Outline of Final Research Achievements

We have developed a communication system using embodied avatars. The following issues were addressed: tension reduction in initial face-to-face interaction, clarification of interactions and self/other modeling in avatar shadows, and evaluation of self-referential embodied communication to improve self-affirmation. Specifically, we developed a tension reduction system for interview candidates using a character that operates by voice input, and a embodied retraction agent as a substitute for an audience member in web conferencing, and evaluated the system. In addition, we developed a shadow avatar system that handles shadows subjectively, and conducted evaluation experiments of a system that superimposes embodied responses on both avatars and plant-type objects to verify the effectiveness of each of the developed systems.

Free Research Field

ヒューマンインタフェース

Academic Significance and Societal Importance of the Research Achievements

新型コロナウイルスの影響による遠隔でのオンラインコミュニケーション機会が日常化し，新たな社会生活様式として定着しつつある．本研究は，通常行われている人同士の身体的コミュニケーションを背景に，遠隔においてもより効果的な対話を支援する身体的アバタを介したシステムの研究開発を進めた．音声に基づく反応動作の自動生成によるインタラクション支援は，アバタを介した対話においても有効に活用できる手法として再確認できた．本申請の成果に関する知見が，対話者間の身体的な関係性において，同一空間内でかかわりが捉えられる手法によって遠隔でも時空間を共有し，つながりを実感できるシステム構築への一助となれば幸いである．