Gaze Mirroring Interaction to Make Latent Interest Explicit and Its Evaluation

• Project/Area Number: 23700168
• Research Category: Grant-in-Aid for Young Scientists (B)
• Allocation Type: Multi-year Fund
• Research Field: Intelligent informatics
• Research Institution: Nagoya University
• Principal Investigator: HIRAYAMA Takatsugu 名古屋大学, 情報科学研究科, 助教 (10423021)
• Project Period (FY): 2011 – 2013
• Project Status: Completed (Fiscal Year 2013)
• Budget Amount: ¥4,160,000 (Direct Cost: ¥3,200,000、Indirect Cost: ¥960,000); Fiscal Year 2013: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000); Fiscal Year 2012: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000); Fiscal Year 2011: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
• Keywords: マルチモーダルインタフェース / 注視行動 / 模倣 / 興味 / 気づき / 視覚的注意

Research Abstract

How do people make latent cognitive state explicit? We have focused on a joint attention which is a process to understand others' mind and proposed a self-feedback interaction that human establishes it with oneself. In this work, we designed Gaze Mirroring that an anthropomorphic agent actively establishes the joint attention with the user by imitating his/her gaze behavior in synchronization and sympathy. We confirmed that the user gazed longer at a visual object of interest in an experimental situation where the user made a choice from some objects. Through this work, we also yielded important findings to model relationships between human cognitive state, gaze behavior, and visual environmental context.

Research Products

• [Journal Article] Computational Models of Human Visual Attention and Their Implementations : A Survey (2013)
  • Author(s): Akisato Kimura, Ryo Yonetani, T. Hirayama
  • Journal Title: IEICE Transactions on Information and Systems Volume: Vol.E96-D, No.3 Pages: 562-578
  • NAID: 10031167446
  • URL: http://repository.kulib.kyoto-u.ac.jp/dspace/handle/2433/171749
  • Peer Reviewed
• [Journal Article] Analysis of Temporal Relationships between Eye Gaze and Peripheral Vehicle Behavior for Detecting Driver Distraction (2013)
  • Author(s): Takatsugu Hirayama, Kenji Mase, Kazuya Takeda
  • Journal Title: International Journal of Vehicular Technology Volume: 2013, 285927 Pages: 1-8
  • DOI: 10.1155/2013/285927
  • Peer Reviewed
• [Journal Article] Computational Models of Human Visual Attention and Their Implementations: A Survey (2013)
  • Author(s): Akisato Kimura, Ryo Yonetani, Takatsugu Hirayama
  • Journal Title: IEICE Transactions on Information and Systems Volume: E96-D Pages: 562-578
  • NAID: 10031167446
  • Peer Reviewed
• [Journal Article] Gaze Mirroringによる注視模倣効果の分析 (2011)
  • Author(s): 石川恵理奈,米谷竜,平山高嗣,松山隆司
  • Journal Title: 情報処理学会論文誌 Volume: Vol.52, No.12 Pages: 3637-3646
  • NAID: 110008719940
  • Peer Reviewed
• [Journal Article] Gaze Mirroringによる注視模倣効果の分析 (2011)
  • Author(s): 石川惠理奈，米谷竜，平山高嗣，松山隆司
  • Journal Title: 情報処理学会論文誌 Volume: 52 Pages: 3637-3646
  • NAID: 110008719940
  • Peer Reviewed
• [Presentation] Analysis of Gaze Behavior while using a Multi-Viewpoint Video Viewer (2014)
  • Author(s): T. Hirayama, Takafumi Marutani, Sidney Fels, Kenji Mase
  • Organizer: 8th ACM Symposium on Eye Tracking Research and Applications
  • Place of Presentation: Florida, US
  • Year and Date: 2014-03-28
• [Presentation] Top-down Visual Attention Computational Model Using Visual Feature Distribution of Search Target (2014)
  • Author(s): Toshiya Ohira, T. Hirayama, Shohei Usui, Shota Sato, Kenji Mase
  • Organizer: Workshop on Attention Models in Robotics : Visual Systems for Better HRI
  • Place of Presentation: Bielefeld, Germany
  • Year and Date: 2014-03-06
• [Presentation] Top-down Visual Attention Computational Model Using Visual Feature Distribution of Search Target (2014)
  • Author(s): Toshiya Ohira, Takatsugu Hirayama, Shohei Usui, Shota Sato, Kenji Mase
  • Organizer: Workshop on Attention Models in Robotics: Visual Systems for Better HRI
  • Place of Presentation: Bielefeld University, Germany
• [Presentation] Analysis of Gaze Behavior while using a Multi-Viewpoint Video Viewer (2014)
  • Author(s): Takatsugu Hirayama, Takafumi Marutani, Sidney Fels, Kenji Mase
  • Organizer: ACM Symposium on Eye Tracking Research and Applications
  • Place of Presentation: Safety Harbor Spa & Resort, Florida, US
• [Presentation] Agent-Assisted Multi-Viewpoint Video Viewer and Its Gaze-Based Evaluation (2013)
  • Author(s): T. Hirayama, Takafumi Marutani, Daishi Tanoue, Shogo Tokai, Sidney Fels, Kenji Mase
  • Organizer: 6th Workshop on Eye Gaze in Intelligent Human Machine Interaction
  • Place of Presentation: Sydney, Australia
  • Year and Date: 2013-12-13
• [Presentation] Analysis of Gaze Mirroring Effects (2013)
  • Author(s): Erina Ishikawa, Ryo Yonetani, T. Hirayama, Takashi Matsuyama
  • Organizer: International Joint Workshop on Advanced Sensing/Visual Attention and Interaction
  • Place of Presentation: Okinawa
  • Year and Date: 2013-11-05
• [Presentation] 人間の内部状態を顕在化する視覚的インタラクション (2013)
  • Author(s): 平山高嗣
  • Organizer: 情報処理学会コンピュータビジョンとイメージメディア研究会
  • Place of Presentation: 鳥取
  • Year and Date: 2013-09-03
• [Presentation] 人間の内部状態を顕在化する視覚的インタラクション (2013)
  • Author(s): 平山高嗣
  • Organizer: 情報処理学会コンピュータビジョンとイメージメディア研究会
  • Place of Presentation: 鳥取大学
  • Invited
• [Presentation] Analysis of Gaze Mirroring Effects (2013)
  • Author(s): Erina Ishikawa, Ryo Yonetani, Takatsugu Hirayama, Takashi Matsuyama
  • Organizer: International Joint Workshop on Advanced Sensing/Visual Attention and Interaction
  • Place of Presentation: ロワジールホテル那覇
• [Presentation] Analysis of Soccer Coach's Eye Gaze Behavior (2013)
  • Author(s): Atsushi Iwatsuki, Takatsugu Hirayama, Kenji Mase
  • Organizer: International Joint Workshop on Advanced Sensing/Visual Attention and Interaction
  • Place of Presentation: ロワジールホテル那覇
• [Presentation] Agent-Assisted Multi-Viewpoint Video Viewer and Its Gaze-Based Evaluation (2013)
  • Author(s): Takatsugu Hirayama, Takafumi Marutani, Daishi Tanoue, Shogo Tokai, Sidney Fels, Kenji Mase
  • Organizer: The 6th Workshop on Eye Gaze in Intelligent Human Machine Interaction
  • Place of Presentation: Coogee Bay Hotel, Sydney, Australia
• [Presentation] 探索目標の視覚特徴分布を考慮した誘目度推定モデル (2013)
  • Author(s): 大平隼也，平山高嗣，榎堀優，間瀬健二
  • Organizer: 電子情報通信学会HCGシンポジウム2013
  • Place of Presentation: 松山市総合コミュニティセンター
• [Presentation] Semantic Interpretation of Eye Movements Using Designed Structures of Displayed Contents (2012)
  • Author(s): Erina Ishikawa, Ryo Yonetani, Hiroaki Kawashima, T. Hirayama, Takashi Matsuyama
  • Organizer: 4th Workshop on Eye Gaze in Intelligent Human Machine Interaction : Eye Gaze and Multimodality
  • Place of Presentation: Santa Monica, CA, US
  • Year and Date: 2012-10-26
• [Presentation] マルチモーダルな認識に基づくポスター発表システム (2012)
  • Author(s): 林宗一郎，吉本廣雅，平山高嗣，河原達也
  • Organizer: インタラクション2011
  • Place of Presentation: 東京
• [Presentation] 人間の視覚的注意の計算モデル (2012)
  • Author(s): 木村昭悟，米谷竜，平山高嗣
  • Organizer: 電子情報通信学会パターン認識・メディア理解研究会
  • Place of Presentation: 神戸
• [Presentation] Info-Concierge : Proactive Multi-Modal Interaction Based on Mind Probing (2011)
  • Author(s): T. Hirayama, Yasuyuki Sumi, Tatsuya Kawahara, Takashi Matsuyama
  • Organizer: Asia Pacific Signal and Information Processing Association Annual Summit and Conference
  • Place of Presentation: Xi'an, China
  • Year and Date: 2011-10-20
• [Presentation] Info-concierge: Proactive Multi-modal Interaction Based on Mind Probing (2011)
  • Author(s): Takatsugu Hirayama, Yasuyuki Sumi, Tatsuya Kawahara, Takashi Matsuyama
  • Organizer: The Asia Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC 2011)
  • Place of Presentation: Xi'an
• [Presentation] Gaze Mirroringによる注視模倣効果の分析 (2011)
  • Author(s): 石川惠理奈，米谷竜，平山高嗣，松山隆司
  • Organizer: ヒューマンインタフェースシンポジウム2011
  • Place of Presentation: 仙台
• [Presentation] 情報コンシェルジェ：Mind Probingに基づくマルチモーダルインタラクションシステム (2011)
  • Author(s): 平山高嗣，角康之，河原達也，松山隆司
  • Organizer: 電子情報通信学会ヒューマンコミュニケーション基礎研究会
  • Place of Presentation: 京都
• [Presentation] Semantic Interpretation of Eye Movements Using Designed Structures of Displayed Contents
  • Author(s): Erina Ishikawa, Ryo Yonetani, Hiroaki Kawashima, Takatsugu Hirayama, Takashi Matsuyama
  • Organizer: The 4th Workshop on Eye Gaze in Intelligent Human Machine Interaction
  • Place of Presentation: Santa Monica, CA, USA
• [Presentation] 提示コンテンツのデザイン構造を用いた視線運動の意味理解
  • Author(s): 石川惠理奈，米谷竜，川嶋宏彰，平山高嗣，松山隆司
  • Organizer: 電子情報通信学会技術研究報告パターン認識とメディア理解PRMU
  • Place of Presentation: 幕張メッセ国際会議場
• [Presentation] Detection of Driver Distraction based on Temporal Relationship between Eye-Gaze and Peripheral Vehicle Behavior
  • Author(s): Takatsugu Hirayama, Kenji Mase, Kazuya Takeda
  • Organizer: The 15th IEEE Intelligent Transportation Systems Conference (ITSC2012)
  • Place of Presentation: Anchorage, Alaska, USA
• [Presentation] 注意散漫状態下の運転者の周辺車状況変化に対する注視反応タイミングの分析
  • Author(s): 平山高嗣，間瀬健二，武田一哉
  • Organizer: 人工知能学会全国大会
  • Place of Presentation: 山口県教育会館
• [Presentation] サッカー指導者の注視行動の分析 -動的対象との関連性-
  • Author(s): 岩月厚，平山高嗣，榎堀優，間瀬健二
  • Organizer: 情報処理学会全国大会
  • Place of Presentation: 東北大学川内キャンパス
• [Remarks]
  • URL: http://mase.itc.nagoya-u.ac.jp/~hirayama/
• [Remarks] 平山高嗣（Takatsugu HIRAYAMA）
  • URL: http://mase.itc.nagoya-u.ac.jp/~hirayama/