• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to project page

2006 Fiscal Year Final Research Report Summary

Communication interface based on gaze model

Research Project

Project/Area Number 16300032
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Media informatics/Database
Research InstitutionTokyo Denki University

Principal Investigator

MUKAWA Naoki  Tokyo Denki University, School of Information Environment, Professor, 情報環境学部, 教授 (20366397)

Co-Investigator(Kenkyū-buntansha) OHI Shoichi  Tokyo Denki University, School of Engineering, Professor, 工学部, 教授 (40057211)
OHYAMA Minoru  Tokyo Denki University, School of Information Environment, Professor, 情報環境学部, 教授 (00339079)
KOBAYASHI Harumi  Tokyo Denki University, School of Science and Engineering, Assistant Professor, 理工学部, 助教授 (60333530)
YUASA Masahide  Tokyo Denki University, School of Information Environment, Instructor, 情報環境学部, 助手 (80385492)
Project Period (FY) 2004 – 2006
Keywordsgaze / nonverbal / communication / interface / video-mediated communication / personification agent / eye-gaze input system / face
Research Abstract

Nonverbal information such as gazes, head orientations, facial expressions and gestures is extremely influential not only in face-to-face communication between persons, but also in information-technology-based electronic communication between persons and computers. The aims of the project are : (1) clarifying the roles of nonverbal information (gazes, head orientation and facial expressions) in human communication, (2) proposing a quantitative model of nonverbal behaviors in human communication, and (3) applying the model to electronic communication systems such as input device, human-like agent on the computer screen, and video-mediated communication systems. The major research results are summarized as follows :
1.A novel gaze-based input device on computer has been developed especially for ALS (amyotrophic lateral sclerosis) disabled people. Robust and sufficiently accurate performance is confirmed. The device has been applied to WEB input application and confirmed the performance.
2. … More Analysis of gaze directions, head orientations and facial expressions in human communication is carried out, and quantitative model that represents relationship between intentions/non-intentions of utterance and nonverbal behaviors, and impression conveyance model that expresses relationship between nonverbal behaviors of human-like agents and conveyed impression on users are proposed. Based on the models two novel communication interfaces using non-verbal information are developed and tested. One is an autonomous turn-taking agent system that recognizes users gazes and utterances, and the other is a video-mediated communication system that ensures the mutual gaze for triadic conversation.
3.An ability of "Joint attention" of pre-school children is tested on the condition of video-mediated communication. It was confirmed that when the mutual gaze between experimenter and child is supported the most children using video system exhibit the same performance with face-to-face condition.
The evaluation criteria introduced in the research, which evaluate IT-based communication systems based on the model and redesign the systems from the evaluation results, will contribute to realization of user-friendly communication systems. Less

  • Research Products

    (50 results)

All 2007 2006 Other

All Journal Article (49 results) Book (1 results)

  • [Journal Article] 方向不整合のある多人数映像会話システムは発話行動に影響を与えるか?-視線による発話交替のビデオ分析-2007

    • Author(s)
      新井久美子, 武川直樹, 湯浅将英
    • Journal Title

      電子情報通信学会技術研究報告書 HCS2006-64

      Pages: 31-36

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] 動的画面分割を用いた視線入カシステム2007

    • Author(s)
      松金朗啓, 湯浅将英, 阿部清彦, 大井尚一, 大山 実
    • Journal Title

      情報処理学会第69回全国大会講演論文集

      Pages: 2Y-2

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] ロンスキアンによる瞬目の検出と眼球領域の推定2007

    • Author(s)
      阿部清彦, 大井尚一, 大山 実
    • Journal Title

      電子情報通信学会2007総合大会講演論文集

      Pages: A-15-1

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] An Eye-gaze Input System Using Information on Eye Movement History2007

    • Author(s)
      Kiyohiko Abe, Shoichi Ohi, Minoru Ohyama
    • Journal Title

      HCII2007 2007年7月 (採録決定)

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] A flow-of-conversation plays a role : Examining line-of-regard of young children and adults in a discrepant labeling situation2007

    • Author(s)
      Kobayashi Harumi, Yasuda Tetuya
    • Journal Title

      Proceedings of the 2nd European Cognitive Science Conference 2007 (In press)

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] The Facial Expression Effect of an Animated Agent on the Decisions Taken in the Negotiation Game2007

    • Author(s)
      Masahide Yuasa, Naoki Mukawa
    • Journal Title

      CHI Extend Abstracts 2007 (In press)

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] 発話交替シミュレーションシステム ARABAHIKA -人間観察に基づく自律的発話交替エージェントの提案-2007

    • Author(s)
      湯浅将英, 徳永弘子, 武川直樹
    • Journal Title

      情報処理学会インタラクション2007論文集

      Pages: 87-88

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] The analysis of relation between non-verbal behavior and spacial consistency in multi-user video mediated communication-The role of gaze direction in turn-taking-2007

    • Author(s)
      Kumiko Arai, Naoki Mukawa, Masahide Yuasa
    • Journal Title

      The Institute of Electronics, Information and Communication Engineers Technical Report (in Japanese) HCS2006-64

      Pages: 31-36

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] Gaze-controlled interface using grid-based mechanism2007

    • Author(s)
      Akihiro Matukane, Masahide Yuasa, Kiyohiko Abe, Shoichi Ohi, Minoru Ohyama
    • Journal Title

      Information Processing Society of Japan The69th National convention lecture memoirs (in Japanese) 2Y-2

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] A detection method for blink and eye-area using wronskian2007

    • Author(s)
      Kiyohiko Abe, Shoichi Ohi, Minoru Ohyama
    • Journal Title

      The Institute of Electronics, Information and Communication Engineers 2007 General meeting lecture memoirs (in Japanese) A-15-1

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] An eye-gaze input system using information on eye movement history2007

    • Author(s)
      Kiyohiko Abe, Shoichi Ohi, Minoru Ohyama
    • Journal Title

      HCII2007 (Transcription decision) (in Japanese)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] A flow-of-conversation plays a role : Examining line-of-regard of young children and adults in a discrepant labeling situation2007

    • Author(s)
      Harumi Kobayashi, Tetuya Yasuda
    • Journal Title

      Proceedings of the 2nd European Cognitive Science Conference (in press)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] ARABAHIKA : Autonomous turn-taking agent system based on bayesian model2007

    • Author(s)
      Masahide Yuasa, Hiroko Tokunaga, Naoki Mukawa
    • Journal Title

      Information Processing Society of Japan Interaction 2007 (in Japanese)

      Pages: 87-88

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] 顔の造作、表情、視線、背景による擬人化ェージェントの印象形成デザイン-流し目における対人印象分析-2006

    • Author(s)
      バズラテ・レジェプ, 中台 沙奈美, 西 雅智, 湯浅 将英, 武川 直樹
    • Journal Title

      ヒューマン エージェント インタラクション (HAI)シンポジウム2006予稿集 USBフラソシュメモリ

      Pages: 1B-2

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] 3 人会話における発話交替時の視線-行動分析-聞き手の立場から見た発話・非発話の戦略-2006

    • Author(s)
      徳永弘子, 湯浅将英, 武川直樹
    • Journal Title

      電子情報通信学会技術研究報告書 HCS2006-45

      Pages: 23-28

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] 視線・表情が変わる擬人化エージェントの印象分析-流し目に対する人の反応2006

    • Author(s)
      中台沙奈美, 川崎 由加里, 湯浅将英, 武川直樹
    • Journal Title

      電気学会 電子・情報・システム部門大会 論文集

      Pages: 230-235

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] 出会いの場所によつて異なる流し目の効果2006

    • Author(s)
      バズラテ・レジェプ, 川崎由加里, 湯浅将英, 武川直樹
    • Journal Title

      日本顔学会フォーラム顔学 日本顔学会誌 vol. 6

      Pages: 180

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] 顔や振り向顔きが人に与えるうれしさ-擬人化エージェントとのインタラクション-2006

    • Author(s)
      西雅智, 黒木裕己, 湯浅将英, 武川直樹, 島田尊正
    • Journal Title

      日本顔学会フォーラム顔学 日本顔学会誌 vol. 6

      Pages: 144

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] インタラクションのうれしさの分析 : 人と擬人化エージェントのインタラクションにおける脳活動計測2006

    • Author(s)
      黒木裕己, 武川直樹, 島田尊正, 湯浅将英
    • Journal Title

      第20回人工知能学会全国大会 (CD-ROM)

      Pages: 3F3-5

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] 擬人化エージェントの空間配置とプレッシャー2006

    • Author(s)
      押川絢美, 武川直樹, 湯浅将英
    • Journal Title

      電子情報通信学会総合全国大会 (CD-ROM)

      Pages: A14-1

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] 視線による自然光下の文字入力に適した注視指標配置の検討2006

    • Author(s)
      阿部清彦, 佐藤寛修, 大井尚一, 大山 実
    • Journal Title

      電子情報通信学会技術研究報告 HCS2006-42

      Pages: 7-12

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] 視線による自然光下の文字入力に適した注視指標配置の検討2006

    • Author(s)
      阿部清彦, 佐藤寛修, 大井尚一, 大山 実
    • Journal Title

      日本顔学会誌 Vol. 6, No. 1

      Pages: 135

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] 視線による重度肢体不自由者向けコンピュータ操作支援システム2006

    • Author(s)
      阿部清彦, 佐藤寛修, 大山 実, 大井尚一
    • Journal Title

      映像情報メディア学会誌 60,12

      Pages: 1971-1979

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] 幼児における視線一致映像対話を利用した共同注意-語意推測課題を使つて-2006

    • Author(s)
      安田哲也, 小林春美, 茂木洋介
    • Journal Title

      日本認知科学会第23回大会論文集

      Pages: 132-133

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] A Tool for Using Abstract Faces in Communication over a Computer Network, Proc. of Joint 3rd International Conference on SoftComputing and Intelligent Systems and 7th International Symposium onadvanced Intelligent Systems2006

    • Author(s)
      Masahide Yuasa
    • Journal Title

      SCIS&ISIS 2006

      Pages: 1573-1577

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] Impression Analysis of Animated Agents in Soft Game Theory, Proc. of Joint 3rd International Conference on Soft Computing and Intelligent Systems and 7th International Symposium on advanced Intelligent Systems2006

    • Author(s)
      Masahide Yuasa
    • Journal Title

      SCIS & ISIS 2006

      Pages: 1043-1047

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] Emoticons Convey Emotions without Cognition of Faces : An f MRI Study2006

    • Author(s)
      Masahide Yuasa, Keiichi Saito, Naoki Mukawa
    • Journal Title

      CHI Extended Abstracts 2006

      Pages: 1565-1570

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] ソフトゲーム理論に基づく擬人化エージェントのノンバーバル情報表出戦略2006

    • Author(s)
      湯浅将英, 武川直樹
    • Journal Title

      ヒューマン エージェント インタラクション (HAI)シンポジウム2006予稿集 USBフラッシュメモリ

      Pages: 1B-3

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] 顔文字に対する脳活動2006

    • Author(s)
      湯浅将英, 斎藤恵一, 武川直樹
    • Journal Title

      平成18年電気学会 電子・情報・システム部門大会/電気学会研究会資料

      Pages: 19-22

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] 電子的コミュニケーションに用いる顔の抽象性と脳反応2006

    • Author(s)
      湯浅将英, 斎藤恵一, 武川直樹
    • Journal Title

      人工知能学会第20回全国大会(JSAI2006)論文集 (CD-ROM)

      Pages: 2B1-4

    • Description
      「研究成果報告書概要(和文)」より
  • [Journal Article] Impression design of a life-like agent using appearance, facial expressions, gaze and background-Impression analysis on flirtatious glance2006

    • Author(s)
      Pazilat Rajap, Sanami Nakadai, Masatomo Nishi, Masah i de Yuasa, Naoki Mukawa
    • Journal Title

      Human-Agent Interaction Simposium 2006 (in Japanese) 1B-2

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] Gaze behaviors at speaking turns in three-party conversation-strategy of hearers for utterance and silence-2006

    • Author(s)
      Hiroko Tokunaga, Masahide Yuasa, Naoki Mukawa
    • Journal Title

      The Institute of Electronics, Information and Communication Engineers Technical Report (in Japanese) HCS2006-45

      Pages: 23-28

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] Impression analysis of human-like agent with gaze and facial expression : reactions caused by agent' s 'Nagashime' behavior2006

    • Author(s)
      Sanami Nakadai, Yukari Kawasaki, Masahide Yuasa, Naoki Mukawa
    • Journal Title

      The Institute of Electrical Engineers of Japan Journal of Electronics, Information and Systems (in Japanese)

      Pages: 230-235

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] The effective flirtatious and the background2006

    • Author(s)
      Pazilat Rajap, Yukari Kawasaki, Masahide Yuasa, Naoki Mukawa
    • Journal Title

      Journal of Japanese Academy of Facial Studies (in Japanese) vol.6

      Pages: 180

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] Which behavior makes us happy in human-agent interaction, smile, face turn or greeting?2006

    • Author(s)
      Masatomo Nishi, Hiroki Kuroki, Masahide Yuasa, Naoki Mukawa, Takamasa Shimada
    • Journal Title

      Journal of Japanese Academy of Facial Studies (in Japanese) vol.6

      Pages: 144

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] Analysis of joyfulness during interaction : Brain activity analysis of interaction between human and human-like agent with gaze and facial expression2006

    • Author(s)
      Hiroki Kuroki, Naoki Mukawa, Takamasa Shimada, Masahide Yuasa
    • Journal Title

      The 20^<th> Annual Conference of the Japanese Society for Artificial Intelligence (in Japanese) CD-ROM

      Pages: 3F3-5

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] Space arrangements and pressure of personification agents2006

    • Author(s)
      Ayami Oshikawa, Naoki Mukawa, Yukari Kawasaki, Masahide Yuasa
    • Journal Title

      The Institute of Electronic s, Information and Communication Engineers, A general national convention (in Japanese) CD-ROM

      Pages: A14-1

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] A Study on allocation method of Japanese text input indicators for eye-gaze input under natural light2006

    • Author(s)
      Kiyokiko Abe, Hironobu Sato, Shoichi ohi, Minoru Ohyama
    • Journal Title

      The Institute of Electronics, Information and Communication Engineers Technical Report (in Japanese) HCS2006-42

      Pages: 7-12

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] A study on allocation method of Japanese text input indicators for eye-gaze input under natural light2006

    • Author(s)
      Kiyokiko Abe, Hironobu Sato, Shoichi ohi, Minoru Ohyama
    • Journal Title

      Journal of Japanese Academy of Facial Studies (in Japanese) Vol.6,No.1

      Pages: 135

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] Eye-gaze input system for physically disabled computer users2006

    • Author(s)
      Kiyokiko Abe, Hironobu Sato, Minoru Ohyama, Shoichi ohi
    • Journal Title

      The Institute of Image Information and Television Engineers (in Japanese) vol.60,No12

      Pages: 1971-1979

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] Video-mediated joint attention by preschoolers-making inferences of word meanings-2006

    • Author(s)
      Tetuya Yasuda, Harumi Kobayashi, Yosuke Motegi
    • Journal Title

      Japanese Cognitive Science Society The23th Meeting memoirs (in Japanese)

      Pages: 132-133

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] A tool for using abstract faces in communication over a computer network2006

    • Author(s)
      Masahide Yuasa
    • Journal Title

      Proc.of joint 3rd international conference on softcomputing and intelligent systems and 7th international symposium onadvanced intelligent systems SCIS&ISIS 2006

      Pages: 1573-1577

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] Impression analysis of animated agents in soft game theory2006

    • Author(s)
      Masahide Yuasa
    • Journal Title

      Proc.of joint 3rd international conference on soft computing and intelligent systems and 7th international symposium on advanced intelligent systems SCIS&ISIS 2006

      Pages: 1043-1047

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] Emoticons convey emotions without cognition of faces : An fMRI study2006

    • Author(s)
      Masahide Yuasa, Keiichi Saito, Naoki Mukawa
    • Journal Title

      CHI Extended Abstracts 2006

      Pages: 1565-1570

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] Strategies of nonverbal information for animated agent based on soft game theory2006

    • Author(s)
      Masahide Yuasa, Naoki Mukawa
    • Journal Title

      Human-Agent Interaction Simposium 2006 (in Japanese) 1B-3

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] Brain activity associated with emoticons2006

    • Author(s)
      Masahide Yuasa, Keiichi Saito, Naoki Mukawa
    • Journal Title

      The Institute of Electrical Engineers of Japan Electronics, Information and Systems /Institute of Electrical Engineers of Japan meeting for the study document (in Japanese)

      Pages: 19-22

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] Brain activity by abstract faces used in communication over computer networks2006

    • Author(s)
      Masahide Yuasa, Keiichi Saito, Naoki Mukawa
    • Journal Title

      The 20^<th> Annual Conference of the Japanese Society for Artificial Intelligence,2006 (in Japanese) 2B1-4 (CD-ROM)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] Encyclopedia of linguistic science2006

    • Author(s)
      Ryoji Suzuki, Harumi Kobayashi
    • Journal Title

      Maruzen Co., Ltd. (in Japanese)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Journal Article] The facial expression effect of an animated agent on the decisions taken in the negotiation game

    • Author(s)
      Masahide Yuasa, Naoki Mukawa
    • Journal Title

      CHI Extended Abstracts2007 (In press)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Book] 言語科学の百科事典2006

    • Author(s)
      鈴木良二他編, 小林春美他分担執筆
    • Total Pages
      862
    • Publisher
      丸善株式会社
    • Description
      「研究成果報告書概要(和文)」より

URL: 

Published: 2008-05-27  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi