• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Study of Human Interface based on the Principle of Entrainment in Communication

Research Project

Project/Area Number 09838029
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field 感性工学
Research InstitutionOkayama Prefectural University

Principal Investigator

WATANABE Tomio  Okayama Prefectural University, Faculty of Computer Science and System Engineering, Professor, 情報工学部, 教授 (30167150)

Co-Investigator(Kenkyū-buntansha) KURODA Tsutomu  Okayama Prefectural University, Assistant Professor, 情報工学部, 助手 (60264909)
OKUBO Masashi  Okayama Prefectural University, Associate Professor, 情報工学部, 助教授 (10233074)
Project Period (FY) 1997 – 1998
Project Status Completed (Fiscal Year 1998)
Budget Amount *help
¥3,100,000 (Direct Cost: ¥3,100,000)
Fiscal Year 1998: ¥1,000,000 (Direct Cost: ¥1,000,000)
Fiscal Year 1997: ¥2,100,000 (Direct Cost: ¥2,100,000)
KeywordsHuman Interface / Human Interaction / Entrainment / Embodiment / Communication / Nonverbal / HCI / 人間工学
Research Abstract

(1) Embodied Viritual Communication System
An embodied virtual face-to-face communication system for human interaction analysis by synthesis was developed, and the effectiveness of the system was demonstrated. The system provides virtual communication environments where two remote talkers communicate through their virtual actors (VAs) or virtual waves (VWs) representing their face-to-face interactive behavior on the basis of their motions and voices. Talkers can obtain interaction awareness by observing their interaction of VAs or VWs including themselves in the same virtual space. In the system, even if the time lags of data transmission exist in network, the temporal interaction relation of VAs keeps natural because each behavior of VA is delayed in the same way in the same space. Thus, this system is quite unlike the conventional telecommunication systems where the communication space between talkers is separated because only the partner to talk to is displayed.
(2) Embodied Interaction Robots System
The concept of embodied interaction robots system was proposed based on an entrainment mechanism in human face-to-face interaction. Then, the prototype of the system was developed in which two models were incorporated : one was a listener's response model of head, arms andbody with timing equivalent to nodding on the basis of the moving average (MA) model of burst-pause of speech to nodding ; the other was a speaker's bodily response model based on his own MA model. Finally, the effectiveness of the system's bodily interaction was demonstrated. The effects of robots as physical media were also evaluated in comparison with computer graphics as electronic media.
The systems would be expected to form the foundation of information media and communication technologies as well as the methodology for the analysis and understanding of various human interactions.

Report

(3 results)
  • 1998 Annual Research Report   Final Research Report Summary
  • 1997 Annual Research Report
  • Research Products

    (38 results)

All Other

All Publications (38 results)

  • [Publications] 渡辺富夫,大久保雅史: "身体的コミュニケーション解析のためのバーチャルコミュニケーションシステム" 情報処理学会論文誌. 40・2. 670-676 (1999)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] 渡辺富夫,大久保雅史: "コミュニケーションにおける引き込み現象の生理的側面からの分析評価" 情報処理学会論文誌. 39・5. 1225-1231 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] 渡辺富夫: "コミュニケーションにおける引き込みと身体性" Neonatal Care. 12・2. 122-128 (1999)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] 渡辺富夫: "身体的コミュニケーションにおける引き込み" 日本新生児学会雑誌. 34・4. 734-738 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Tomio Watanabe, Masashi Okubo and Masao Inadome: "Virtual Communication System for Human Interaction Analysis" Proc.of the 7th IEEE International Workshop on Robot and Human Communication. 21-26 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Tomio Watanabe, Masashi Okubo and Tsutomu Kuroda: "Evaluation of Emotion by Using Peripheral Skin Temperature-the Effectiveness of Measurement on the Back of Finger" Proc.of the 7th IFAC/IFIP/IFORS/IEA Symposium on Analysis, Design and Evaluation of Man-Machine Systems. 401-405 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] 渡辺富夫: "ヒューマンインタフェース" オーム社, 263-267 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] 渡辺富夫: "赤ちゃんの認識世界" ミネルヴァ書房, 51-74 (1999)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Tomio Watanabe and Masashi Okubo.: "Virtual Communication System for Human Interaction Analysis" Transactions of Information Processing Society of Japan. Vol.40, No.2. 670-676 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Tomio Watanabe: "Communication in Entrainment and Embodiment" Neonatal Care. Vol.12, No.2. 122-128 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Tomio Watanabe and Masashi Okubo: "Physiological Analysis of Entrainment in Communication" Transactions of Information Processing Society of Japan. Vol.39, No.5. 1125-1231 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Tomio Watanabe: "Entrainment in Embodied Communication" Acta Neonatologica Japonica. Vol.34, No.4. 734-738 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Masashi Okubo and Tomio Watanabe: "Sensory Evaluation of the Preference of 3D Shape in Virtual and Real Spaces" Transactions of the Japan Society of Mechanical Engineers. Vol.64, No.620. 1218-1222 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Tsutomu Kuroda and Tomio Watanabe: "Analysis and Synthesis of Facial Color Using Color Image Processing" JSME International Journal. Vol.41, No.2(C). 307-312 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Tomio Watanabe, Masashi Okubo and Tsutomu Kuroda: "Evaluation of Emotion by Using Peripheral Skin Temperature-the Effectiveness of Measurement on the Back of Finger" Proc.of the 7th IFAC/IFIP/IFORS/IEA Symposium on Analysis, Design and Evaluation of Man-Machine Systems. 401-405 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Tomio Watanabe, Masashi Okubo and Msao Inadome: "Virtual Communicaion System for Human Interaction Analysis" Proc.of the 7th IEEE International Workshop on Robot and Human Communication. 21-26 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Masashi Okubo, Tomio Watanabe and Kimishige Yamada: "Lip Motion Extraction from Color Video Images Using Optical-Snakes" ibid.507-512 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Tsutomu Kuroda and Tomio Watanabe: "Facial Color Image Analysis and Synthesis for Emotional Change" ibid.456-461 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Tsutomu Kuroda and Tomio Watanabe: "Affect Display for Virtual Face Image Using Facial Color" Proc.of the 3rd International Conference on Advanced Mechatronics. 352-356 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Masashi Okubo and Tomio Watanabe: "Lip Motion Capture and Its Application to 3-D Molding" Proc.of the 3rd International Conference on Automatic Face and Gesture Recognition. 187-192 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Masashi Okubo and Tomio Watanabe: "Shape Evaluation in Virtual and Real Spaces Using Sensory Evaluation and Heart Rate Variability" JAPAN-U.S.A.Symposium on Flexible Automation. 869-874 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Tomio Watanabe and Masashi Okubo: "Physiological Analysis of Entrainment in Face-to-Face Communicaion" Advances in Human Factors/Ergonomics. Vol.21B. 411-414 (1997)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Tomio Watanabe and Masashi Okubo: "Evaluation of the Entrainment Between a Speaker's Burst-Pause of Speech and Respiration and a Listener's Respiration in Face-to-Face Communication" Proc.of the 6th IEEE International Workshop on Robot and Human Communication. 392-397 (1997)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Masashi Okubo and Tomio Watanabe: "Sensory Evaluation of the Preference of 3D Shape in Virtual And Real Environments" ibid.460-464 (1997)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] 渡辺富夫,大久保雅史: "身体的コミュニケーション解析のためのバーチャルコミュニケーションシステム" 情報処理学会論文誌. 40・2. 670-676 (1999)

    • Related Report
      1998 Annual Research Report
  • [Publications] 渡辺富夫,大久保雅史: "コミュニケーションにおける引き込み現象の生理的側面からの分析評価" 情報処理学会論文誌. 39・5. 1225-1231 (1998)

    • Related Report
      1998 Annual Research Report
  • [Publications] 渡辺富夫: "コミュニケーションにおける引き込みと身体性" Neonatal Care. 12・2. 122-128 (1999)

    • Related Report
      1998 Annual Research Report
  • [Publications] 渡辺富夫: "身体的コミュニケーションにおける引き込み" 日本新生児学会雑誌. 34・4. 734-738 (1998)

    • Related Report
      1998 Annual Research Report
  • [Publications] Tomio Watanabe,Masashi Okubo and Masao Inadome: "Virtual Communication System for Human Interaction Analysis" Proc.of the 7th IEEE International Workshop on Robot and Human Communication. 21-26 (1998)

    • Related Report
      1998 Annual Research Report
  • [Publications] Tomio Watanabe,Masashi Okubo and Tsutomu Kuroda: "Evaluation of Emotion by Using Peripheral Skin Temperature -the Effectiveness of Measurement on the Back of Finger" Proc.of the 7th IFAC/IFIP/IFORS/IEA Symposium on Analysis,Design and Evaluation of Man-Machine Systems. 401-405 (1998)

    • Related Report
      1998 Annual Research Report
  • [Publications] 渡辺富夫: "ヒューマンインタフェース" オーム社, 263-267 (1998)

    • Related Report
      1998 Annual Research Report
  • [Publications] 渡辺富夫: "赤ちゃんの認識世界" ミネルヴァ書房, 51-74 (1999)

    • Related Report
      1998 Annual Research Report
  • [Publications] 渡辺富夫,大久保雅史: "コミュニケーションにおける引き込み現象の生理的側面からの分析評価" 情報処理学会論文誌. 39・5(掲載決定). 総7ページ (1998)

    • Related Report
      1997 Annual Research Report
  • [Publications] 渡辺富夫,大久保雅史: "コミュニケーションにおける引き込み-音声のON-OFFに基づく頷き反応モデル-" 情報処理学会第56回全国大会講演論文集(4). 4-15-4-16 (1998)

    • Related Report
      1997 Annual Research Report
  • [Publications] Tomio Watanabe, Masashi Okubo: "Physiological Analysis of Entrainment in Face-to-Face Communication" Advances in Human Factors/Ergonomics. 21B. 411-414 (1997)

    • Related Report
      1997 Annual Research Report
  • [Publications] Tomio Watanabe, Masashi Okubo: "Evaluation of the Entrainment Between a Speaker's Burst-Pause of Speech and Respiration and a Listener's Respiration in Face-to-Face Communication" Proc.of the 6th IEEE International Workshop on Robot and Human Communication. 392-397 (1997)

    • Related Report
      1997 Annual Research Report
  • [Publications] Masashi Okubo, Tomio Watanabe: "Sensory Evaluation of the Preference of 3D Shape in Virtual and Real Environments" Proc.of the 6th IEEE International Workshop on Robot and Human Communication. 460-464 (1997)

    • Related Report
      1997 Annual Research Report
  • [Publications] 黒田勉,渡辺富夫: "色彩画像処理による顔色の分析と合成" 日本機械学会論文集(C編). 63・608. 1255-1260 (1997)

    • Related Report
      1997 Annual Research Report

URL: 

Published: 1997-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi