• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

A STUDY OF ENTRAINMENT IN VERBAL COMMUNICATION AND ITS APPLICATIONS TO HUMAN INTERFACE

Research Project

Project/Area Number 05650253
Research Category

Grant-in-Aid for General Scientific Research (C)

Allocation TypeSingle-year Grants
Research Field Intelligent mechanics/Mechanical systems
Research InstitutionOKAYAMA PREFECTURAL UNIVERSITY

Principal Investigator

WATANABE Tomio  OKAYAMA PREFECTURAL UNIVERSITY,FACULTY OF COMPUTER SCIENCE AND SYSTEM ENGINEERING,PROFESSOR, 情報工学部, 教授 (30167150)

Project Period (FY) 1993 – 1994
Project Status Completed (Fiscal Year 1994)
Budget Amount *help
¥2,300,000 (Direct Cost: ¥2,300,000)
Fiscal Year 1994: ¥1,200,000 (Direct Cost: ¥1,200,000)
Fiscal Year 1993: ¥1,100,000 (Direct Cost: ¥1,100,000)
KeywordsHuman Interface / Entrainment / Facial Expression / Communication / Lip-reding / Speech Input / Non-verbal Interface / 音声
Research Abstract

We evaluated the synchrony between a speaker's voice and eye-blink, and a listener's eye-blink and nodding in actual face-to-face interaction by the cross-correlation analysis. We found significant synchronous, and lagged relationships betweem : (a) a speaker's voice and own his eye-blinking response ; (b) a speaker's voice and a listener's eye-blinking and nodding responses. We also found that the listener's eye blinking response tends to occur during nodding. On the basis of these findings, an eye-blinking and nodding feedback model for speech input was proposed, and the effectiveness was demonstrated. Finally, a model system using a digital signal processor which accepted voice-activated input and provided feedback to the speaker was tested with the aim of developing more user-friendly computer systems. Attentiveness to, and comprehension of, information were mainly expressed by simulated nodding, the nodding onset being estimated by a weighted sum of the binary vocal signal, while the remaining communicative signals were simulated using facial expressions alne. The smoothness of speech input when the voice-reactive system is used was measured using subjective sensory evaluation by the speaker, and the finding was that the smoothness of the speech input was improved by the system. This model would be applicable to a variety of human-computer interactions where visual feedback is possible and may well lead to a more user-friendly system.

Report

(3 results)
  • 1994 Annual Research Report   Final Research Report Summary
  • 1993 Annual Research Report
  • Research Products

    (21 results)

All Other

All Publications (21 results)

  • [Publications] Tomio. Watanabe: "Effects of Pitch Adaptation in Prosody on Human-Machine Verbal Communication" 6th International Conference on Human-Computer Interaction. 7月発表. 6- (1995)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] 渡辺 富夫, 黒田 勉: "フラクタル性に基づくグラフィック・イメージの親しみ易さの評価" 第10回ヒューマン・インタフェース・シンポジウム論文集. 10. 301-304 (1994)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] 黒田 勉, 渡辺 富夫: "色彩データベースに基づく唇の形状抽出法" 第10回ヒューマン・インタフェース・シンポジウム論文集. 10. 349-354 (1994)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] 渡辺 富夫, B. M. Lester, C. F. Z. Boukydis: "乳児の泣き声に対する母親の知覚・感情と育児環境及び乳児発達との関係" 第33回日本ME学会大会. 235- (1994)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] T.Watanabe, B. M. Lester and C. F. Z. Boukydis: "Mothers'Perceptions and Feelings About Their Infant's Cry Relate to Home Environment and Developmental Outcome" 9th International Conference on Infant Studies. 193- (1994)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] Tomio Watanabe, et al.: "Early Differences in Maternal Perception of Infant Crying Predict Organization of the Home Enviroment and Developmental Outcome" 13th Biennial Meeting of ISSBD. 160- (1994)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] T.Watanabe: "Voice-Responsive Eye-Blinking Feedback for Improved Human-to-Machine Speech Input." Advances in Human Factors Ergonomics. 19B. 1091-1096 (1993)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] M.Nakano and T.Watanabe: "Machine Lip-Reading of Japanese Vowels Utilizing A Stereoscopic Vision System" Transaction of the Japan Society of Mechanical Engineers.60. 525-530 (1994)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] T.Watanabe: "Effects of Pitch Adaptation in Prosody on Human-Machine Verbal Communication" Advances in Human Factors Ergonomics. (in press).

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] T.Kuroda and T.Watanabe: "A Method for Lip Extraction of Face Image by Using HSV color space" Transactions of the Japan Society of Mechanical Engineers. submitted.

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] T.Watanabe, B,MLester and C.F.ZBoukydis: "Mothers' Perceptions and Feelings About Their Imfant's Cry Relate to Home Environment and Developmental Outcome." 9th International Conference on Infant Studies.193 (1994)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] T.Watanabe, B.M.Lester, C.F.ZBoukydis and N.Kobayashi: "Early Differences in Maternal Perception of Infant Crying Predict Organization of the Home Enviroment and Developmental Outcome" 13th Biennial Meeting of ISSBD. 160 (1994)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1994 Final Research Report Summary
  • [Publications] Tomio Watanabe: "Effects of Pitch Adaptation in Prosody on Human-Machine Verbal Communication" 6th International Conference on Human-Computer Interaction. (7月発表). 6ページ- (1995)

    • Related Report
      1994 Annual Research Report
  • [Publications] 渡辺富夫、黒田勉: "フラクタル性に基づくグラフイック・イメージの親しみ易さの評価" 第10回ヒューマン・インタフェース・シンポジウム論文集. 10. 301-304 (1994)

    • Related Report
      1994 Annual Research Report
  • [Publications] 黒田勉、渡辺富夫: "色彩データベースに基づく唇の形状抽出法" 第10回ヒューマン・インタフェース・シンポジウム論文集. 10. 349-354 (1994)

    • Related Report
      1994 Annual Research Report
  • [Publications] 渡辺富夫,B.M.Lester,C.F.Z.Boukydis: "乳児の泣き声に対する母親の知覚・感情と育児環境及び乳児発達との関係" 第33回日本ME学会大会. 235- (1994)

    • Related Report
      1994 Annual Research Report
  • [Publications] T.Watanabe,B.M.Lester and C.F.Z.Boukydis: "Mother's Perceptions and Feelings About Their Infant's Cry Relate to Home Environment and Developmental Outcome" 9th International Conference on Infant Studies. 193- (1994)

    • Related Report
      1994 Annual Research Report
  • [Publications] Tomio Watanabe et al.: "Early Differences in Maternal Perception of Infant Crying Predict Organization of the Home Enviroment and Development Outcome" 13th Biennial Meeting of ISSBD. 160- (1994)

    • Related Report
      1994 Annual Research Report
  • [Publications] Tomio Watanabe: "Voice-Responsive Eye-Blinking Feedback for Improved Human-to-Machine Speech Input" Advances in Human Factors/Ergonomics. 24A. 1091-1096 (1993)

    • Related Report
      1993 Annual Research Report
  • [Publications] 渡辺富夫: "音声対話システムにおける韻律情報適応化" 第9回ヒューマン・インタフェース・シンポジウム. 311-315 (1993)

    • Related Report
      1993 Annual Research Report
  • [Publications] 中野政身,渡辺富夫: "ステレオ視による母音口形の識別" 日本機会学会論文集. 60. 525-530 (1994)

    • Related Report
      1993 Annual Research Report

URL: 

Published: 1993-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi