Development and Practical Evaluation of Teaching Materials for Developing English Nonverbal Communication Skills

2021 Fiscal Year Final Research Report

• Project/Area Number: 17K02964
• Research Category: Grant-in-Aid for Scientific Research (C)
• Allocation Type: Multi-year Fund
• Section: 一般
• Research Field: Foreign language education
• Research Institution: University of Toyama (2019-2021); National Institute of Technology, Toyama College (2017-2018)
• Principal Investigator: Cooper Todd Dwayne 富山大学, 学術研究部教養教育学系, 准教授 (70442449)
• Co-Investigator(Kenkyū-buntansha): 的場 隆一 富山高等専門学校, 電子情報工学, 准教授 (30592323) ; 塚田 章 富山高等専門学校, 電子情報工学, 教授 (40236849) ; 五味 伸之 福井工業高等専門学校, 機械工学科, 講師 (80600634) ; 成瀬 喜則 富山大学, 学術研究部教育学系, 教授 (00249773)
• Project Period (FY): 2017-04-01 – 2022-03-31
• Keywords: facial expression / nonverbal communication / L1 L2 difference / Kinect / mock job interview

Outline of Final Research Achievements

In this research, we specifically focused on facial expression and the nonverbal elements of the voice. When speakers speak, "how" speakers say something becomes just as important as "what" they say. Data were collected under the guise of a mock job interview. Twelve students were interviewed and recorded and later watched by the primary researcher, who assessed the facial expression and head movements using a 5-point Likert scale (1=poor, 5=excellent). Our system connects the interview scorer’s assessment with the actual head movements and facial expressions recorded by the Kinect. Users found that they became more aware of their facial expressions after using the system.

Free Research Field

Foreign language study

Academic Significance and Societal Importance of the Research Achievements

In business and technology, English is essential across the globe. This system helps Japanese EFL students to develop nonverbal communicative skills which makes up half of communication.