| Project/Area Number |
17K02964
|
|---|
| Research Category |
Grant-in-Aid for Scientific Research (C)
|
| Allocation Type | Multi-year Fund |
|---|
| Section | 一般 |
|---|
| Research Field |
Foreign language education
|
|---|
| Research Institution | University of Toyama (2019-2021)
National Institute of Technology, Toyama College (2017-2018) |
|---|
Principal Investigator |
|
|---|
| Co-Investigator(Kenkyū-buntansha) |
的場 隆一 富山高等専門学校, 電子情報工学, 准教授 (30592323)
塚田 章 富山高等専門学校, 電子情報工学, 教授 (40236849)
五味 伸之 福井工業高等専門学校, 機械工学科, 講師 (80600634)
成瀬 喜則 富山大学, 学術研究部教育学系, 教授 (00249773)
|
|---|
| Project Period (FY) |
2017-04-01 – 2022-03-31
|
| Project Status |
Completed (Fiscal Year 2021)
|
| Budget Amount *help |
¥4,290,000 (Direct Cost: ¥3,300,000、Indirect Cost: ¥990,000)
Fiscal Year 2019: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2018: ¥1,690,000 (Direct Cost: ¥1,300,000、Indirect Cost: ¥390,000)
Fiscal Year 2017: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
|
|---|
| Keywords | facial expression / nonverbal communication / L1 L2 difference / Kinect / mock job interview / kinect camera / L1 L2 differences / Nonverbal communication / Facial expression / Speaking assessment / speaking assessment / Speech wave analysis / Nonverbal / Facial analysis / Audio wave analysis / expression / facial recognition / gesture recognition |
|---|
| Outline of Final Research Achievements |
In this research, we specifically focused on facial expression and the nonverbal elements of the voice. When speakers speak, "how" speakers say something becomes just as important as "what" they say. Data were collected under the guise of a mock job interview. Twelve students were interviewed and recorded and later watched by the primary researcher, who assessed the facial expression and head movements using a 5-point Likert scale (1=poor, 5=excellent). Our system connects the interview scorer’s assessment with the actual head movements and facial expressions recorded by the Kinect. Users found that they became more aware of their facial expressions after using the system.
|
| Academic Significance and Societal Importance of the Research Achievements |
In business and technology, English is essential across the globe. This system helps Japanese EFL students to develop nonverbal communicative skills which makes up half of communication.
|
