表情とパラ言語を自動評価する非言語コミュニケーション能力育成教材の開発と実践評価
| Project/Area Number |
21K00675
|
|---|
| Research Category |
Grant-in-Aid for Scientific Research (C)
|
| Allocation Type | Multi-year Fund |
|---|
| Section | 一般 |
|---|
| Review Section |
Basic Section 02100:Foreign language education-related
|
|---|
| Research Institution | University of Toyama |
|---|
Principal Investigator |
COOPER T・D 富山大学, 学術研究部教養教育学系, 准教授 (70442449)
|
|---|
| Co-Investigator(Kenkyū-buntansha) |
的場 隆一 富山高等専門学校, その他部局等, 准教授 (30592323)
塚田 章 富山高等専門学校, その他部局等, 教授 (40236849)
|
|---|
| Project Period (FY) |
2021-04-01 – 2024-03-31
|
| Project Status |
Granted (Fiscal Year 2022)
|
| Budget Amount *help |
¥3,770,000 (Direct Cost: ¥2,900,000、Indirect Cost: ¥870,000)
Fiscal Year 2023: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2022: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Fiscal Year 2021: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
|
|---|
| Keywords | Facial expression / AI / mock interviews / online interviews / nonverbal communication / gaze tracking / facial expression / kinect camera / mock job interview / L1 L2 differences / paralanguage |
|---|
| Outline of Research at the Start |
The system will automatically assess the NVC skills of both student’s language interviews and presentations; specifically, users will be given immediate feedback on the quantity and quality of their facial expression, and their spoken answers to real-life situations.
|
| Outline of Annual Research Achievements |
With the lifting of the COVID-19 restrictions we were able to further our progress with our research, hold a new series of interviews, and present our findings at several international conferences. By changing the code from C to Python, we were able to use AI technology to analyze the facial expression of interviewees, this in turn allowed us to also start using gaze technology which helps us better assess eye contact. In this round, students participated in mock job interviews remotely via Zoom, which helps them get used to video interviews. Finally, we presented our findings at EdMEDIA 2022 via Zoom, and onsite at the ALANZ/ALAA/ALTAANZ Applied Linguistics Conference 2022 and CamTESOL 2023.
|
| Current Status of Research Progress |
Current Status of Research Progress
3: Progress in research has been slightly delayed.
Reason
Our project was delayed by COVID-19 so we rethought our experiment procedures and started to hold our mock job interviews online. With the lifting of most restrictions we were able to get back close to our original timeline.
|
| Strategy for Future Research Activity |
Our plan is to hold our next round of interviews n mid- to late 2023. In this round we will incorporate AI and gaze technology. These findings will be presented at a conference in early 2024.
|
Report
(2 results)
Research Products
(5 results)
