| 研究課題/領域番号 |
17K02964
|
|---|
| 研究機関 | 富山高等専門学校 |
|---|
研究代表者 |
COOPER T・D 富山高等専門学校, 一般教養科, 准教授 (70442449)
|
|---|
| 研究分担者 |
的場 隆一 富山高等専門学校, 電子情報工学, 准教授 (30592323)
塚田 章 富山高等専門学校, 電子情報工学, 教授 (40236849)
五味 伸之 福井工業高等専門学校, 機械工学科, 助教 (80600634)
|
|---|
| 研究期間 (年度) |
2017-04-01 – 2020-03-31
|
| キーワード | Nonverbal / Facial analysis / Audio wave analysis |
|---|
| 研究実績の概要 |
Three components of the initial system are being developed. The audio portion was designed to analyse the speech of students The audio clips were recorded as wav files and scored with a rubric. Overall pronunciation was scored using individual sounds 40%, word/sentence stress 30% and rhythm/intonation 30%. And the scoring data of several judges was used to create an algorithm to automatically assess students.
The facial recognition portion was improved in its accuracy even with a smaller library of images. More improvements are being made in limiting the personal data required to establish identity.
The gestural recognition component was improved to analyse the richness and quality of facial expression. More improvements are being made to increase the accuracy, and scored units.
|
| 現在までの達成度 (区分) |
現在までの達成度 (区分)
3: やや遅れている
理由
While the prototypes have been designed and some improvements have been made, the software has not been fully implemented in the curricula.
|
| 今後の研究の推進方策 |
The audio portion will be improved by increasing the scoring units. Now the system relies on giving one general score by using a rubric with 3 ranges. We will create the system to give 3 separate analyses and allow the user to get 3 different types of feedback.
The facial recognition portion will be improved to be more accurate even when using less data. We are particularly concerned about the amount of personal information needed, and we want to limit such.
Finally, the gestural portion will also be improved to check for more features of non-verbal communication, giving wider and better feedback to users.
|
| 次年度使用額が生じた理由 |
This year H29, we could not implement the system into the curriculum due to reasons such as the renewal of our computer system, and the postponement of a planned overseas presentation.
In the coming year H30, the transferred portion will be used to develop the system and for the presentation that had been postponed in H29.
|
