2016 Fiscal Year Annual Research Report
Development and practical evaluation of communication skill training teaching materials using gesture and speech recognition
| Project/Area Number |
25370681
|
|---|
| Research Institution | National Institute of Technology, Toyama College |
|---|
Principal Investigator |
COOPER T・D 富山高等専門学校, 一般教養科, 准教授 (70442449)
|
|---|
| Co-Investigator(Kenkyū-buntansha) |
塚田 章 富山高等専門学校, 電子情報工学, 教授 (40236849)
的場 隆一 富山高等専門学校, 電子情報工学, 准教授 (30592323)
成瀬 喜則 富山大学, 教職実践開発研究科, 教授 (00249773)
|
|---|
| Project Period (FY) |
2013-04-01 – 2017-03-31
|
| Keywords | nonverbal / gesture recognition / speech recognition / facial analysis |
|---|
| Outline of Annual Research Achievements |
In this project, we developed a software-based gestural [GR], facial [FR] and speech recognition [SR] systems to help students perform better on English interviews and presentations.
SR: presented at Ed Media 2016: World Conference on Educational Media and Technology. In this presentation we stressed the importance of our research into modification of SR technology for non-native speakers of English, and emphasized the need to analyze facial expressions when communicating.
GR and FR: at the start of the year we presented at SITE 2016: Society for Information Technology & Teacher Education International Conference. In this presentation we showed how a 3D camera can assess the quality of non-verbal communication. Throughout the year, we were able to increase the accuracy of our system.
|
