2007 Fiscal Year Final Research Report Summary
Eye-Movement measurement while Learning Pronunciation Using English Pronunciation Practice CAI System Based on Sound and Mouth Movement
| Project/Area Number |
17500669
|
|---|
| Research Category |
Grant-in-Aid for Scientific Research (C)
|
| Allocation Type | Single-year Grants |
|---|
| Section | 一般 |
|---|
| Research Field |
Educational technology
|
|---|
| Research Institution | Kurume Institute of Technology |
|---|
Principal Investigator |
ODA Mariko Kurume Institute of Technology, Engineering, Lecturer (20269046)
|
|---|
| Project Period (FY) |
2005 – 2007
|
| Keywords | Eye Movement / English Pronunciation / Mouth Movement / Lip Reading / CG Animation |
|---|
| Research Abstract |
The pronunciation practice CAI system called “Lip Reading" based on lip reading techniques has been developed. “Lip Reading" enables a learner to practice English pronunciation by looking at the model speaker's mouth movement and allows to compare his/her own mouth movement which is simultaneously shown on the screen by the video camera connected to a computer. After Using “Lip Reading", the native speakers could easily recognize the students' performance. “Lip Reading" is effective for improvements of pronunciation by correcting of mouth movements.
However, it is not always clear which part of the mouth should be focused on for each sound. Therefore, eye cameras were used to precisely measure both native speakers' and students' eye movements as they observed the model speaker's mouth on the computer screen. A variety of aspects regarding eye movement were analyzed and the data was conveyed numerically. For example, some students did not observe the model speaker's mouth, but rather other parts of the face. Some students did not understand when, where or how to properly observe the model speaker's mouth.
In order to capture the student's attention and focus it on the proper aspects of pronunciation and mouth movement, we produced a new computer graphics (CG) animation film emphasizing the precise areas of mouth movement. Using this new CG animation system, students were able to practice proper pronunciation much more effectively.
|
