研究実績の概要 |
In 2022 we concluded collecting data from Japan-based raters and submitted applications for permission to collect responses from Canada-based teacher raters at public schools. We also began quantitative analysis of data collected so far. Initial findings suggest that the L1 Japanese teachers of English rated the L1 Japanese L2 English speaker samples as low scoring for all categories aside from overall comprehensibility, but teaching experience did not influence L1 Japanese L2 English speaker sample ratings. However, for the L1 Thai L2 English samples, rater L1 only influenced segmental pronunciation and we observed a positive influence of teaching experience, with the L1 Japanese L2 English students rating samples significantly higher than their English teacher counterparts. In addition, both Japanese teachers and students report significantly lower confidence in their ability to rate English speech than English L1 or L2 English teachers in Japan. Furthermore, regarding evaluating specific aspects of speech, fluency was the easiest, while grammar and lexis were often the most challenging. For English L2 speakers, there was a lack of confidence in their own knowledge of correct grammar and vocabulary, while for English L1 speakers, the difficulty was in judging the complexity of the grammar and lexis accurately based on the sample length. In terms of vocabulary analysis, we observed that there was correlation between self-assessment vocabulary scores and some lexical measures, but no correlations were found for ratings by outside raters.
|
今後の研究の推進方策 |
This year we plan to complete all data collection and analysis. We will finish comparing ratings of Japan-based raters with their Canadian counterparts. We also plan to finish obtaining objective measures of speech sample fluency, vocabulary, and phonological features to compare to the human ratings. We have also applied to present our findings at the 2023 JALT International conference. We are also in the process of writing a paper on our initial findings that we will submit this summer and then we will write further papers once the final data collection and analysis is completed.
|