2021 Fiscal Year Research-status Report
Evaluating communicative adequacy in English speaking - development and validation of rater evaluation rubric
| Project/Area Number |
21K00786
|
|---|
| Research Institution | Osaka University |
|---|
Principal Investigator |
リー シーチェン・ナンシー 大阪大学, 言語文化研究科(言語文化専攻), 講師 (60512308)
|
|---|
| Co-Investigator(Kenkyū-buntansha) |
小川 知恵 京都産業大学, 文化学部, 准教授 (40645107)
|
|---|
| Project Period (FY) |
2021-04-01 – 2024-03-31
|
| Keywords | communicative adequacy / speaking proficiency / evaluation / rater evaluation / validation |
|---|
| Outline of Annual Research Achievements |
Developing English speaking proficiency is a continuous challenge for many Japanese learners. Not only do learners lack confidence when speaking English, many teachers also struggle with how to teach and evaluate English speaking. The conceptualization of L2 speaking proficiency is extremely controversial. In the field of task-based language teaching (TBLT), L2 speaking proficiency has often been conceptualized in terms of three constructs: complexity, accuracy, and fluency. Communicative adequacy is argued to be a new measurement of speaking proficiency because it evaluates how successful speakers are in achieving the objective of their original speaking task. This study therefore aims to conceptualize EFL communicative adequacy for Japanese learners.
|
| Current Status of Research Progress |
Current Status of Research Progress
3: Progress in research has been slightly delayed.
Reason
In order to investigate L2 learners’ conceptualization of communicative adequacy, student participants were asked to rate four students’ English narration intuitively and to give reasons to justify their rating. A total of 53 first-year and second-year Japanese university students (from two universities) participated in this study and approximately 1600 words of comments were collected. Categorization of comments was made by grouping comments with the same (or equivalent) key words were grouped into the same categories. Results of up-to-date research was presented the 56th RELC International Conference-Equitable and inclusive Language Education (Singapore, online) and a paper has been submitted to RELC Conference in Anthology Series (in the process of being considered).
|
| Strategy for Future Research Activity |
The present study aims to continue to examine communicative adequacy by looking further into fluency. It was found in the initial survey analysis that Japanese student participants are predominantly concerned with fluency in speaking. It aims to clarify Japanese learners’ conceptualization of fluency and proficiency for having successful communication. In addition, it will also investigate teacher raters’ conceptualization of communicative adequacy. Depending on the 2022 Covid-19 situation, it aims to engage some teacher raters for doing intuitive evaluation of pre-recorded cartoon narrations.
|
| Causes of Carryover |
計画がやや変わったためです。
|
