2016 Fiscal Year Final Research Report
An investigation of rater variability in the context of teacher employment examinations using a mixed approach
| Project/Area Number |
25370726
|
|---|
| Research Category |
Grant-in-Aid for Scientific Research (C)
|
| Allocation Type | Multi-year Fund |
|---|
| Section | 一般 |
|---|
| Research Field |
Foreign language education
|
|---|
| Research Institution | Bunkyo University |
|---|
Principal Investigator |
|
|---|
| Project Period (FY) |
2013-04-01 – 2017-03-31
|
| Keywords | 教員採用試験 / パフォーマンステスト / 模擬授業 / 評価者 |
|---|
| Outline of Final Research Achievements |
This study aims to examine possible reasons of rater variability in employing prospective English teachers, both quantitatively (Many-Facet Rasch Analysis, MFRA) and qualitatively (think-aloud method). Thirty candidates undertook microteaching tests. Seventeen raters rated all candidates using assessment criteria. Results indicate that most of the raters show consistent rating patterns but with various levels of severity. Results of the think-aloud method show that raters rated candidates not only with different interpretations of and different attention to subcategories of assessment criteria but also according to different core teaching values and ideal images of English teachers or English classes possessed by the rater themselves, leading to divergence between lenient and harsh ratings of the same candidates by different raters.
|
| Free Research Field |
言語テスト
|
