2021 Fiscal Year Research-status Report
Validating a CEFR-informed Open Access English Placement Test
| Project/Area Number |
21K13083
|
|---|
| Research Institution | Tezukayama University |
|---|
Principal Investigator |
Bower Jack 帝塚山大学, 全学教育開発センター, 准教授 (90406687)
|
|---|
| Project Period (FY) |
2021-04-01 – 2025-03-31
|
| Keywords | assessment / CEFR / course placement / language testing / Moodle |
|---|
| Outline of Annual Research Achievements |
A pilot version of an online, CEFR-informed English course placement test was created consisting of 90 questions. The test was then placed on the Tezukayama University Active Learning System using the Moodle LMS. After receiving research ethics approval from Tezukayama University, the pilot test was administered to six of the researcher's English language classes in second semester, 2021, along with a short survey about the test. 87 students gave permission for their test data and 104 students for their survey data to be used for research purposes. Rash analysis of the test results showed high reliability, and that the test was able to separate the students into three distinct proficiency groups. However, student comments in the survey showed that more time needed to be given for the test.
|
| Current Status of Research Progress |
Current Status of Research Progress
2: Research has progressed on the whole more than it was originally planned.
Reason
The goals of designing the placement test and piloting it with the researchers English classes in the 2021 academic year were met. The researcher was also able to present on the research results at a domestic conference and at an international conference. Furthermore, statistical analyses of the test provide strong evidence that the test is able to fulfill it's puporse of dividing students into three levels of English proficiency for English as a foreign language course placement purposes.
|
| Strategy for Future Research Activity |
In the second year of the project, the placement test will again be piloted on the researcher's first semester English classes at Tezukayama University. In this pilot, the time limit of the test will be raised from 30 minutes to 40 minutes as several students in the survey indicated that they did not have enough time to complete the test. In addition, the researcher will host the test on a commercial Moodle server, so that it can be taken by students outside Tezukayama university. An ethics application will also be made to Nishikyushu University with a view to piloting the placement test with their first-year students. Lastly, volunteer university students from other institutions will be sought to take the placement test along with two commercial tests.
|
| Causes of Carryover |
This amount will be put toward payment of a commercial Moodle server.
|
