| Project/Area Number |
21K13083
|
|---|
| Research Category |
Grant-in-Aid for Early-Career Scientists
|
| Allocation Type | Multi-year Fund |
|---|
| Review Section |
Basic Section 02100:Foreign language education-related
|
|---|
| Research Institution | Waseda University (2024)
Tezukayama University (2021-2023) |
|---|
Principal Investigator |
Bower Jack 早稲田大学, 商学学術院, 准教授 (90406687)
|
|---|
| Project Period (FY) |
2021-04-01 – 2026-03-31
|
| Project Status |
Granted (Fiscal Year 2024)
|
| Budget Amount *help |
¥4,030,000 (Direct Cost: ¥3,100,000、Indirect Cost: ¥930,000)
Fiscal Year 2024: ¥260,000 (Direct Cost: ¥200,000、Indirect Cost: ¥60,000)
Fiscal Year 2023: ¥1,820,000 (Direct Cost: ¥1,400,000、Indirect Cost: ¥420,000)
Fiscal Year 2022: ¥1,820,000 (Direct Cost: ¥1,400,000、Indirect Cost: ¥420,000)
Fiscal Year 2021: ¥130,000 (Direct Cost: ¥100,000、Indirect Cost: ¥30,000)
|
|---|
| Keywords | Placement test / Test validity / CEFR / Online Language Test / placement testing / CEFR-J / language testing / assessment / course placement / Moodle / Language testing / Test validation / English proficiency test |
|---|
| Outline of Research at the Start |
This research is a validation study of an online, CEFR-informed, English course placement test designed for Japanese university students. Results of this research will be of benefit to language educators seeking to make their own online, CEFR-informed or CEFR-linked language tests.
|
| Outline of Annual Research Achievements |
In the 2024 academic year, I presented at the AILA international conference in Malaysia on unexpected item difficulty patterns in test items based on the CEFR-J vocabulary list. I received valuable feedback from experts in applied linguistics, which helped refine my approach. I subsequently examined ways to improve the test format to more efficiently and effectively measure general language proficiency while remaining CEFR-informed. After reviewing relevant literature I decided to redesign the test using C-test and dictation items. These formats provide strong reliability and construct validity, and are also practical to create and administer, supporting the project’s goal of developing a cost-effective, valid alternative to commercial English proficiency tests.
|
| Current Status of Research Progress |
Current Status of Research Progress
4: Progress in research has been delayed.
Reason
Progress on the project in the 2024 academic year was delayed due to a major life event involving a job change and the resulting need to adjust to a new workplace and responsibilities. These professional transitions, along with family obligations, significantly impacted the timeline, and the project fell behind schedule.
|
| Strategy for Future Research Activity |
To improve validity and efficiency, a new placement test using C-test and dictation items will be piloted. These integrative item types are widely considered better measures of overall language proficiency than discrete-point formats, as they require simultaneous use of multiple skills. A custom Moodle plugin will be developed by an educational software company to support these formats. CEFR-informed items will be created using TextInspector and the English Vocabulary and Grammar Profiles. University student volunteers will take the pilot test, the Versant English Placement Test, and a self-assessment questionnaire. Data will be used to examine the test’s validity for placement and its CEFR alignment. The plugin will be released publicly to support other educators and test developers.
|
