2021 Fiscal Year Research-status Report
The production of a conventional and computer adaptive online-self marking meaning-recall levels tests
| Project/Area Number |
20K00792
|
|---|
| Research Institution | Momoyama Gakuin University |
|---|
Principal Investigator |
Mclean Stuart 桃山学院大学, 経営学部, 准教授 (10624794)
|
|---|
| Co-Investigator(Kenkyū-buntansha) |
スチュワート ジェフリー 東京理科大学, 理学部第一部教養学科, 准教授 (40536306)
水本 篤 関西大学, 外国語学部, 教授 (80454768)
|
|---|
| Project Period (FY) |
2020-04-01 – 2023-03-31
|
| Keywords | vocabulary |
|---|
| Outline of Annual Research Achievements |
So far this KAKEN-funded research has resulted in the creation of the freely available self-marking meaning-recall (L2 to L1 translation) vocabulary levels and size tests (vocableveltest.org). The sites has been used by over 400 teachers, and over 10,000 test takers. Data from 500,000 responses has been collected. Once enough data is collected for stable difficulty estimates, this data will be used to create and CAT vocabulary levels test. The self-marking meaning-recall site was used in published research that investigated the accuracy of elf-marked responses. It was found that self-marked responses were 97 to 98% similar to human marked meaning-recall responses. The self-marking meaning-recall site has been promoted in one journal article, and numerous research presentations. Validation studies of meaning-recall test data collected from the site are currents under review. The self-marking meaning-recall site has been used in research presently under review with an internal journal. The test site is used in teaching as well as research. The testing site is used by teachers to (a) establish learners' lexical reading level so they can be matched with lexically appropriate materials, and (b) to measure student's lexical development over a semester or academic year. Work has started on a parallel Spanish test project.
|
| Current Status of Research Progress |
Current Status of Research Progress
3: Progress in research has been slightly delayed.
Reason
COVID delayed the creation of vocabulary questions and the creation of an answer bank as campus was closed in the spring semester of 2020. This delayed the creation of the testing platform. Further, as classes were not collect in person in a normal fashion it has delayed data collection.
|
| Strategy for Future Research Activity |
During the 2022 spring semester responses from students will be collected. Then, if stable difficultly logits can be established from the data collected a CAT will be created. If it is not possible to establish stable difficulty logits more data will be collected in the 2022 fall semester.
|
| Causes of Carryover |
Because of COVID we were unable to collect as much data as we planed from students. As result, we did not use as much money as we planned.
|
