| 研究課題/領域番号 |
21K13083
|
|---|
| 研究種目 |
若手研究
|
| 配分区分 | 基金 |
|---|
| 審査区分 |
小区分02100:外国語教育関連
|
|---|
| 研究機関 | 帝塚山大学 |
|---|
研究代表者 |
Bower Jack 帝塚山大学, 全学教育開発センター, 准教授 (90406687)
|
|---|
| 研究期間 (年度) |
2021-04-01 – 2025-03-31
|
| 研究課題ステータス |
交付 (2022年度)
|
| 配分額 *注記 |
4,030千円 (直接経費: 3,100千円、間接経費: 930千円)
2024年度: 260千円 (直接経費: 200千円、間接経費: 60千円)
2023年度: 1,820千円 (直接経費: 1,400千円、間接経費: 420千円)
2022年度: 1,820千円 (直接経費: 1,400千円、間接経費: 420千円)
2021年度: 130千円 (直接経費: 100千円、間接経費: 30千円)
|
|---|
| キーワード | language testing / assessment / CEFR / CEFR-J / course placement / Moodle / Language testing / Placement test / Test validation / English proficiency test |
|---|
| 研究開始時の研究の概要 |
This research is a validation study of an online, CEFR-informed, English course placement test designed for Japanese university students. Results of this research will be of benefit to language educators seeking to make their own online, CEFR-informed or CEFR-linked language tests.
|
| 研究実績の概要 |
In 2022 a slightly revised version of the course placement test with a 40-minute time limit was trailed. 247 of the Japanese university students who took the test on their smartphones through the Moodle LMS, gave permission for their test results to be used for research purposes. As with the first pilot, strong statistical evidence from a Cronbach's alpha of 0.9 and a Rasch person separation statistic of 2.91 was found to support the test function of dividing students into three ability groups for course placement purposes. However, item analysis revealed some problems with item quality and with the ordering of test items when ranked by CEFR-J wordlist levels. Therefore, further revision and creation of test items is needed before collecting criterion validity data and setting cut scores.
|
| 現在までの達成度 (区分) |
現在までの達成度 (区分)
3: やや遅れている
理由
Two major challenges were encountered in the second year of this research project. Firstly, although the test was used for actual course placement purposes at the researcher's university for the first time at that start of the 2023 academic year, only reading items could be used and listening items had to be abandoned due to administrative constraints. Furthermore, permission was not granted by the university administration for the use of student test data from the the first actual implementation of the test for research purposes. Secondly, it was found that some test items need further revision, so the goal of correlating the test with results from commercial English placement tests is better left until the 2024 academic year after test items have been further revised.
|
| 今後の研究の推進方策 |
In the 2023 academic year the researcher will focus on building a larger question bank for the placement test, from which to select well-functioning items for the 2024 iteration of the test. The new test items will be trialed with Japanese university students at the researcher:s institution and the results will be equated with results from the 2022 pilot test administration.The researcher will also attempt to get permission from his university to be able to use results from the 2024 administration the test for English course placement at his university for research purposes. Additionally, the researcher will submit research papers on this project to at least two academic journals, and will again endeavor to present research results at one domestic and one international conference.
|
