• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Validating a CEFR-informed Open Access English Placement Test

Research Project

Project/Area Number 21K13083
Research Category

Grant-in-Aid for Early-Career Scientists

Allocation TypeMulti-year Fund
Review Section Basic Section 02100:Foreign language education-related
Research InstitutionTezukayama University

Principal Investigator

Bower Jack  帝塚山大学, 全学教育開発センター, 准教授 (90406687)

Project Period (FY) 2021-04-01 – 2025-03-31
Project Status Granted (Fiscal Year 2023)
Budget Amount *help
¥4,030,000 (Direct Cost: ¥3,100,000、Indirect Cost: ¥930,000)
Fiscal Year 2024: ¥260,000 (Direct Cost: ¥200,000、Indirect Cost: ¥60,000)
Fiscal Year 2023: ¥1,820,000 (Direct Cost: ¥1,400,000、Indirect Cost: ¥420,000)
Fiscal Year 2022: ¥1,820,000 (Direct Cost: ¥1,400,000、Indirect Cost: ¥420,000)
Fiscal Year 2021: ¥130,000 (Direct Cost: ¥100,000、Indirect Cost: ¥30,000)
Keywordsplacement testing / CEFR / CEFR-J / language testing / assessment / course placement / Moodle / Language testing / Placement test / Test validation / English proficiency test
Outline of Research at the Start

This research is a validation study of an online, CEFR-informed, English course placement test designed for Japanese university students. Results of this research will be of benefit to language educators seeking to make their own online, CEFR-informed or CEFR-linked language tests.

Outline of Annual Research Achievements

In 2023, I presented analyses of my 2022 data at the JALT2023 International Conference in Tsukuba, Japan. At the conference, I had conversations with experts in the fields of language testing and vocabulary, which helped me plan the design of test items that will more validly separate test takers by CEFR level. I also continued the analysis of test results obtained in 2022 and began planning and designing better test item types, which should be able to overcome the problem of items based on the CEFR-J vocabulary list that were misordered when ranked by item difficulty level. Additionally, I made a submission to present the results of the 2022 data at the International Association of Applied Linguistics conference in Kuala Lumpur, Malaysia, in August 2024, and my application was accepted.

Current Status of Research Progress
Current Status of Research Progress

4: Progress in research has been delayed.

Reason

Unfortunately, I was unable to obtain further results from trialing the placement test in 2023. Although the placement test was used to stream 2024 entering students from four departments at the university where I worked, my application to use the test results for research was rejected. Additionally, although I submitted an analysis of the 2022 results to an international journal, feedback from the journal referees indicated that my research was better suited for another journal.

Strategy for Future Research Activity

In 2024, I plan to redesign the pilot test by updating item types and vocabulary selection based on the 2022 data analysis to address problems with items not ranking by CEFR level. I will also create a new pilot version to expand the proficiency range from CEFR A1 to B2, making the test more widely applicable. At my new research institution, I'll apply for permission to run this revised pilot test with my classes. Additionally, I will seek research collaborators to help administer the test at other Japanese universities. Furthermore, I will present my 2022 data results at the AILA conference for expert feedback and attend the Japan Language Testing Association conference for further consultation. Lastly, I will revise my article and submit it to a more suitable international journal.

Report

(3 results)
  • 2023 Research-status Report
  • 2022 Research-status Report
  • 2021 Research-status Report
  • Research Products

    (11 results)

All 2023 2022 2021 Other

All Presentation (5 results) (of which Int'l Joint Research: 2 results) Remarks (6 results)

  • [Presentation] Validation Of an Online English Course Placement Test2023

    • Author(s)
      Jack Bower
    • Organizer
      JALT2023 International Conference
    • Related Report
      2023 Research-status Report
  • [Presentation] Valid for Course Placement but not for CEFR placement?: Misordered, CEFR-J-informed test items at the A1 and A2 levels2022

    • Author(s)
      Jack Bower
    • Organizer
      CEFR-J 2023 Symposium
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] Preliminary validation of an online, CEFR-Informed, English courseplacement test2022

    • Author(s)
      Jack Bower
    • Organizer
      57th RELC International Conference
    • Related Report
      2022 Research-status Report
  • [Presentation] Using the Moodle Quiz Module for an English Course Placement Test2021

    • Author(s)
      Jack Bower
    • Organizer
      MoodleMoot Japan 2022
    • Related Report
      2021 Research-status Report
  • [Presentation] Introducing the COAEPT: A CEFR-informed, open-access, English placement test2021

    • Author(s)
      Jack Bower
    • Organizer
      18th Annual CamTESOL Conference on English Language Teaching
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Remarks] JALT2023 International Conference

    • URL

      https://jalt.org/conference/jalt2023

    • Related Report
      2023 Research-status Report
  • [Remarks] AILA 60th Anniversary World Congress 2024

    • URL

      https://aila2024.com/

    • Related Report
      2023 Research-status Report
  • [Remarks] 57th RELC International Conference Programme

    • URL

      https://www.relc.org.sg/documents/21424/52068463/2023+RELC+International+Conference+Programme.pdf/76fad9c1-0fa8-4740-befc-4516c67cc9c8

    • Related Report
      2022 Research-status Report
  • [Remarks] CEFR-J 2023 Symposium - Schedule

    • URL

      https://corpuscobo.net/events.html

    • Related Report
      2022 Research-status Report
  • [Remarks] MoodleMoot Japan 2022 Presentation Website

    • URL

      https://moodlejapan.org/mod/data/view.php?d=64&rid=2450

    • Related Report
      2021 Research-status Report
  • [Remarks] 18th Annual CamTESOL Conference Website

    • URL

      https://camtesol.org/Camtesol/Past%20Conferences/2022%20Conference

    • Related Report
      2021 Research-status Report

URL: 

Published: 2021-04-28   Modified: 2024-12-25  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi