• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

The production of a conventional and computer adaptive online-self marking meaning-recall levels tests

Research Project

Project/Area Number 20K00792
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Review Section Basic Section 02100:Foreign language education-related
Research InstitutionMomoyama Gakuin University

Principal Investigator

McLean Stuart  桃山学院大学, 経営学部, 准教授 (10624794)

Co-Investigator(Kenkyū-buntansha) スチュワート ジェフリー  東京理科大学, 理学部第一部教養学科, 准教授 (40536306)
水本 篤  関西大学, 外国語学部, 教授 (80454768)
Project Period (FY) 2020-04-01 – 2023-03-31
Project Status Completed (Fiscal Year 2022)
Budget Amount *help
¥4,290,000 (Direct Cost: ¥3,300,000、Indirect Cost: ¥990,000)
Fiscal Year 2022: ¥780,000 (Direct Cost: ¥600,000、Indirect Cost: ¥180,000)
Fiscal Year 2021: ¥780,000 (Direct Cost: ¥600,000、Indirect Cost: ¥180,000)
Fiscal Year 2020: ¥2,730,000 (Direct Cost: ¥2,100,000、Indirect Cost: ¥630,000)
Keywordsvocabulary / testing / Vocabulary / Testing / CAT / Adaptive
Outline of Research at the Start

Vocabulary knowledge contributes to reading (Hu & Nation, 2000), listening (Van Zeeland & Schmitt, 2013), writing (Laufer & Nation, 1995), and speaking (Saito, Webb, Trofimovich, & Isaacs, 2016). When matching learners with lexically appropriate reading materials it is necessary to establish which 1,000- or 500-word band learners can comprehend 98% of. This project’s goal is to produce an easy to use self- marking meaning-recall (L2 to L1) Conventional Online Levels Test (COLT) and a Computer Adaptive Tests (CAT) version for learners, teachers and researchers, which provide immediate feedback

Outline of Final Research Achievements

This research has resulted in the production of an online Written-receptive Meaning-Recall convectional Vocabulary Levels Test, an online Spoken-receptive (Aural) Meaning-recall Test, and an online Written-receptive Meaning-Recall Computer Adaptive Vocabulary Levels Test. These tests are freely available to the public at https://vocableveltest.org/. Test responses are marked against a back of responses that are added to through feedback from test administrators on the accuracy of the automatically marked responses. After responses are marked against the bank of responses test administrators are shown which response types are marked as correct and incorrect. Test administrators are then able to override the marking of test-taker responses against the automatic marking against the bank of growing valid responses. If a test administrator overrides (disagrees with how a response has been marked) the automatic marking then this is noted and is used to improve the automatic answer bank.

Academic Significance and Societal Importance of the Research Achievements

The production of two (one written of aural) online receptive meaning-Recall convectional Vocabulary Levels Test, and an online Written-receptive Meaning-Recall Computer Adaptive Vocabulary Levels Test. 705 teachers have registers to use the site. Tens of thousands of students have completed tests.

Report

(4 results)
  • 2022 Annual Research Report   Final Research Report ( PDF )
  • 2021 Research-status Report
  • 2020 Research-status Report
  • Research Products

    (14 results)

All 2023 2022 2021 Other

All Int'l Joint Research (2 results) Journal Article (5 results) (of which Int'l Joint Research: 4 results,  Peer Reviewed: 5 results,  Open Access: 4 results) Presentation (7 results) (of which Int'l Joint Research: 2 results,  Invited: 2 results)

  • [Int'l Joint Research] Toronto University(カナダ)

    • Related Report
      2021 Research-status Report
  • [Int'l Joint Research] Carleton university pinchbeck(カナダ)

    • Related Report
      2021 Research-status Report
  • [Journal Article] Quantifying proper nouns’ influence on L2 English learners’ reading fluency2023

    • Author(s)
      Christopher Nicklin, Allie Patterson, Stuart McLean
    • Journal Title

      Studies in Second Language Acquisition

      Volume: Online First Issue: 4 Pages: 1-24

    • DOI

      10.1017/s027226312200050x

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] The Internal Consistency and Accuracy of Automatically Scored Written Receptive Meaning-Recall Data: A Preliminary Study2021

    • Author(s)
      McLean Stuart、Momoyama Gakuin University、Raine Paul、Pinchbeck Geoffrey、Hunston Laura、Kim YoungAe、Ueno Shotaro、Keio University、Carlton University、Josai International University、Kyoto Seika University、Hirakata Junior High School
    • Journal Title

      Vocabulary Learning and Instruction

      Volume: 10 Issue: 2 Pages: 64-81

    • DOI

      10.7820/vli.v10.2.mclean

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] WHAT THE RESEARCH SHOWS ABOUT WRITTEN RECEPTIVE VOCABULARY TESTING2021

    • Author(s)
      Stewart Jeffrey、Stoeckel Tim、McLean Stuart、Nation Paul、Pinchbeck Geoffrey G.
    • Journal Title

      Studies in Second Language Acquisition

      Volume: 43 Issue: 2 Pages: 462-471

    • DOI

      10.1017/s0272263121000437

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Comparisons of Word Lists on New Word Level Checker2021

    • Author(s)
      Mizumoto Atsushi、Kansai University、Pinchbeck Geoffrey、McLean Stuart、Carlton University、Momoyama Gakuin University
    • Journal Title

      Vocabulary Learning and Instruction

      Volume: 10 Issue: 2 Pages: 30-41

    • DOI

      10.7820/vli.v10.2.mizumoto

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] The coverage comprehension model, its importance to pedagogy and research, and threats to the validity with which it is operationalized.2021

    • Author(s)
      McLean, S.
    • Journal Title

      Reading in a Foreign Language

      Volume: 33 Pages: 126-140

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access
  • [Presentation] Initial validation of a meaning-recall online L2 Spanish Vocabulary Levels Test2022

    • Author(s)
      Pablo Robles-Garca Jeffrey Stewart, Stuart McLean
    • Organizer
      Language Testing Research Conference 2022
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Self-marking online form-recall and meaning-recall vocabulary tests2021

    • Author(s)
      Stuart McLean
    • Organizer
      JALT CALL
    • Related Report
      2021 Research-status Report
  • [Presentation] Vocabulary Day2021

    • Author(s)
      Stuart McLean
    • Organizer
      LET Kansai Fundamental Theory SIG (LET関西支部基礎理論研究部会)
    • Related Report
      2021 Research-status Report
    • Invited
  • [Presentation] Appropriately measuring lexical knowledge for pedagogy and research2021

    • Author(s)
      Stuart McLean
    • Organizer
      2021 CUE SIG Conference
    • Related Report
      2021 Research-status Report
  • [Presentation] Self-marking form-recall and meaning-recall vocabulary tests2021

    • Author(s)
      Stuart McLean
    • Organizer
      JALT PANSIG 2021
    • Related Report
      2021 Research-status Report 2020 Research-status Report
  • [Presentation] The Coverage Comprehension Model: Matching learners with lexically appropriate meaning-focused materials2021

    • Author(s)
      Stuart McLean
    • Organizer
      JALT PANSIG 2021
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] Self-marking online form-recall and meaning-recall vocabulary tests2021

    • Author(s)
      Stuart McLean
    • Organizer
      JALT OSAKA SIG Back to School 2021
    • Related Report
      2020 Research-status Report

URL: 

Published: 2020-04-28   Modified: 2024-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi