• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to project page

2013 Fiscal Year Final Research Report

An Objective Test of Communicative English Proficiency

Research Project

  • PDF
Project/Area Number 24652131
Research Category

Grant-in-Aid for Challenging Exploratory Research

Allocation TypeSingle-year Grants
Research Field Foreign language education
Research InstitutionKeio University

Principal Investigator

BATTY Aaron Olaf  慶應義塾大学, 環境情報学部, 講師 (80406686)

Co-Investigator(Kenkyū-buntansha) JEFFREY Stewart  九州産業大学, 語学教育研究センター, 講師 (40536306)
Project Period (FY) 2012-04-01 – 2014-03-31
Keywords学力検査 / 言語試験 / 英語教育 / スピーキング伝達能力
Research Abstract

The researchers developed a new test of communicative speaking proficiency, called the Objective Communicative Speaking Test (OCST). The OCST is a timed information-gap task-based test delivered via tablet computers. The OCST measures the time required for a speaker to relate a piece of information unknown to the rater, on the assumption that more traditional components of oral proficiency will contribute to time to completion. The test was administered to a sample of 86 first- (L1s) and second-language (L2s) speakers of English, and their task completion times were assigned an L1-referenced score. The data were analyzed via many-facet Rasch analysis. As hypothesized, the objective design of the test reduced rater effects, and raters could be excluded from the model. An examinee reliability coefficient of 0.88 was observed, surpassing that of most subjective tests of speaking proficiency.

  • Research Products

    (4 results)

All 2014 2013 Other

All Journal Article (1 results) Presentation (2 results) Remarks (1 results)

  • [Journal Article] Theoretical underpinnings of a computerized objective test of communicative competence in Japan. In V. Aryadoust & J. Fox (Eds.), Current Trends in Language Testing in the Pacific Rim and the Middle East : Policies, Analyses, and Diagnoses

    • Author(s)
      Batty, A. O., & Stewart, J.
    • Journal Title

      Cambridge Scholars Publishing

      Volume: (in press)

  • [Presentation] socially-fair and objective method of scoring communicative ability2014

    • Organizer
      the Language Testing Research Colloquium (LTRC)
    • Place of Presentation
      Amsterdam, Netherlands
    • Year and Date
      20140000
  • [Presentation] A more objective test of communicative competence in English : Establishing native speaker norms with MFRM2013

    • Author(s)
      Batty, A. O., & Stewart, J.
    • Organizer
      the Pacific Rim Objective Measurement Symposium (PROMS)
    • Place of Presentation
      Kaohsiung, Taiwan
    • Year and Date
      20130000
  • [Remarks] テストのソフトウェアのソースコードはGitHubで配布している。オープンソースである

    • URL

      https://github.com/aaronpropst/cst

URL: 

Published: 2015-06-25  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi