• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

An Objective Test of Communicative English Proficiency

Research Project

Project/Area Number 24652131
Research Category

Grant-in-Aid for Challenging Exploratory Research

Allocation TypeSingle-year Grants
Research Field Foreign language education
Research InstitutionKeio University

Principal Investigator

BATTY Aaron Olaf  慶應義塾大学, 環境情報学部, 講師 (80406686)

Co-Investigator(Kenkyū-buntansha) JEFFREY Stewart  九州産業大学, 語学教育研究センター, 講師 (40536306)
Project Period (FY) 2012-04-01 – 2014-03-31
Project Status Completed (Fiscal Year 2013)
Budget Amount *help
¥2,340,000 (Direct Cost: ¥1,800,000、Indirect Cost: ¥540,000)
Fiscal Year 2013: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Fiscal Year 2012: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Keywords学力検査 / 言語試験 / 英語教育 / スピーキング伝達能力
Research Abstract

The researchers developed a new test of communicative speaking proficiency, called the Objective Communicative Speaking Test (OCST). The OCST is a timed information-gap task-based test delivered via tablet computers. The OCST measures the time required for a speaker to relate a piece of information unknown to the rater, on the assumption that more traditional components of oral proficiency will contribute to time to completion. The test was administered to a sample of 86 first- (L1s) and second-language (L2s) speakers of English, and their task completion times were assigned an L1-referenced score. The data were analyzed via many-facet Rasch analysis. As hypothesized, the objective design of the test reduced rater effects, and raters could be excluded from the model. An examinee reliability coefficient of 0.88 was observed, surpassing that of most subjective tests of speaking proficiency.

Report

(3 results)
  • 2013 Annual Research Report   Final Research Report ( PDF )
  • 2012 Research-status Report
  • Research Products

    (7 results)

All 2014 2013 Other

All Journal Article (1 results) Presentation (4 results) Remarks (2 results)

  • [Journal Article] Theoretical underpinnings of a computerized objective test of communicative competence in Japan. In V. Aryadoust & J. Fox (Eds.), Current Trends in Language Testing in the Pacific Rim and the Middle East : Policies, Analyses, and Diagnoses

    • Author(s)
      Batty, A. O., & Stewart, J.
    • Journal Title

      Cambridge Scholars Publishing

      Volume: (in press)

    • Related Report
      2013 Final Research Report
  • [Presentation] socially-fair and objective method of scoring communicative ability2014

    • Organizer
      the Language Testing Research Colloquium (LTRC)
    • Place of Presentation
      Amsterdam, Netherlands
    • Related Report
      2013 Final Research Report
  • [Presentation] A socially fair scoring scale for communicative ability: A tablet-delivered test of objective communicative ability2014

    • Author(s)
      Batty, A. O. & Stewart, J
    • Organizer
      Language Testing Research Colloquium (LTRC) 2014
    • Place of Presentation
      Amsterdam, Netherlands
    • Related Report
      2013 Annual Research Report
  • [Presentation] A more objective test of communicative competence in English : Establishing native speaker norms with MFRM2013

    • Author(s)
      Batty, A. O., & Stewart, J.
    • Organizer
      the Pacific Rim Objective Measurement Symposium (PROMS)
    • Place of Presentation
      Kaohsiung, Taiwan
    • Related Report
      2013 Final Research Report
  • [Presentation] A more objective test of communicative competence in English: Establishing native speaker norms with MFRM2013

    • Author(s)
      Batty, A. O. & Stewart, J
    • Organizer
      Pacific Rim Objective Measurement Symposium (PROMS) 2013
    • Place of Presentation
      Kaohsiung, Taiwan
    • Related Report
      2013 Annual Research Report
  • [Remarks] テストのソフトウェアのソースコードはGitHubで配布している。オープンソースである

    • URL

      https://github.com/aaronpropst/cst

    • Related Report
      2013 Final Research Report
  • [Remarks] Communicative Speaking Test

    • URL

      https://github.com/aaronpropst/cst

    • Related Report
      2013 Annual Research Report

URL: 

Published: 2013-05-31   Modified: 2019-07-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi