• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Studies concerning the optimization of rating scales in the English section of a national university's entrance examination

Research Project

Project/Area Number 17520371
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field Foreign language education
Research InstitutionTokyo University of Agriculture and Technology

Principal Investigator

CHRIS Weaver  Tokyo University of Agriculture and Technology, Head Quarter, Foreign Instructor of English, 本部, 外国人教師 (50345336)

Co-Investigator(Kenkyū-buntansha) SATO Yoko  Tokyo University of Agriculture and Technology, Institute of Symbiotic Science and Technology, Professor, 大学院共生科学技術研究院, 教授 (30162499)
ROMANKO Rick  Tokyo University of Agriculture and Technology, Head Quarter, Foreign Instructor of English, 本部, 外国人教師 (60345337)
FUNAKURA Masanori  Tokyo University of Agriculture and Technology, Institute of Symbiotic Science and Technology, Professor, 大学院共生科学技術研究院, 教授 (60040507)
Project Period (FY) 2005 – 2006
Project Status Completed (Fiscal Year 2006)
Budget Amount *help
¥2,400,000 (Direct Cost: ¥2,400,000)
Fiscal Year 2006: ¥900,000 (Direct Cost: ¥900,000)
Fiscal Year 2005: ¥1,500,000 (Direct Cost: ¥1,500,000)
Keywordsrating scales / entrance examination / Rasch measurement theory / item difficulty / item demands / item targeting / cut-point targeting / readability indexes / 読みやすさ指数 / 英語学力検査 / ラッシュ分析 / 最適化 / カテゴリー / 信頼性 / 感度
Research Abstract

This two year intensive investigation examined the use of rating scales in the English section of Tokyo University of Agriculture and Technology's entrance examination. This research project has many facets, which are organized around three themes. The first theme involved an in depth analysis of rating scale performances. With the use of Rasch measurement theory, this investigation identified not only what types of rating scales needed improvement, but also provided insights leading to improved rating scale performances. The most significant finding arising from the first research theme is the importance of maximizing the compatibility between rating scales and the demands of test items. The second research theme of this research project involved an investigation into the interaction occurring between rating scales and different types of test items used in the English section of the university entrance examination over a four year period. This type of analysis provided numerous insights into how rating scales performance underlies many important aspects of the overall performance of the entrance examination. Another related investigation found that the difficulty of the items used with the different reading passages, which are based upon the use of different types of rating scales, had no relation to the readability estimates and the vocabulary level of the texts. The third theme of this research project looks ahead and explains the full extent to which rating scales can be utilized by administrators, test writers, curriculum designers, and teachers to gain vital information concerning test takers.

Report

(3 results)
  • 2006 Annual Research Report   Final Research Report Summary
  • 2005 Annual Research Report
  • Research Products

    (20 results)

All 2007 2006 2005

All Journal Article (20 results)

  • [Journal Article] 受験者の英語コミュニケーション能力識別のための評価尺度について「分析例」-ラッシュ・モデルが期待する評価尺度のパフォーマンス2007

    • Author(s)
      ウィーバー, C., 佐藤容子
    • Journal Title

      大学入試研究ジャーナル 17(印刷中)

      Pages: 135-142

    • NAID

      40016081019

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Jukensha no eigo-communication-noryoku-shikibetsu no tameno hyouka-shakudo ni tsuite 'bunsekirei'-Rasch model ga kitaisuru hyouka-shakudo no performance [The use of rating scales to differentiate test takers' English communicative competence : an analysis-the Rasch model expectations of a well performing rating scale](in Japanese)2007

    • Author(s)
      Weaver, C., Sato, Y.
    • Journal Title

      Daigaku Nyushi Kenkyu Journal [Journal of studies on university entrance examinations] 17

      Pages: 135-142

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] 受験者の英語コミュニケーション能力識別のための評価尺度について 「分析例」-ラッシュ・モデルが期待する評価尺度のパフォーマンス-2007

    • Author(s)
      ウィーバー, C., 佐藤容子
    • Journal Title

      大学入試研究ジャーナル 17号(印刷中)

      Pages: 135-142

    • NAID

      40016081019

    • Related Report
      2006 Annual Research Report
  • [Journal Article] 受験者の英語コミュニケーション能力識別のための評価尺度について-ラッシュ・モデルが期待する評価尺度のパフォーマンス2006

    • Author(s)
      ウィーバー, C., 佐藤容子
    • Journal Title

      全国大学入学者選抜研究連絡協議会第1回大会研究発表予稿集

      Pages: 153-158

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Annual Research Report 2006 Final Research Report Summary
  • [Journal Article] How university entrance examination scores can inform more than just admission decisions2006

    • Author(s)
      Weaver, C.
    • Journal Title

      Pan-SIG 2005 Conference Proceedings

      Pages: 114-121

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] 受験者の英語コミュニケーション能力の多面的評価に向けて-分析例2006

    • Author(s)
      ウィーバー, C., 佐藤容子
    • Journal Title

      大学入試研究ジャーナル 16

      Pages: 125-132

    • NAID

      40015320342

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Evaluating the use of rating scales in a high-stakes Japanese university entrance examination2006

    • Author(s)
      Weaver, C.
    • Journal Title

      Spaan Fellow Working Papers in Second or Foreign Language Assessment Vol.4

      Pages: 57-79

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Jukensha no eigo-communication-noryoku-shikibetsu no tameno hyouka-shakudo ni tsuite-Rasch model ga kitaisuru hyouka-shakudo no performance [The use of rating scales to differentiate test taker's English communicative competence : the Rasch model expectations of a well performing rating scale](in Japanese)2006

    • Author(s)
      Weaver, C., Sato, Y.
    • Journal Title

      Proceedings for the 1st national conference on the studies of university entrance examinations, Japanese university association

      Pages: 153-158

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Jukensha no eigo-communication-noryoku no tamenteki-hyouka ni mukete - bunseki-rei [A multiple dimensional approach to assessing test-takers' level of communicative competence : an analysis](in Japanese)2006

    • Author(s)
      Weaver, C., Sato, Y.
    • Journal Title

      Daigaku Nyushi Kenkyu Journal [Journal of studies on university entrance examinations] 16

      Pages: 125-132

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] How university entrance examination scores can inform more than just admission decisions2006

    • Author(s)
      Weaver, C
    • Journal Title

      Pan-SIG 2005 Conference Proceedings

      Pages: 114-121

    • Related Report
      2006 Annual Research Report
  • [Journal Article] 受験者の英語コミュニケーション能力の多面的評価向けて-分析例2006

    • Author(s)
      ウィーバー, C., 佐藤容子
    • Journal Title

      大学入試研究ジャーナル 16号

      Pages: 125-132

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Evaluating the use of rating scales in a high-stakes Japanese university entrance examination2006

    • Author(s)
      Weaver, C
    • Journal Title

      Spaan Fellow Working Papers in Second or Foreign Language Assessment Vol.4

      Pages: 57-79

    • Related Report
      2006 Annual Research Report
  • [Journal Article] 受験者の英語コミュニケーション能力の多面的評価に向けて-分析例2006

    • Author(s)
      ウィーバー, C., 佐藤容子
    • Journal Title

      大学入試研究ジャーナル 16号(印刷中)

    • NAID

      40015320342

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Evaluating the use of rating scales in a high-stakes Japanese university entrance examination2006

    • Author(s)
      Weaver, C.
    • Journal Title

      Spaan Fellow Working Papers in Second or Foreign Language Assessment (印刷中)

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 受験者の英語コミュニケーション能力識別のための評価尺度について-ラッシュ・モデルが期待する評価尺度のパフォーマンス2006

    • Author(s)
      ウィーバー, C., 佐藤容子
    • Journal Title

      国立大学入学者選抜研究連絡協議会第27回大会研究発表予稿集 (印刷中)

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 個別学力検査(英語)のラッシュ分析2005

    • Author(s)
      ウィーバー, C., 佐藤容子
    • Journal Title

      大学入試研究ジャーナル 15

      Pages: 147-153

    • NAID

      40006780782

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] 受験者の英語コミュニケーション能力の多面的評価に向けて2005

    • Author(s)
      ウィーバー, C., 佐藤容子
    • Journal Title

      国立大学入学者選抜研究連絡協議会第26回大会研究発表予稿集

      Pages: 139-145

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary 2005 Annual Research Report
  • [Journal Article] Kobetsu-gakuryoku-kensa (eigo) no Rasch bunseki [A Rasch analysis of the English section of a university entrance examination](in Japanese)2005

    • Author(s)
      Weaver, C., Sato, Y.
    • Journal Title

      Daigaku Nyushi Kenkyu Journal [Journal of studies on university entrance examinations] 15

      Pages: 147-153

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Jukensha no eigo-communication-noryoku no tamenteki-hyouka ni mukete [A multiple dimensional approach to assessing test-takers' level of communicative competence](in Japanese)2005

    • Author(s)
      Weaver, C., Sato, Y.
    • Journal Title

      Proceedings for the 26th conference on the studies of university entrance examinations, Japanese national university association

      Pages: 139-145

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] 個別学力検査(英語)のラッシュ分析2005

    • Author(s)
      ウィーバー, C., 佐藤容子
    • Journal Title

      大学入試研究ジャーナル 15号

      Pages: 147-153

    • NAID

      40006780782

    • Related Report
      2005 Annual Research Report

URL: 

Published: 2005-04-01   Modified: 2021-04-07  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi