• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Development of a small-scale multi-stage English proficiency test based on open sources

Research Project

Project/Area Number 16K02987
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Research Field Foreign language education
Research InstitutionNiigata Seiryou University

Principal Investigator

Kimura Tetsuo  新潟青陵大学, 福祉心理学部, 教授 (90249095)

Project Period (FY) 2016-04-01 – 2020-03-31
Project Status Completed (Fiscal Year 2019)
Budget Amount *help
¥4,420,000 (Direct Cost: ¥3,400,000、Indirect Cost: ¥1,020,000)
Fiscal Year 2018: ¥910,000 (Direct Cost: ¥700,000、Indirect Cost: ¥210,000)
Fiscal Year 2017: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Fiscal Year 2016: ¥1,950,000 (Direct Cost: ¥1,500,000、Indirect Cost: ¥450,000)
Keywordsコンピュータ適応型テスト / マルチステージテスト / オープンソース / 学習管理システム / コーパス分析 / コンテンツ・バランス / 受験者の心理的側面 / インタビュー / ルーティング・アルコリズム / コンピュータ・アダプティブ・テスト
Outline of Final Research Achievements

To manage the content balance, we developed a multi-stage test (MST) on Moodle, an open-source learning management system (LMS). It was confirmed that a MST can be implemented on a small scale. We confirmed through a pilot test and interview survey that test-takers tend to choose "tests with many questions but easy questions" rather than "tests with few questions but difficult questions," and we also verified the routing algorithm based on actual data.

Academic Significance and Societal Importance of the Research Achievements

テストのコンテンツ・バランスの管理は,テストの妥当性に深く影響を与える重要な問題であるが,本研究が示した複数の設問を束ねていくつかの段階を踏むMSTは、従来の単問形式のCATよりも,コンテツ・バランスの管理が容易であり,小規模でも既存のアイテムバンクがあれば実現可能であることを示した。本研究のテスト項目は,コーパス分析に基づく英語の語彙に関する設問であるが,本研究により開発されるMSTのシステムが,オープンソースで提供・公開されることは,外国語教育のみならず,多様な分野の教育評価にとっても,その意義は大きい。

Report

(5 results)
  • 2019 Annual Research Report   Final Research Report ( PDF )
  • 2018 Research-status Report
  • 2017 Research-status Report
  • 2016 Research-status Report
  • Research Products

    (12 results)

All 2019 2018 2017 2016

All Journal Article (5 results) (of which Peer Reviewed: 1 results,  Open Access: 1 results,  Acknowledgement Compliant: 2 results) Presentation (7 results) (of which Int'l Joint Research: 4 results)

  • [Journal Article] 小規模多段階コンピュータ適応型テストの検証: 受験者へのインタビューからの一考察2019

    • Author(s)
      木村哲夫
    • Journal Title

      統計数理研究所共同研究リポート

      Volume: 382 Pages: 1-8

    • Related Report
      2018 Research-status Report
  • [Journal Article] Shorter Tests with More Difficult Questions, or Longer Tests with Easier Questions: Which Do Test Takers Prefer?2018

    • Author(s)
      Kimura, T.
    • Journal Title

      EDULEARN18 Proceedings

      Volume: 18 Pages: 3840-3844

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] 小規模多段階テストにおけるルーティンク・アルゴリズムの実データによる検証2018

    • Author(s)
      木村哲夫
    • Journal Title

      統計数理研究所共同研究リポート

      Volume: 397 Pages: 45-56

    • Related Report
      2017 Research-status Report
  • [Journal Article] 受験者が目標正答確率を選ぶ多段階コンピュータ適応型テスト2017

    • Author(s)
      木村哲夫
    • Journal Title

      統計数理研究所共同研究リポート

      Volume: 338 Pages: 1-16

    • Related Report
      2016 Research-status Report
    • Acknowledgement Compliant
  • [Journal Article] RaschモデルによるMoodle小規模CATの改良2016

    • Author(s)
      木村哲夫・大西 昭夫・永岡 慶三
    • Journal Title

      JSET32講演論文集

      Volume: 32 Pages: 795-796

    • Related Report
      2016 Research-status Report
    • Acknowledgement Compliant
  • [Presentation] 小規模多段階コンピュータ適応型テストの検証2019

    • Author(s)
      木村哲夫
    • Organizer
      統計数理研究所言語系共同研究グループ夏季合同発表会
    • Related Report
      2019 Annual Research Report
  • [Presentation] Shorter tests with more difficult questions, or longer tests with easier questions: which do test takers prefer?2018

    • Author(s)
      Tetsuo Kimura
    • Organizer
      IATED 10th International Conference on Education and New Learning Technologies
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] 受験者が目標正答確率を選ぶ多段階コンピュータ適応型テスト2017

    • Author(s)
      木村哲夫
    • Organizer
      言語研究と統計2017
    • Place of Presentation
      統計数理研究所
    • Year and Date
      2017-03-27
    • Related Report
      2016 Research-status Report
  • [Presentation] Test-takers' Psychological Aspects in Case of Computerized Adaptive Testing.2017

    • Author(s)
      Kimura, T. & Koyama, Y.
    • Organizer
      The Applied Linguistics Conference 2017
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] RaschモデルによるMoodle小規模CATの改良2016

    • Author(s)
      木村哲夫・大西 昭夫・永岡 慶三
    • Organizer
      日本教育工学会
    • Place of Presentation
      大阪大学豊中キャンパス
    • Year and Date
      2016-09-17
    • Related Report
      2016 Research-status Report
  • [Presentation] Psychological aspects of computer adaptive testing: Loss of learning self-efficacy and motivation.2016

    • Author(s)
      Tetsuo Kimura & Yukie Koyama
    • Organizer
      Individuals in Contexts -- Psychology of Language Learning 2
    • Place of Presentation
      Finland
    • Year and Date
      2016-08-22
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] Manipulation of target probability of computer adaptive tests.2016

    • Author(s)
      Tetsuo Kimura
    • Organizer
      Pacific Rim Objective Measurement Symposium 2016
    • Place of Presentation
      Xi’an, China
    • Year and Date
      2016-08-01
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research

URL: 

Published: 2016-04-21   Modified: 2021-02-19  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi