• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Developing test items for cognitive diagnosis: With achievement level descriptors and students' errors

Research Project

Project/Area Number 19K21018
Project/Area Number (Other) 18H05826 (2018)
Research Category

Grant-in-Aid for Research Activity Start-up

Allocation TypeMulti-year Fund (2019)
Single-year Grants (2018)
Review Section 0110:Psychology and related fields
Research InstitutionThe National Center for University Entrance Examinations

Principal Investigator

Terao Takahiro  独立行政法人大学入試センター, 研究開発部, 助教 (70827055)

Project Period (FY) 2018-08-24 – 2020-03-31
Project Status Completed (Fiscal Year 2019)
Budget Amount *help
¥2,860,000 (Direct Cost: ¥2,200,000、Indirect Cost: ¥660,000)
Fiscal Year 2019: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Fiscal Year 2018: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Keywords項目作成 / 受験者の誤答 / 学力の達成度を表す記述文 / 誤答選択肢 / 教育測定 / 誤答 / 試験問題の作成 / 試験問題作成 / 英語文章読解能力 / 学力達成度を表す記述文 / 学力診断 / 受検者の誤答 / 証拠中心デザイン
Outline of Research at the Start

本研究の目的は,学力達成度を表す記述文と多くの受験者に見られる誤答の特徴を対応づけて試験問題を作成し,学力診断のための試験問題が満たすべき条件について知見を得ることである。研究1では,新学習指導要領を基に学力達成度を表す記述文を作成し,これに1対1対応する記述式問題の解答から受験者に見られる誤答の特徴を把握する。研究2では,学力達成度を表す記述文に1対1対応する多肢選択式問題を高校生に実施し,学力達成度を表す記述文と誤答の特徴を対応づける。研究3では,学力達成度を表す記述文に1 対1対応する多肢選択式問題において,受験者の学習のつまずきを捉えるのに適した誤答選択肢の組み合わせについて検討する。

Outline of Final Research Achievements

This study aimed to investigate the features that were relevant to students' cognitive processes and affected difficulty of test items, for the development of cognitive test items. The study identified such factors based on the information processing model in cognitive psychology, manipulated them in experimental test items, and checked whether these factors certainly influenced on the difficulty of test items. The result showed that some characteristics reflected in distractors had an enormous impact on item difficulty, rather than item formats.

Academic Significance and Societal Importance of the Research Achievements

本研究の学術的意義は,試験問題の作成にあたって,測定したい学力に関連した認知プロセスの中に含まれている要因の操作によって,確かに受験者に求める学力水準が影響を受け,試験問題の難易度の高低が変動していたことを示したことである。この結果は,測定したい学力が試験問題の要求する能力水準に写し取られていたことの証拠として機能し,測定の妥当性(validity)の高さを示している。試験問題が要求する能力水準を実証的に検討した事例を提供したとともに,学力の達成度を表す記述文の作成にも活用できる知見である。

Report

(3 results)
  • 2019 Annual Research Report   Final Research Report ( PDF )
  • 2018 Annual Research Report
  • Research Products

    (11 results)

All 2020 2019 2018

All Journal Article (4 results) (of which Int'l Joint Research: 2 results,  Peer Reviewed: 4 results,  Open Access: 4 results) Presentation (7 results) (of which Int'l Joint Research: 3 results,  Invited: 1 results)

  • [Journal Article] Difficulty of Summarization Items for Japanese Learners: Effects of Passages, Distractors, and Response Formats2020

    • Author(s)
      Terao Takahiro
    • Journal Title

      Frontiers in Education: Assessment, Testing and Applied Measurement

      Volume: 5 Pages: 1-15

    • DOI

      10.3389/feduc.2020.00009

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] A comparison of distractor selection among proficiency levels in reading tests: A focus on summarization processes in Japanese EFL learners2020

    • Author(s)
      Terao,T., & Ishii,H.
    • Journal Title

      SAGE Open

      Volume: 10 Issue: 1 Pages: 1-14

    • DOI

      10.1177/2158244020902087

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] 英語文章要約パターンの教育測定学的検討 -削除・一般化・統合のプロセスに着目してー2019

    • Author(s)
      寺尾尚大・石井秀宗
    • Journal Title

      日本テスト学会誌

      Volume: 15 Pages: 59-78

    • NAID

      130007691326

    • Related Report
      2019 Annual Research Report 2018 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Roles of articulatory movements and speech feedback in Japanese text comprehension during oral reading2019

    • Author(s)
      Terao Takahiro、Takahashi Maiko、Kiyokawa Sachiko
    • Journal Title

      The Japanese journal of psychology

      Volume: 89 Issue: 6 Pages: 618-624

    • DOI

      10.4992/jjpsy.89.17312

    • NAID

      130007604298

    • ISSN
      0021-5236, 1884-1082
    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access
  • [Presentation] An Investigation of Item Difficulty for Multiple-Texts Reading Skills2020

    • Author(s)
      Takahiro Terao
    • Organizer
      Paper presented in the annual meeting of the National Council on Measurement in Education
    • Related Report
      2019 Annual Research Report
  • [Presentation] Analyses of distractors in English summarizing test items: Focusing on cognitive processes2019

    • Author(s)
      Takahiro Terao, Hidetoki Ishii
    • Organizer
      Paper presented in the annual meeting of the National Council on Measurement in Education
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] CBT・CATとは何か2019

    • Author(s)
      寺尾尚大
    • Organizer
      日本テスト学会 第17回大会シンポジウム
    • Related Report
      2019 Annual Research Report
    • Invited
  • [Presentation] 複数文章を読解する項目における困難度の規定因の検討2019

    • Author(s)
      寺尾尚大
    • Organizer
      日本教育心理学会 第61回大会
    • Related Report
      2019 Annual Research Report
  • [Presentation] Analyses of distractors in English summarizing test items: Focusing on cognitive processes2019

    • Author(s)
      Takahiro Terao, and Hidetoki Ishii
    • Organizer
      The National Council on Measurement in Education
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Typical Errors in English Summarizing Items for L2 Learners2018

    • Author(s)
      Takahiro Terao, and Hidetoki Ishii
    • Organizer
      The National Council on Measurement in Education
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 英語文章の要点を把握する問題における錯乱枝の選択率 ――能力群別にみた実証的検討――2018

    • Author(s)
      寺尾尚大・石井秀宗
    • Organizer
      日本テスト学会第16回大会
    • Related Report
      2018 Annual Research Report

URL: 

Published: 2018-08-27   Modified: 2024-03-26  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi