• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Developing a method of educational evaluation focused on a systematic error using subquestions

Research Project

Project/Area Number 26750068
Research Category

Grant-in-Aid for Young Scientists (B)

Allocation TypeMulti-year Fund
Research Field Science education
Research InstitutionYamagata University

Principal Investigator

YASUDA JUNICHIRO  山形大学, 基盤教育院, 准教授 (00402446)

Research Collaborator TANIGUCHI Masa-aki  名城大学, 教職センター, 准教授
Mae Naohiro  関西大学, 理工学教育開発センター, 特任教授
Hull Mike  Wayne State College, Department of Physical Sciences and Mathematics, Assistant Professor
Project Period (FY) 2014-04-01 – 2016-03-31
Project Status Completed (Fiscal Year 2015)
Budget Amount *help
¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Fiscal Year 2015: ¥650,000 (Direct Cost: ¥500,000、Indirect Cost: ¥150,000)
Fiscal Year 2014: ¥650,000 (Direct Cost: ¥500,000、Indirect Cost: ¥150,000)
Keywords学習評価 / 概念調査 / 教育評価 / 力学概念 / 妥当性評価 / 系統誤差 / 科学教育 / 物理教育研究 / Force concept inventory / 物理概念指標 / 物理教育 / 教育指標 / 力学概念調査
Outline of Final Research Achievements

In this study, we quantified the validity of FCI as a systematic error and analyzed its behavior. We focused on the false positives and used subquestions to judge whether a student understands the concept tested in an FCI question. The questions for which we created the subquestions are limited to the three invalid-like questions that, according to prior research, elicit false positives from students, and one of the remaining 27 valid-like questions. We used the results of the valid-like question and its subquestions to estimate the systematic error arising from the remaining 26 valid-like questions. Our results indicate that true score can be lower than half of raw score and true average normalized gain can be as low as half of raw average normalized gain, depending on the fitting function for the estimation. We also found that there are thresholds in the relationship between true positive ratio and raw score for the invalid-like questions, but not for the valid-like question.

Report

(3 results)
  • 2015 Annual Research Report   Final Research Report ( PDF )
  • 2014 Research-status Report
  • Research Products

    (6 results)

All 2016 2015 2014 Other

All Int'l Joint Research (1 results) Journal Article (1 results) (of which Peer Reviewed: 1 results,  Acknowledgement Compliant: 1 results) Presentation (4 results) (of which Int'l Joint Research: 1 results)

  • [Int'l Joint Research] Wayne State College(米国)

    • Related Report
      2015 Annual Research Report
  • [Journal Article] 部分設問群を用いた和訳版FCIの定量的な妥当性評価2014

    • Author(s)
      谷口正明、安田淳一郎
    • Journal Title

      物理教育

      Volume: 62 Pages: 226-231

    • NAID

      110009896270

    • Related Report
      2014 Research-status Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Presentation] 力学概念指標の偽正答に着目した系統的誤差分析2016

    • Author(s)
      安田淳一郎, 谷口正明, 前直弘, M.M.Hull
    • Organizer
      日本物理学会第71会年次大会
    • Place of Presentation
      東北学院大学
    • Year and Date
      2016-03-16
    • Related Report
      2015 Annual Research Report
  • [Presentation] Characteristics of a Systematic Error of the Force Concept Inventory2015

    • Author(s)
      J.Yasuda, M.Taniguchi and N.Mae
    • Organizer
      International Conference on Physics Education 2015
    • Place of Presentation
      Beijing Friendship Hotel, Beijing, China
    • Year and Date
      2015-08-10
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Subquestionsを用いたFCIの系統誤差分析2014

    • Author(s)
      安田淳一郎、谷口正明
    • Organizer
      日本物理学会2014年秋季大会
    • Place of Presentation
      中部大学
    • Year and Date
      2014-09-07
    • Related Report
      2014 Research-status Report
  • [Presentation] Analyzing A Systematic Error of the Force concept inventory with Sub-Question2014

    • Author(s)
      J.Yasuda and M.Taniguchi
    • Organizer
      International Conference on Physics Education 2014
    • Place of Presentation
      Dr. Cesar Carman Hotel, Argentina
    • Year and Date
      2014-08-21
    • Related Report
      2014 Research-status Report

URL: 

Published: 2014-04-04   Modified: 2022-01-27  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi