• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Developing a Computerized Multistage Test with the Force Concept Inventory

Research Project

Project/Area Number 19K03135
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Review Section Basic Section 09080:Science education-related
Research InstitutionYamagata University

Principal Investigator

YASUDA Jun-ichiro  山形大学, 学士課程基盤教育院, 准教授 (00402446)

Co-Investigator(Kenkyū-buntansha) 前 直弘  大阪大学, 核物理研究センター, 協同研究員 (10796098)
谷口 正明  名城大学, その他部局等, 教授 (90554113)
Project Period (FY) 2019-04-01 – 2023-03-31
Project Status Completed (Fiscal Year 2022)
Budget Amount *help
¥4,290,000 (Direct Cost: ¥3,300,000、Indirect Cost: ¥990,000)
Fiscal Year 2021: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2020: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Fiscal Year 2019: ¥1,820,000 (Direct Cost: ¥1,400,000、Indirect Cost: ¥420,000)
Keywords物理教育研究 / 科学教育 / 教育評価 / 学習評価 / テスト理論 / 項目反応理論 / コンピューター適応型テスト / コンピュータ適応型テスト
Outline of Research at the Start

本研究では,学習者の力学概念の理解度を精確かつ効率的に測定するための評価テストを開発し,その国際的通用性を検証することを目的とする。開発する評価テストの土台として,国際的に普及している力学概念指標(FCI)を用いる。テストの精度を高めるため,研究代表者らが独自に開発してきた部分設問群の方法を用いる。またテストの効率性を高めるため,つまりテストの解答時間を短縮するため,コンピュータ適応型テスト(CAT)の発展型であるマルチステージテスト(MST)を用いる。開発の第1段階ではFCIを組み込んだCATを開発し,第2段階ではFCIとその部分設問群を組み込んだMSTを開発する。

Outline of Final Research Achievements

The two main results of this research project are as follows.
(1) We developed computerized adaptive testing (CAT) using the Force Concept Inventory (FCI). Using simulations, we found, that for a class size of 40, we may reduce the test length of the FCI-CAT to 15-19 items (the full-length FCI has 30 items) with an accompanying decrease in accuracy and precision of only 5-10%.
(2) We improved the algorithm of the FCI-CAT to increase the efficiency and security of the test. The simulation analysis revealed that we can achieve the accuracy and precision of the full-length FCI with fewer items via the FCI-CAT. Specifically, for a class size of 40, we can reduce the sum of the pre- and post-test lengths of the FCI-CAT to a total of 29 items, thereby reducing the testing time to 55%. We also found that if one desires a balance of test efficiency and security, choosing equal pre- and post-test lengths would be reasonable.

Academic Significance and Societal Importance of the Research Achievements

本研究の成果により,コンピューター適応型テストを利用することで,力学概念指標(FCI)の実施に要する時間を約30分から約15分まで短縮できることが明らかになった。これにより,これまで調査に費やされていた授業時間を学習時間に充てることが可能になる。また,これまで時間的な制限からFCI調査を授業中に実施することを躊躇っていた教員にとっては,実施を後押しすることが期待できる。以上のように,本研究で開発されたFCI-CATは学習評価に係わる負担を軽減することにより,評価の普及を促進するものである。

Report

(5 results)
  • 2022 Annual Research Report   Final Research Report ( PDF )
  • 2021 Research-status Report
  • 2020 Research-status Report
  • 2019 Research-status Report
  • Research Products

    (22 results)

All 2023 2022 2021 2020 2019 Other

All Int'l Joint Research (4 results) Journal Article (5 results) (of which Int'l Joint Research: 5 results,  Peer Reviewed: 5 results,  Open Access: 5 results) Presentation (12 results) (of which Int'l Joint Research: 3 results,  Invited: 3 results) Funded Workshop (1 results)

  • [Int'l Joint Research] アラスカ大学フェアバンクス校(米国)

    • Related Report
      2022 Annual Research Report
  • [Int'l Joint Research] ウィーン大学(オーストリア)

    • Related Report
      2021 Research-status Report
  • [Int'l Joint Research] ウィーン大学(オーストリア)

    • Related Report
      2020 Research-status Report
  • [Int'l Joint Research] ウィーン大学(オーストリア)

    • Related Report
      2019 Research-status Report
  • [Journal Article] Improving test security and efficiency of computerized adaptive testing for the Force Concept Inventory2022

    • Author(s)
      Yasuda Jun-ichiro, Hull Michael M., Mae Naohiro
    • Journal Title

      Physical Review Physics Education Research

      Volume: 18 Issue: 1

    • DOI

      10.1103/physrevphyseducres.18.010112

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Balancing content of computerized adaptive testing for the Force Concept Inventory2021

    • Author(s)
      Yasuda Jun-ichiro, Hull Michael M.
    • Journal Title

      PERC Proceedings

      Volume: 2021 Pages: 456-461

    • DOI

      10.1119/perc.2021.pr.yasuda

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Analysis to Develop Computerized Adaptive Testing with the Force Concept Inventory2021

    • Author(s)
      Yasuda Jun-ichiro, Mae Naohiro, Hull Michael M., Taniguchi Masa-aki
    • Journal Title

      Journal of Physics: Conference Series

      Volume: 1929 Issue: 1 Pages: 012009-012009

    • DOI

      10.1088/1742-6596/1929/1/012009

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Optimizing the length of computerized adaptive testing for the Force Concept Inventory2021

    • Author(s)
      Jun-ichiro Yasuda , Naohiro Mae, Michael M. Hull, Masa-aki Taniguchi
    • Journal Title

      Physical Review Physics Education Research

      Volume: 17 Issue: 1

    • DOI

      10.1103/physrevphyseducres.17.010115

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Analysis to Develop Computerized Adaptive Testing with the Force Concept Inventory2020

    • Author(s)
      Jun-ichiro Yasuda, N. MAE, M. M. Hull, M. Taniguchi
    • Journal Title

      Journal of Physics: Conference Series

      Volume: -

    • Related Report
      2019 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Presentation] コンピューター適応型テストによる学習成果の可視化:理論と活用2023

    • Author(s)
      安田 淳一郎
    • Organizer
      九州大学 基幹教育院 粒子系理論物理学研究室セミナー
    • Related Report
      2022 Annual Research Report
    • Invited
  • [Presentation] Optimizing the length of computerized adaptive testing for the Force Concept Inventory2023

    • Author(s)
      Jun-ichiro Yasuda
    • Organizer
      University of Alaska Fairbanks, Spring 2023 Journal Club
    • Related Report
      2022 Annual Research Report
    • Invited
  • [Presentation] 沖積図と部分設問群を用いた力学概念理解の系統的分析2023

    • Author(s)
      安田 淳一郎
    • Organizer
      日本物理学会 2023年春季大会
    • Related Report
      2022 Annual Research Report
  • [Presentation] 力学概念指標を用いたコンピュータ適応型テストの開発 IV2022

    • Author(s)
      安田 淳一郎
    • Organizer
      日本物理学会 2022年秋季大会
    • Related Report
      2022 Annual Research Report
  • [Presentation] Balancing content of computerized adaptive testing for the Force Concept Inventory2021

    • Author(s)
      Yasuda Jun-ichiro, Hull Michael M.
    • Organizer
      Physics Education Research Conference 2021
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Optimizing the length of computerized adaptive testing for the Force Concept Inventory2021

    • Author(s)
      Yasuda Jun-ichiro
    • Organizer
      2021 AAPT Virtual Summer Meeting
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Optimizing the length of computerized adaptive testing for the Force Concept Inventory2021

    • Author(s)
      Yasuda Jun-ichiro
    • Organizer
      Austrian Educational Competence Center, University of Vienna, 520001 SE Design Based Research-new developments (Online)
    • Related Report
      2021 Research-status Report
    • Invited
  • [Presentation] 力学概念指標を用いたコンピュータ適応型テストの開発III2021

    • Author(s)
      安田淳一郎, 前直弘, M.M.Hull, 谷口正明
    • Organizer
      日本物理学会第76回年次大会
    • Related Report
      2020 Research-status Report
  • [Presentation] 力学概念指標を用いたコンピュータ適応型テストの開発II2020

    • Author(s)
      安田淳一郎, 前直弘, M.M.Hull, 谷口正明
    • Organizer
      日本物理学会2020年秋季大会
    • Related Report
      2020 Research-status Report
  • [Presentation] 力学概念指標を用いたコンピュータ適応型テストの開発2019

    • Author(s)
      安田 淳一郎,前 直弘,Michael Hull,谷口 正明
    • Organizer
      日本物理学会 2019年 秋季大会
    • Related Report
      2019 Research-status Report
  • [Presentation] 力学概念指標を用いたコンピュータ適応型テストの開発2019

    • Author(s)
      安田 淳一郎,前 直弘,Michael Hull,谷口 正明
    • Organizer
      第36回物理教育研究大会
    • Related Report
      2019 Research-status Report
  • [Presentation] Analysis to Develop Computerized Adaptive Testing with the Force Concept Inventory2019

    • Author(s)
      Jun-ichiro Yasuda, N. MAE, M. M. Hull, M. Taniguchi
    • Organizer
      GIREP-ICPE-EPEC-MPTL 2019
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Funded Workshop] FCI-CAT Winter Meeting2019

    • Related Report
      2019 Research-status Report

URL: 

Published: 2019-04-18   Modified: 2024-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi