• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Developing techniques for constructing and maintaining an item pool

Research Project

Project/Area Number 15300290
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Educational technology
Research InstitutionThe Institute of Statistical Mathematics

Principal Investigator

YANAGIMOTO Takemi  The Institute of Statistical Mathematics, Department of Data Science, Professor, データ科学研究系, 教授 (40000195)

Co-Investigator(Kenkyū-buntansha) MAEDA Tadahiko  The Institute of Statistical Mathematics, Department of Data Science, Assoc. Professor, データ科学研究系, 助教授 (10247257)
OHNISHI Toshio  The Institute of Statistical Mathematics, Department of Data Science, Assist. Professors, データ科学研究系, 助手 (60353413)
MAYEKAWA Shin-ichi  Tokyo Institute of Technology, Graduate School of Decision Science and Technology / Human System Science, Professor, 大学院・社会理工学研究科, 教授 (70190288)
NITTA Yoshio  Tokyo Medical and Dental University, Center for Education Research in Medicine and Dentistry, Assoc. Professor, MDセンター, 助教授 (10114315)
FUKUSHIMA Osamu  The Jikei University, School of Medicine, Professor, 医学部, 教授 (60173332)
吉田 素文  東京医科歯科大学, MDセンター, 助教授 (00291518)
Project Period (FY) 2003 – 2005
Project Status Completed (Fiscal Year 2005)
Budget Amount *help
¥9,400,000 (Direct Cost: ¥9,400,000)
Fiscal Year 2005: ¥1,100,000 (Direct Cost: ¥1,100,000)
Fiscal Year 2004: ¥3,200,000 (Direct Cost: ¥3,200,000)
Fiscal Year 2003: ¥5,100,000 (Direct Cost: ¥5,100,000)
KeywordsCBT / Design science / OSCE / LSAT / Common Achievement Test / Intelligence-based sampling / 設計科学 / Hyperbola分布
Research Abstract

Under tight coordination the three groups, consisting of biostatisticians, psychometricians and medical educators, conducted the present research. The primary aim of the present research is to develop quantitative techniques for constructing and maintaining an item pool. Special efforts are placed on improving the ongoing the computer based testing (CBT) of the Common Achievement Test. Intensive contacts with this actual project make this research practical. This CBT is really a breakthrough in a huge number of ongoing testings. It is one of most challenging educational tests in the world.
The result of trials are analyzed in terms of the standard item response theory. This analysis is helpful for preparing inclusion-exclusion criteria of items tested in the trials. Further it suggests various important subjects to be studied. One of them is to justify why an item pool is necessary for evaluating adequately knowledges regarding a specified academic field of an student. This allows us ri … More gid scientific bases of educational testings and also flexible operation of nation-wide testing. On the other hand, various difficulties give rise to, which include validity of items, a huge number of items in a pool, quantitative evaluation of item characteristics. Another important problem is how we obtain reliable quantitative item parameters in a item pool. In addition to analytical techniques we emphasized the need for a well designed pre-operation based on the item response theory. The necessity is in principle widely accepted among researchers but practical implementation, together with its actual use, has not been attempted. Fortunately, the Board of the Common Achievement Test accepted our propose. Probably this is the first trial in large-scaled testings. The result will be useful for evaluating item parameters, especially when the general time trend will be suspected. Sampling techniques are rapidly developing though Bayesian analysis. They are expected to be useful in balancing various aspects of items selected to a particular examinee. A small size survey regarding opinions and impressions of examinees was conducted. The results call our attention to unexpected unclear descriptions remained in items. More importantly, they suggest how examinees participate the CBT as an important stakeholder. Such a view was completely discarded in the existing testings.
In addition to the above project, we participate other important projects. One of them is OSCE by the Common Achievement Testing. The others include LSAT and the CBT for nurse students. These projects make the present research useful in practice, and we can expect possible contributions on future educational tests. Less

Report

(4 results)
  • 2005 Annual Research Report   Final Research Report Summary
  • 2004 Annual Research Report
  • 2003 Annual Research Report
  • Research Products

    (27 results)

All 2006 2005 2004 2003 Other

All Journal Article (21 results) Publications (6 results)

  • [Journal Article] 法科大学院統一適正試験の妥当性検討のための分析方法2006

    • Author(s)
      前田 忠彦
    • Journal Title

      法化大学院統一適正試験2005 (印刷中)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] 法科大学院統一適正試験のDIF分析2006

    • Author(s)
      前田忠彦, 野口裕之
    • Journal Title

      法化大学院統一適正試験2005 (印刷中)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Analysis of the questionarre for nationwide common achievement test system for entering clinical clerkship in Japan (in Japanese).2006

    • Author(s)
      Nara, N., Abe, T, Takamatsu, K, Nitta, Y, Fukushima, O., Morita, T.
    • Journal Title

      Medical Education 37

      Pages: 3-7

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] 法科大学院統一適性試験の妥当性検討のための分析方法2006

    • Author(s)
      前田 忠彦
    • Journal Title

      法科大学院統一適性試験2005 (印刷中)

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 法科大学院統一適性試験のDIF分析2006

    • Author(s)
      前田忠彦, 野口裕之
    • Journal Title

      法科大学院統一適性試験2005 (印刷中)

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 医療を支える科学的証拠の収集と評価2005

    • Author(s)
      柳本 武美
    • Journal Title

      科学 75巻

      Pages: 598-603

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Annual Research Report 2005 Final Research Report Summary
  • [Journal Article] Extensions of the Confugate Prior Through the Kullback-Leibler Separators2005

    • Author(s)
      Yanagimoto, T., Ohnishi, T.
    • Journal Title

      J. Mult. Anal. 92巻

      Pages: 116-133

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] 因子スコアや潜在変数得点を用いた構造方程式モデルの母数推定の偏りの解決2005

    • Author(s)
      光永悠彦, 星野崇宏, 繁桝算男, 前川眞一
    • Journal Title

      行動計量学 32巻

      Pages: 21-33

    • NAID

      110004045669

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Annual Research Report 2005 Final Research Report Summary
  • [Journal Article] 項目反応理論を用いた第1回共用試験医学系CBTの統計解析2005

    • Author(s)
      仁田善雄, 前川眞一, 柳本武美, 前田忠彦, 吉田素文, 奈良信雄, 石田達樹, 福島統, 齋藤宣彦, 福田康一郎, 高久史麿, 麻生武司
    • Journal Title

      医学教育 36巻

      Pages: 3-9

    • NAID

      10016683665

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Annual Research Report 2005 Final Research Report Summary
  • [Journal Article] Extensions of the Conjugate Prior Through the Kullback-Leibler Separators.2005

    • Author(s)
      Yanagimoto, T., Ohnishi, T.
    • Journal Title

      J Mult.Anal. 92

      Pages: 116-133

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Standardized posterior mode for the flexible use of a conjugate prior.2005

    • Author(s)
      Yanagimoto, T., Ohnishi, T.
    • Journal Title

      J.Statist.Plann.Inf. 131

      Pages: 253-269

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Parameter estimation of structural equation models using latent variable scores (in Japanese).2005

    • Author(s)
      Mitsunaga, H., Hoshino, T., Shigemasu, K, Mayekawa, S.
    • Journal Title

      Behaviometrika 32

      Pages: 21-33

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Extensions of the Conjugate Prior Through the Kullback-Leibler Separators2005

    • Author(s)
      Yanagimoto, T., Ohnishi, T.
    • Journal Title

      J.Mult.Anal. 92巻

      Pages: 116-133

    • Related Report
      2005 Annual Research Report 2004 Annual Research Report
  • [Journal Article] Standardized posterior mode for the flexible use of a conjugate prior2005

    • Author(s)
      Yanagimoto, T., Ohnishi, T.
    • Journal Title

      J.Statist.Plann.Inf. 131巻

      Pages: 253-269

    • Related Report
      2004 Annual Research Report
  • [Journal Article] 項目反応理論を用いた第1回共用試験医学系CBTの統計解析2005

    • Author(s)
      仁田 善雄, 前川 眞一ら
    • Journal Title

      医学教育 36巻

      Pages: 3-9

    • NAID

      10016683665

    • Related Report
      2004 Annual Research Report
  • [Journal Article] 全国共用試験CBT問題作成向上に対する学内講習会の効果2005

    • Author(s)
      奈良 信雄, 仁田 善雄ら
    • Journal Title

      医学教育 36巻

      Pages: 11-16

    • NAID

      10016683672

    • Related Report
      2004 Annual Research Report
  • [Journal Article] 「法科大学院統一適性試験」のIRT分析2004

    • Author(s)
      前田 忠彦, 野口 裕之
    • Journal Title

      法科大学院統一適性試験テクニカル・レポート2004

      Pages: 73-83

    • Related Report
      2004 Annual Research Report
  • [Journal Article] 日弁連法務研究財団「統一適性試験」と大学入試センター「適性試験」の比較分析2004

    • Author(s)
      前田 忠彦, 柴山 直
    • Journal Title

      法科大学院統一適性試験テクニカル・レポート2004

      Pages: 84-94

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Randomized item testing ; its framework and infrastructure (in Japanese).2003

    • Author(s)
      Yanagimoto, T., Maeda, T.
    • Journal Title

      Behaviometrika 30

      Pages: 213-221

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Implications of Scientific Epistemology to research designs - Requirements for obtaining Evidences of High Quality (in Japanese).2003

    • Author(s)
      Yanagimoto, T.
    • Journal Title

      Philosophy of Science 36

      Pages: 151-164

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Electrostatic views of Stein-type estimation of location vectors.2003

    • Author(s)
      Ohnishi, T., Yanagimoto, T
    • Journal Title

      J Japan Statist.Soc. 33

      Pages: 39-64

    • NAID

      110003144453

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Publications] 三好 美浩, 柳本 武美: "学習指導要領に準拠した項目プールからのサンプリング"統数研研究教育活動報告. No.18. 32-41 (2004)

    • Related Report
      2003 Annual Research Report
  • [Publications] Ohnishi, T., Yanagimoto, T.: "Electrostatic views of Stein-type estimation of location vectors"J.Japan Statist.Soc.. 33巻. 39-64 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 柳本 武美: "科学的認識論の研究計画への含意-質の高い証拠を得る要件-"科学哲学. 36巻2号. 151-164 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 前田 忠彦, 柳本 武美(編): "大規模テストの構築と運用をめぐる諸問題-研究集会 報告資料集-"統計数理研究所研究教育活動報告. No.18. 1-83 (2004)

    • Related Report
      2003 Annual Research Report
  • [Publications] 仁田 善雄, 奈良 信雄ら: "第1回共用試験医科CBTトライアルの統計解析"医学教育. 35巻. 45-52 (2004)

    • Related Report
      2003 Annual Research Report
  • [Publications] 福島 統: "臨床実習開始前の共用試験"大学時報. 78-81 (2003)

    • Related Report
      2003 Annual Research Report

URL: 

Published: 2003-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi