2005 Fiscal Year Final Research Report Summary
Developing techniques for constructing and maintaining an item pool
| Project/Area Number |
15300290
|
|---|
| Research Category |
Grant-in-Aid for Scientific Research (B)
|
| Allocation Type | Single-year Grants |
|---|
| Section | 一般 |
|---|
| Research Field |
Educational technology
|
|---|
| Research Institution | The Institute of Statistical Mathematics |
|---|
Principal Investigator |
YANAGIMOTO Takemi The Institute of Statistical Mathematics, Department of Data Science, Professor, データ科学研究系, 教授 (40000195)
|
|---|
| Co-Investigator(Kenkyū-buntansha) |
MAEDA Tadahiko The Institute of Statistical Mathematics, Department of Data Science, Assoc. Professor, データ科学研究系, 助教授 (10247257)
OHNISHI Toshio The Institute of Statistical Mathematics, Department of Data Science, Assist. Professors, データ科学研究系, 助手 (60353413)
MAYEKAWA Shin-ichi Tokyo Institute of Technology, Graduate School of Decision Science and Technology / Human System Science, Professor, 大学院・社会理工学研究科, 教授 (70190288)
NITTA Yoshio Tokyo Medical and Dental University, Center for Education Research in Medicine and Dentistry, Assoc. Professor, MDセンター, 助教授 (10114315)
FUKUSHIMA Osamu The Jikei University, School of Medicine, Professor, 医学部, 教授 (60173332)
|
|---|
| Project Period (FY) |
2003 – 2005
|
| Keywords | CBT / Design science / OSCE / LSAT / Common Achievement Test / Intelligence-based sampling / 設計科学 |
|---|
| Research Abstract |
Under tight coordination the three groups, consisting of biostatisticians, psychometricians and medical educators, conducted the present research. The primary aim of the present research is to develop quantitative techniques for constructing and maintaining an item pool. Special efforts are placed on improving the ongoing the computer based testing (CBT) of the Common Achievement Test. Intensive contacts with this actual project make this research practical. This CBT is really a breakthrough in a huge number of ongoing testings. It is one of most challenging educational tests in the world.
The result of trials are analyzed in terms of the standard item response theory. This analysis is helpful for preparing inclusion-exclusion criteria of items tested in the trials. Further it suggests various important subjects to be studied. One of them is to justify why an item pool is necessary for evaluating adequately knowledges regarding a specified academic field of an student. This allows us ri
… More
gid scientific bases of educational testings and also flexible operation of nation-wide testing. On the other hand, various difficulties give rise to, which include validity of items, a huge number of items in a pool, quantitative evaluation of item characteristics. Another important problem is how we obtain reliable quantitative item parameters in a item pool. In addition to analytical techniques we emphasized the need for a well designed pre-operation based on the item response theory. The necessity is in principle widely accepted among researchers but practical implementation, together with its actual use, has not been attempted. Fortunately, the Board of the Common Achievement Test accepted our propose. Probably this is the first trial in large-scaled testings. The result will be useful for evaluating item parameters, especially when the general time trend will be suspected. Sampling techniques are rapidly developing though Bayesian analysis. They are expected to be useful in balancing various aspects of items selected to a particular examinee. A small size survey regarding opinions and impressions of examinees was conducted. The results call our attention to unexpected unclear descriptions remained in items. More importantly, they suggest how examinees participate the CBT as an important stakeholder. Such a view was completely discarded in the existing testings.
In addition to the above project, we participate other important projects. One of them is OSCE by the Common Achievement Testing. The others include LSAT and the CBT for nurse students. These projects make the present research useful in practice, and we can expect possible contributions on future educational tests. Less
|
Research Products
(13 results)
-
-
-
[Journal Article] Analysis of the questionarre for nationwide common achievement test system for entering clinical clerkship in Japan (in Japanese).2006
Author(s)
Nara, N., Abe, T, Takamatsu, K, Nitta, Y, Fukushima, O., Morita, T.
-
Journal Title
Medical Education 37
Pages: 3-7
Description
「研究成果報告書概要(欧文)」より
-
-
-
-
[Journal Article] 項目反応理論を用いた第1回共用試験医学系CBTの統計解析2005
Author(s)
仁田善雄, 前川眞一, 柳本武美, 前田忠彦, 吉田素文, 奈良信雄, 石田達樹, 福島統, 齋藤宣彦, 福田康一郎, 高久史麿, 麻生武司
-
Journal Title
Description
「研究成果報告書概要(和文)」より
-
-
-
-
-
-
