Pilot study on testing system for large-scale test based on tablet computer and statistical model

• Project/Area Number: 26702003
• Research Category: Grant-in-Aid for Young Scientists (A)
• Allocation Type: Partial Multi-year Fund
• Research Field: Educational technology
• Research Institution: The National Center for University Entrance Examinations
• Principal Investigator: Okubo Tomoya 独立行政法人大学入試センター, その他部局等, 助教 (80512136)
• Project Period (FY): 2014-04-01 – 2017-03-31
• Project Status: Completed (Fiscal Year 2016)
• Budget Amount: ¥21,190,000 (Direct Cost: ¥16,300,000、Indirect Cost: ¥4,890,000); Fiscal Year 2016: ¥4,420,000 (Direct Cost: ¥3,400,000、Indirect Cost: ¥1,020,000); Fiscal Year 2015: ¥4,550,000 (Direct Cost: ¥3,500,000、Indirect Cost: ¥1,050,000); Fiscal Year 2014: ¥12,220,000 (Direct Cost: ¥9,400,000、Indirect Cost: ¥2,820,000)
• Keywords: CBT / 大規模試験 / 試験技術 / IRT

Outline of Final Research Achievements

In this research, we conducted pilot studies of a Computer-Based Testing (CBT) system that is based on statistical theory and tablet computers. We developed some test item formats that requires computers as well as test items for the CBT system. Further, we developed the management system of the tablet computers that enables us to operate testing system efficiently. We obtained much information on managing CBT system in large-scale testing.

Academic Significance and Societal Importance of the Research Achievements

本研究が進んだことによって，(1) 同一受験者の年複数回受験を検討する．(2) 高校の基礎学力を測定する基礎型試験と大学入学者選抜に用いる発展型試験を共存させる．(3) 話す・書くなどの英語能動的技能を測定するテスト(TOEFL，TOEIC等)を活用する．(4) 論理的思考力や数学的思考力といった非教科依存型の試験を一部含める．といったことを可能にするテストシステムの可能性について具体的に示すことが出来た．このことにより，現在の大学入試センター試験の運用方法では実行不可能な新しい試験のあり方を社会に対して発信することができた．

Research Products

• [Presentation] Scoring algorithm for students' constructed responses. (2017)
  • Author(s): Okubo, T.
  • Organizer: 81th Annual Meeting of the Psychometric Society
  • Place of Presentation: Nashville, NC
  • Year and Date: 2017-07-12
  • Int'l Joint Research
• [Presentation] Category prediction on short-answer question using dynamic scoring algorithm. (2015)
  • Author(s): Okubo, T
  • Organizer: ERCIM 2015
  • Place of Presentation: London, UK
  • Year and Date: 2015-12-14
  • Int'l Joint Research
• [Presentation] CBTシステムで運用可能なシミュレーション型試験項目の研究開発 (2015)
  • Author(s): 大久保智哉・武田洋・室田真男・徳田安春
  • Organizer: 第47回日本医学教育学会大会
  • Place of Presentation: 新潟県新潟市朱鷺メッセ
  • Year and Date: 2015-07-24
• [Presentation] Latent-shift model and its applications. (2015)
  • Author(s): Okubo, T. & Okada, K.
  • Organizer: International Meeting of the Psychometric Society 2015
  • Place of Presentation: Beijing, China
  • Year and Date: 2015-07-12
  • Int'l Joint Research
• [Presentation] CBTのデモンストレーション (2014)
  • Author(s): 大久保智哉
  • Organizer: 大学入試センターシンポジウム「大学入試の日本的風土は変えられるか」
  • Place of Presentation: 東京・目黒区・東京工業大学
  • Year and Date: 2014-11-29
• [Presentation] Changing a large-scale test using computer-based testing (2014)
  • Author(s): Okubo, T.
  • Organizer: Senshu-University International Symposium. Big Data in Psychological Science and Related Disciplines
  • Place of Presentation: Senshu-University Tokyo, Japan
  • Year and Date: 2014-09-06
  • Invited
• [Presentation] 入学者選抜とeテスティング (2014)
  • Author(s): 大久保智哉
  • Organizer: テスト学会
  • Place of Presentation: 東京・八王子・帝京大学
  • Year and Date: 2014-08-30 – 2014-08-31
• [Presentation] 数学における情報端末を利用した連問形式が持つ特性 (2014)
  • Author(s): 吉原正寛・大久保智哉・室田真男
  • Organizer: テスト学会
  • Place of Presentation: 東京・八王子・帝京大学
  • Year and Date: 2014-08-30 – 2014-08-31
• [Presentation] Sequential items based on computer based testing (2014)
  • Author(s): Okubo, T.
  • Organizer: International Meeting of Psychometric Society
  • Place of Presentation: University of Wisconsin Wisconsin, USA
  • Year and Date: 2014-07-23 – 2014-07-25
• [Patent(Industrial Property Rights)] 採点補助システム (2016)
  • Inventor(s): 大久保智哉・佐藤圭
  • Industrial Property Rights Holder: 大学入試センター
  • Industrial Property Rights Type: 特許
  • Filing Date: 2016-03-17