• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Hierarchical Bayesian Item Response Theory Model for Reliable Peer Assessment

Research Project

Project/Area Number 15K16256
Research Category

Grant-in-Aid for Young Scientists (B)

Allocation TypeMulti-year Fund
Research Field Educational technology
Research InstitutionThe University of Electro-Communications

Principal Investigator

Uto Masaki  電気通信大学, 大学院情報理工学研究科, 助教 (10732571)

Project Period (FY) 2015-04-01 – 2017-03-31
Project Status Completed (Fiscal Year 2016)
Budget Amount *help
¥2,730,000 (Direct Cost: ¥2,100,000、Indirect Cost: ¥630,000)
Fiscal Year 2016: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Fiscal Year 2015: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Keywordsピアアセスメント / 項目反応理論 / eラーニング / eテスティング / 教育評価 / パフォーマンス評価 / 信頼性 / 階層ベイズ / レイティング / 評価者特性
Outline of Final Research Achievements

In peer assessment, a problem remains that reliability depends on the rater characteristics. For this reason, some item response models that incorporate rater parameters have been proposed. Those models are expected to improve the reliability if the model parameters can be estimated accurately. However, when applying them to actual peer assessment, the parameter estimation accuracy would be reduced for the following reasons. 1) The number of rater parameters increases rapidly because the models include higher-dimensional rater parameters. 2) The parameter estimation accuracy from sparse assessment data depends on hand-tuning parameters, called hyperparameters.
To solve the problems, we propose a new item response model for peer assessment that incorporates rater parameters to maintain as few rater parameters as possible. Furthermore, this article proposes a parameter estimation method using a hierarchical Bayes model for the proposed model that can learn the hyperparameters from data.

Report

(3 results)
  • 2016 Annual Research Report   Final Research Report ( PDF )
  • 2015 Research-status Report
  • Research Products

    (15 results)

All 2017 2016 2015

All Journal Article (2 results) (of which Peer Reviewed: 2 results,  Acknowledgement Compliant: 1 results) Presentation (13 results) (of which Int'l Joint Research: 5 results)

  • [Journal Article] パフォーマンス評価のための項目反応モデルの比較と展望2016

    • Author(s)
      宇都雅輝,植野真臣
    • Journal Title

      日本テスト学会誌

      Volume: 12 Pages: 55-75

    • NAID

      130007654633

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Item Response Theory for Peer Assessment2016

    • Author(s)
      Masaki Uto, Maomi Ueno
    • Journal Title

      IEEE Transactions on Learning Technologies, IEEE Computer Society

      Volume: 9 Issue: 2 Pages: 157-170

    • DOI

      10.1109/tlt.2015.2476806

    • NAID

      110004744922

    • Related Report
      2016 Annual Research Report 2015 Research-status Report
    • Peer Reviewed
  • [Presentation] Group optimization to maximize peer assessment accuracy using item response theory2017

    • Author(s)
      Masaki Uto, Nguyen Duc Thien, Maomi Ueno
    • Organizer
      International Conference on Artificial Intelligence in Education
    • Place of Presentation
      Wuhan(China)
    • Year and Date
      2017-06-28
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Features of Globalization in Japanese Graduate Schools2017

    • Author(s)
      Taiyo Utsuhara, Masaki Uto, Asana Ishihara, Koichi Ota, Ayako Hirano, Atsushi Yoshikawa, Maomi Ueno
    • Organizer
      International Conference on Education
    • Place of Presentation
      San Diego(United States of America)
    • Year and Date
      2017-03-12
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 足場かけに基づくアカデミックライティング学習支援システム2017

    • Author(s)
      木下涼,宇都雅輝,植野真臣
    • Organizer
      教育システム情報学会 学生研究発表会
    • Place of Presentation
      銚子市民センター(千葉)
    • Year and Date
      2017-02-28
    • Related Report
      2016 Annual Research Report
  • [Presentation] パフォーマンス評価の多様なバイアスを考慮した項目反応モデル2016

    • Author(s)
      宇都雅輝,植野真臣
    • Organizer
      日本教育工学会第32回全国大会
    • Place of Presentation
      大阪大学(大阪)
    • Year and Date
      2016-09-17
    • Related Report
      2016 Annual Research Report
  • [Presentation] Group formation for peer assessment using item response theory2016

    • Author(s)
      Nguyen Duc Thien, Masaki Uto, Maomi Ueno
    • Organizer
      日本教育工学会第32回全国大会
    • Place of Presentation
      大阪大学(大阪)
    • Year and Date
      2016-09-17
    • Related Report
      2016 Annual Research Report
  • [Presentation] 評価者と課題の多様な特性を考慮した項目反応モデル2016

    • Author(s)
      宇都雅輝,植野真臣
    • Organizer
      日本テスト学会14回大会
    • Place of Presentation
      電気通信大学(東京)
    • Year and Date
      2016-09-08
    • Related Report
      2016 Annual Research Report
  • [Presentation] ピアアセスメントの精度を最適化する評価者選択手法2016

    • Author(s)
      Nguyen Duc Thien,宇都雅輝,植野真臣
    • Organizer
      日本テスト学会14回大会
    • Place of Presentation
      電気通信大学(東京)
    • Year and Date
      2016-09-08
    • Related Report
      2016 Annual Research Report
  • [Presentation] Co-creating ルーブリックの自己制御学習および自己評価力への影響分析2016

    • Author(s)
      山本美紀,宇都雅輝,西山悠,川野秀一,植野真臣
    • Organizer
      日本テスト学会14回大会
    • Place of Presentation
      電気通信大学(東京)
    • Year and Date
      2016-09-08
    • Related Report
      2016 Annual Research Report
  • [Presentation] Reliable Peer Assessment for Team-project-based Learning using Item Response Theory2015

    • Author(s)
      Thien Nguyen,Masaki Uto,Yu Abe,Maomi Ueno
    • Organizer
      International Conference on Computers in Education (ICCE)
    • Place of Presentation
      Hangzhou, China
    • Year and Date
      2015-11-30
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] 項目反応理論によるルーブリックの自己評価力への影響分析-評価者特性と目標志向性,学習観,動機づけ,学習方略に着目して2015

    • Author(s)
      山本美紀・宇都雅輝・植野真臣
    • Organizer
      日本教育工学会第31回全国大会
    • Place of Presentation
      電気通信大学
    • Year and Date
      2015-09-21
    • Related Report
      2015 Research-status Report
  • [Presentation] ピアアセスメントのための項目反応理論を用いた評価者選択2015

    • Author(s)
      宇都雅輝
    • Organizer
      教育システム情報学会第40回全国大会
    • Place of Presentation
      徳島大学
    • Year and Date
      2015-09-01
    • Related Report
      2015 Research-status Report
  • [Presentation] Academic Writing Support System using Bayesian Networks2015

    • Author(s)
      Masaki Uto, Maomi Ueno
    • Organizer
      IEEE International Conference on Advanced Learning Technologies (ICALT)
    • Place of Presentation
      Hualien, Taiwan
    • Year and Date
      2015-07-06
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] Item Response Model with Lower Order Rater Parameters for Peer Assessment2015

    • Author(s)
      Masaki Uto, Maomi Ueno
    • Organizer
      International Conference on Artificial Intelligence in Education (AIED)
    • Place of Presentation
      Madrid, Spain
    • Year and Date
      2015-06-22
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research

URL: 

Published: 2015-04-16   Modified: 2018-03-22  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi