• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Automated scoring system for short-answer responses

Research Project

Project/Area Number 23650558
Research Category

Grant-in-Aid for Challenging Exploratory Research

Allocation TypeMulti-year Fund
Research Field Educational technology
Research InstitutionThe National Center for University Entrance Examinations

Principal Investigator

ISHIOKA Tsunenori  独立行政法人大学入試センター, 研究開発部, 教授 (80311166)

Co-Investigator(Kenkyū-buntansha) NAGATSUKA Hideki  中央大学, 理工学部経営システム工学科, 准教授 (30384738)
ARAI Sayaka  大学入試センター, 研究開発部, 助教 (00561036)
Project Period (FY) 2011 – 2013
Project Status Completed (Fiscal Year 2013)
Budget Amount *help
¥3,510,000 (Direct Cost: ¥2,700,000、Indirect Cost: ¥810,000)
Fiscal Year 2013: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Fiscal Year 2012: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2011: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Keywordse-ラーニング / テキスト評価 / 自然言語処理 / 情報システム / 統計数学 / 人工知能
Research Abstract

At the beginning of our research, we were planning to use two indices of recall and precision in order to measure a similarity between an input answer and the model answer. After that, it turned out that use of the textual entailment recognition based on the legitimate natural-language-processing technology is promising. Our research was advanced, acquiring knowledge from the member of National Institute of Informatics. Main results are follows:
(1) Evaluating or grading essays based on our actual proof experiment was announced at the 10th Japanese Test society convention. (2) About the computer use and automatic grading in an essay or composition test, a lecture was given at open symposium to introduce our activity widely. (3) The method of the statistical technology towards automatic grading was developed, and many papers were published in famous journals.

Report

(4 results)
  • 2013 Annual Research Report   Final Research Report ( PDF )
  • 2012 Research-status Report
  • 2011 Research-status Report
  • Research Products

    (40 results)

All 2014 2013 2012 2011 Other

All Journal Article (17 results) (of which Peer Reviewed: 16 results) Presentation (14 results) (of which Invited: 4 results) Book (6 results) Remarks (3 results)

  • [Journal Article] A consistent method of estimation for the three-parameter Weibull distribution2013

    • Author(s)
      Hideki Nagatsuka, Toshinari Kamakura and N.Balakrishnan
    • Journal Title

      Computational Statistics and Data Analysis(Elsevier)

      Volume: Vol.58 Pages: 210-226

    • Related Report
      2013 Final Research Report
    • Peer Reviewed
  • [Journal Article] 大学入学者選抜における小論文試験と教科・科目試験との関連について2013

    • Author(s)
      荒井清佳, 大久保智哉, 石岡恒憲, 宮埜壽夫
    • Volume
      Vol.9
    • Pages
      27-36
    • NAID

      40019725046

    • Related Report
      2013 Final Research Report
    • Peer Reviewed
  • [Journal Article] Imputation of Missing Values for Unsupervised Data Using the Proximity in Random Forests2013

    • Author(s)
      Tsunenori Ishioka
    • Journal Title

      eLmL 2013 : The Fifth International Conference on Mobile, Hybrid, and On-line Learning

      Pages: 30-36

    • Related Report
      2013 Final Research Report
    • Peer Reviewed
  • [Journal Article] A consistent method of estimation for the three-parameter Weibull distribution2013

    • Author(s)
      Hideki Nagatsuka, Toshinari Kamakura and N.Balakrishnan,
    • Journal Title

      Computational Statistics and Data Analysis, Elsevier

      Volume: 58 Pages: 210-226

    • Related Report
      2013 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 大学入学者選抜における小論文試験と教科・科目試験との関連について2013

    • Author(s)
      荒井清佳,大久保智哉,石岡恒憲,宮埜壽夫
    • Journal Title

      日本テスト学会

      Volume: 9 Pages: 27-36

    • NAID

      40019725046

    • Related Report
      2013 Annual Research Report 2012 Research-status Report
    • Peer Reviewed
  • [Journal Article] Imputation of Missing Values for Unsupervised Data Using the Proximity in Random Forestsximity in Random Forests2013

    • Author(s)
      Tsunenori Ishioka
    • Journal Title

      eLmL 2013 : The Fifth International Conference on Mobile, Hybrid, and On-line Learning

      Volume: eLmL 2013 Pages: 30-36

    • Related Report
      2013 Annual Research Report
  • [Journal Article] A consistent method of estimation for the three-parameter Weibull distribution,2013

    • Author(s)
      Hideki Nagatsuka, Toshinari Kamakura and N. Balakrishnan,
    • Journal Title

      Computational Statistics and Data Analysis, Elsevier

      Volume: Vol.58 Pages: 210-226

    • Related Report
      2012 Research-status Report
    • Peer Reviewed
  • [Journal Article] Imputation of Missing Values for Semi-supervised Data Using the Proximity in Random Forests2012

    • Author(s)
      Tsunenori Ishioka
    • Journal Title

      iiWAS 2012, ACM International Conference Proceedings Series

      Pages: 319-325

    • Related Report
      2013 Final Research Report
    • Peer Reviewed
  • [Journal Article] Parameter and quantile estimation for the three-parameter lognormal distribution based on statistics invariant to unknown location2012

    • Author(s)
      Hideki Nagatsuka and N. Balakrishnan
    • Journal Title

      Journal of Statistical Computation and Simulation

      Volume: Vol.43 Issue: 9 Pages: 1629-1647

    • DOI

      10.1080/00949655.2012.667410

    • Related Report
      2013 Final Research Report 2011 Research-status Report
    • Peer Reviewed
  • [Journal Article] A consistent parameter estimation in the three-parameter lognormal distribution2012

    • Author(s)
      Hideki Nagatsuka and N. Balakrishnan
    • Journal Title

      Journal of Statistical Planning and Inference

      Volume: Vol.142, No.7 Issue: 7 Pages: 2071-2086

    • DOI

      10.1016/j.jspi.2012.01.019

    • Related Report
      2013 Final Research Report 2011 Research-status Report
    • Peer Reviewed
  • [Journal Article] Parameter and quantile estimation for the three-parameter gamma distribution based on statistics invariant to unknown location2012

    • Author(s)
      Hideki Nagatsuka and N. Balakrishnan
    • Journal Title

      Journal of Statistical Planning and Inference

      Volume: Vol.142, No.7 Issue: 7 Pages: 2087-2102

    • DOI

      10.1016/j.jspi.2012.01.018

    • Related Report
      2013 Final Research Report 2011 Research-status Report
    • Peer Reviewed
  • [Journal Article] Parameter estimation of multivariate distributions under order restrictions of the parameters : An extension of isotonic regression2012

    • Author(s)
      Hideki Nagatsuka, Megumi Uchino and Hisashi Yamamoto
    • Journal Title

      Quality Technology and Quantitative Management

      Volume: Vol.9 Pages: 283-293

    • Related Report
      2013 Final Research Report
    • Peer Reviewed
  • [Journal Article] A consistent method of estimation for the parameters of the three-parameter inverse Gaussian distribution2012

    • Author(s)
      Hideki Nagatsuka and N.Balakrishnan
    • Journal Title

      Journal of Statistical Computation and Simulation

      Volume: 印刷中 Issue: 10 Pages: 1915-1931

    • DOI

      10.1080/00949655.2012.674130

    • Related Report
      2013 Final Research Report 2011 Research-status Report
    • Peer Reviewed
  • [Journal Article] Parameter estimation of multivariate distributions under order restrictions of the parameters: An extension of isotonic regression2012

    • Author(s)
      Hideki Nagatsuka, Megumi Uchino and Hisashi Yamamoto
    • Journal Title

      Quality Technology and Quantitative Management

      Volume: 未定

    • Related Report
      2011 Research-status Report
    • Peer Reviewed
  • [Journal Article] Ascertaining and graphically representing the logical structure of Japanese essays2011

    • Author(s)
      Tsunenori Ishioka
    • Journal Title

      International Journal of Continuing Engineering Education and Life-Long Learning (IJCEELL)

      Volume: Volume 21, Issue 4 Pages: 276-288

    • NAID

      130000098241

    • Related Report
      2013 Final Research Report 2011 Research-status Report
    • Peer Reviewed
  • [Journal Article] Random Forest を用いた欠測データの補完に基づく大学入試センター試験科目間得点差2011

    • Author(s)
      石岡恒憲
    • Journal Title

      応用統計学

      Volume: 40(3) Pages: 193-209

    • NAID

      10030153149

    • Related Report
      2013 Final Research Report
    • Peer Reviewed
  • [Journal Article] Random Forestを用いた欠測データの補完に基づく大学入試センター試験科目間得点差2011

    • Author(s)
      石岡恒憲
    • Journal Title

      応用統計学

      Volume: 40 (3) Pages: 193-209

    • NAID

      10030153149

    • Related Report
      2011 Research-status Report
    • Peer Reviewed
  • [Presentation] Random Forestsを用いた欠測値補完の半教師データおよび教師なしデータへの拡張2014

    • Author(s)
      石岡恒憲
    • Organizer
      言語処理学会第20回年次大会(NLP2014)
    • Place of Presentation
      北海道大学
    • Related Report
      2013 Annual Research Report
  • [Presentation] Imputation of Missing Values for Unsupervised or Semi-supervised Data Using the Proximity in Random Forests2013

    • Author(s)
      Tsunenori Ishioka
    • Organizer
      Incomplete Data Analysis and Causal Inference
    • Place of Presentation
      International Symposium at Osaka University
    • Related Report
      2013 Final Research Report
  • [Presentation] 小論文の自動採点2013

    • Author(s)
      石岡恒憲
    • Organizer
      国立情報学研究所
    • Place of Presentation
      ロボットは東大に入れるか
    • Related Report
      2013 Final Research Report
    • Invited
  • [Presentation] Imputation of Missing Values for Unsupervised or Semi-supervised Data Using the Proximity in Random Forests2013

    • Author(s)
      Tsunenori Ishioka
    • Organizer
      Incomplete Data Analysis and Causal Inference,International Symposium at Osaka University
    • Place of Presentation
      大阪大学
    • Related Report
      2013 Annual Research Report
  • [Presentation] エッセイおよび作文テストにおけるコンピュータ利用と自動採点2012

    • Author(s)
      石岡恒憲
    • Organizer
      日本テスト学会 第10回大会 公開シンポジウム「パフォーマンス評価の未来」
    • Related Report
      2013 Final Research Report
    • Invited
  • [Presentation] Random Forestによるコンテキスト情報の補完について2011

    • Author(s)
      石岡 恒憲
    • Organizer
      電子情報通信学会, 信学技報
    • Place of Presentation
      九州大学
    • Related Report
      2011 Research-status Report
  • [Presentation] Random Forests を用いた欠測値補完の半教師データおよび教師なしデータへの拡張

    • Author(s)
      石岡恒憲
    • Organizer
      言語処理学会第20回年次大会(NLP2014)
    • Place of Presentation
      北海道大学
    • Related Report
      2013 Final Research Report
  • [Presentation] 小論文試験得点と他教科科目得点および受験者属性との関連

    • Author(s)
      石岡恒憲, 荒井清佳, 大久保智哉
    • Organizer
      日本テスト学会第10回大会
    • Related Report
      2013 Final Research Report
  • [Presentation] 教師なしデータおよび半教師データにおけるランダムフォレストによる欠測値補完

    • Author(s)
      石岡恒憲
    • Organizer
      2012年度統計関連学会連合大会
    • Place of Presentation
      北海道大学
    • Related Report
      2013 Final Research Report
  • [Presentation] Random Forest によるコンテキスト情報の補完について

    • Author(s)
      石岡恒憲
    • Organizer
      電子情報通信学会, 信学技報
    • Related Report
      2013 Final Research Report
  • [Presentation] 小論文試験得点と他教科科目得点および受験者属性との関連

    • Author(s)
      石岡恒憲, 荒井清佳,大久保智哉
    • Organizer
      日本テスト学会 第10回大会
    • Place of Presentation
      東京医科歯科大
    • Related Report
      2012 Research-status Report
  • [Presentation] 複数課題の小論文試験得点と他教科科目得点との関連

    • Author(s)
      荒井清佳,大久保智哉,石岡恒憲,宮埜壽夫
    • Organizer
      日本テスト学会 第10回大会
    • Place of Presentation
      東京医科歯科大
    • Related Report
      2012 Research-status Report
  • [Presentation] エッセイおよび作文テストにおけるコンピュータ利用と自動採点

    • Author(s)
      石岡恒憲
    • Organizer
      日本テスト学会 第10回大会 公開シンポジウム「パフォーマンス評価の未来」
    • Place of Presentation
      東京医科歯科大
    • Related Report
      2012 Research-status Report
    • Invited
  • [Presentation] 小論文の自動採点

    • Author(s)
      石岡恒憲
    • Organizer
      国立情報学研究所「ロボットは東大に入れるか」プロジェクト講演
    • Place of Presentation
      国立情報学研究所
    • Related Report
      2012 Research-status Report
    • Invited
  • [Book] 新しい時代の大学入試2014

    • Author(s)
      石岡恒憲ほか(繁桝算男編)
    • Total Pages
      240
    • Publisher
      金子書房
    • Related Report
      2013 Final Research Report
  • [Book] 日本語小論文試験についての実証的研究 -小論文試験は何を測っているのか-2014

    • Author(s)
      荒井清佳, 大久保智哉, 石岡恒憲
    • Total Pages
      49
    • Publisher
      大学入試センター研究開発部
    • Related Report
      2013 Final Research Report
  • [Book] 新しい時代の大学入試2014

    • Author(s)
      石岡 恒憲ほか(繁桝算男編)
    • Total Pages
      240
    • Publisher
      金子書房
    • Related Report
      2013 Annual Research Report
  • [Book] 日本語小論文試験についての実証的研究 ―小論文試験は何を測っているのか―2014

    • Author(s)
      荒井清佳,大久保智哉,石岡恒憲
    • Total Pages
      49
    • Publisher
      大学入試センター研究開発部
    • Related Report
      2013 Annual Research Report
  • [Book] 自然言語処理と学習評価, 教育工学における学習評価2012

    • Author(s)
      石岡恒憲ほか(植野真臣・永岡慶三・山内祐平共編)
    • Total Pages
      224
    • Publisher
      教育工学選書
    • Related Report
      2013 Final Research Report
  • [Book] 自然言語処理と学習評価, 教育工学における学習評価, 教育工学選書2012

    • Author(s)
      石岡 恒憲ほか(植野真臣・永岡慶三・山内 祐平 共編)
    • Total Pages
      224
    • Publisher
      ミネルヴァ書房
    • Related Report
      2012 Research-status Report
  • [Remarks] Ishioka's Home Page

    • URL

      http://www.rd.dnc.ac.jp/~tunenori/

    • Related Report
      2013 Final Research Report
  • [Remarks] Ishioka's Home Page

    • URL

      http://www.rd.dnc.ac.jp/~tunenori/

    • Related Report
      2013 Annual Research Report
  • [Remarks] Ishioka's Home Page

    • URL

      http://www.rd.dnc.ac.jp/~tunenori/

    • Related Report
      2012 Research-status Report

URL: 

Published: 2011-08-05   Modified: 2019-07-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi