• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

A Practical Japanese Short-answer Scoring System for Writing Test

Research Project

Project/Area Number 26350357
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Research Field Educational technology
Research InstitutionThe National Center for University Entrance Examinations

Principal Investigator

Ishioka Tsunenori  独立行政法人大学入試センター, 研究開発部, 教授 (80311166)

Co-Investigator(Kenkyū-buntansha) 峯 恒憲  九州大学, システム情報科学研究院, 准教授 (30243851)
Research Collaborator KAMEDA Masayuki  大学入試センター, 研究開発部付, 学術支援員
Project Period (FY) 2014-04-01 – 2017-03-31
Project Status Completed (Fiscal Year 2016)
Budget Amount *help
¥4,810,000 (Direct Cost: ¥3,700,000、Indirect Cost: ¥1,110,000)
Fiscal Year 2016: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Fiscal Year 2015: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Fiscal Year 2014: ¥1,820,000 (Direct Cost: ¥1,400,000、Indirect Cost: ¥420,000)
Keywords情報システム / 自然言語処理 / 機械学習 / CBT / Webアプリケーション / 自動評価・自動採点 / 人工知能 / 共通テスト / 高大接続システム / 統計科学 / 教育工学 / 統計数学
Outline of Final Research Achievements

We have developed an automated Japanese short-answer scoring and support machine for new National Center Test written exams. Our approach is based on the fact that recognizing textual entailments and/or synonymy has been almost impossible for scoring systems for several years. The system generates automated scores on the basis of evaluation criteria or rubrics, and human raters revise the scores. The system determines semantic similarity between the model answers and the actual written answers as well as a certain degree of semantic identity and implication. Owing to the need for the scoring results to be classified at multiple levels, we use random forests to effectively utilize many predictors rather than use support vector machines. An experimental prototype operates as a web system on a Linux computer.

Report

(4 results)
  • 2016 Annual Research Report   Final Research Report ( PDF )
  • 2015 Research-status Report
  • 2014 Research-status Report
  • Research Products

    (41 results)

All 2017 2016 2015 2014 Other

All Journal Article (16 results) (of which Open Access: 5 results,  Acknowledgement Compliant: 5 results,  Peer Reviewed: 13 results) Presentation (22 results) (of which Int'l Joint Research: 5 results,  Invited: 1 results) Book (2 results) Remarks (1 results)

  • [Journal Article] Comment Data Mining to Estimate Student Performance Considering Consecutive Lessons2017

    • Author(s)
      Shaymaa E. Sorour1 and Kazumasa Goda and Tsunenori Mine
    • Journal Title

      Journal of Educational Technology & Society

      Volume: 20(1) Pages: 73-86

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed
  • [Journal Article] コンピュータ上で実施する記述式試験 ──エッセイタイプ,短答式,マルチメディア利用について──2016

    • Author(s)
      石岡 恒憲
    • Journal Title

      電子情報通信学会誌

      Volume: 99(10) Pages: 1005-1011

    • NAID

      40020982243

    • Related Report
      2016 Annual Research Report
    • Open Access / Acknowledgement Compliant
  • [Journal Article] Understandable Prediction Models of Student Performance Using an Attribute Dictionary2016

    • Author(s)
      Sorour, Shaymaa E and El Rahman, Shaimaa Abd and Kahouf, Samir A and Mine, Tsunenori
    • Journal Title

      International Conference on Web-Based Learning

      Volume: ICWL 2016 Pages: 161-171

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Building an Interpretable Model of Predicting Student Performance Using Comment Data Mining2016

    • Author(s)
      Shaymaa E. Sorour and Tsunenori Mine
    • Journal Title

      The 5th International Conference on Learning Technologies and Learning Environments in conjunction with the 5th IIAI International Congress on Advanced Applied Informatics 2016

      Volume: LTLE 2016 Pages: 285-291

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Teacher interventions to enhance the quality of student comments and their effect on prediction performance2016

    • Author(s)
      Sorour, Shaymaa E and El Rahman, Shaymaa Abd and Mine, Tsunenori
    • Journal Title

      Frontiers in Education Conference

      Volume: FIE 2016 Pages: 1-9

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Extraction of Current Actual Status and Demand Expressions from Complaint Reports2016

    • Author(s)
      Yuta Sano and Tsunenori Mine
    • Journal Title

      the 18th International Conference on Information Integration and Web-based Applications & Services

      Volume: iiWAS 2016 Pages: 151-155

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed
  • [Journal Article] コンピュータ上で実施する記述式試験について2016

    • Author(s)
      石岡 恒憲
    • Journal Title

      情報処理学会電子図書館

      Volume: CE-133-19

    • Related Report
      2015 Research-status Report
    • Open Access
  • [Journal Article] 再設計される (redesigned)SAT について ― 改訂の 意図と背景 ―2016

    • Author(s)
      石岡恒憲
    • Journal Title

      大学入試研究ジャーナル

      Volume: 26 Pages: 163-169

    • NAID

      40020764441

    • Related Report
      2015 Research-status Report
    • Peer Reviewed
  • [Journal Article] 小論文課題の複数人による採点の基礎的分析 -採点者による得点の違いについてー2016

    • Author(s)
      荒井清佳・石岡恒憲
    • Journal Title

      大学入試研究ジャーナル

      Volume: 26 Pages: 53-58

    • Related Report
      2015 Research-status Report
    • Peer Reviewed
  • [Journal Article] PATRASH: Transportation Recommendation Agent Based User's History2015

    • Author(s)
      中村 啓之, 峯 恒憲
    • Journal Title

      電子情報通信学会論文誌D 情報・システム

      Volume: J98-D Issue: 6 Pages: 962-970

    • DOI

      10.14923/transinfj.2014SWP0015

    • ISSN
      1880-4535, 1881-0225
    • Year and Date
      2015-06-01
    • Related Report
      2014 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Evaluation of Effectiveness of Time-Series Comments by Using Machine Learning Techniques2015

    • Author(s)
      Shaymaa E. Sorour, Kazumasa Goda and Tsunenori Mine
    • Journal Title

      Journal of Information Processing

      Volume: 23 Pages: 784-794

    • NAID

      130005109165

    • Related Report
      2015 Research-status Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] 学習態度に関する自己評価記述の正確さ と 成績推定性能の相関2015

    • Author(s)
      合田和正,廣川佐千男,峯 恒憲
    • Journal Title

      電子情報通信学会和文論文誌

      Volume: J98-D Pages: 1247-1255

    • Related Report
      2015 Research-status Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] 全文検索による試験問題検索システム ―新規作成問題の類似文書検索を中心として―2015

    • Author(s)
      石岡恒憲, 狩野芳伸,橋本貴充,大津起夫
    • Journal Title

      大学入試研究ジャーナル

      Volume: 25 Pages: 129-135

    • NAID

      40020402652

    • Related Report
      2014 Research-status Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] 平成27年度センター試験理科受験者の得点分析 ―科目別の学力分布ならびに得点調整スコアについて―2015

    • Author(s)
      石岡 恒憲
    • Journal Title

      大学入試センター研究開発部リサーチノート

      Volume: RN-14-03 Pages: 1-12

    • Related Report
      2014 Research-status Report
  • [Journal Article] Predictive Model to Evaluate Students Performance2015

    • Author(s)
      Shaymaa Sorour, Tsunenori Mine, Kazumasa Goda, Sachio Hirokawa
    • Journal Title

      Journal ofInformation Processing, Special Issue of "Students' and Young Researchers' Papers”

      Volume: Vol.23, No.2 Pages: 192-201

    • NAID

      130004952418

    • Related Report
      2014 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Investigations into Missing Values Imputation Using Random Forests for Semi-supervised Data2014

    • Author(s)
      Tsunenori Ishioka
    • Journal Title

      Proceedings of the 16th International Conference on Information Integration and Web-based Applications & Services

      Volume: iiWAS Special Issue Pages: 296-301

    • DOI

      10.1145/2684200.2684288

    • Related Report
      2014 Research-status Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Presentation] 短答記述式問題解答文の採点支援システムJS4の試作2017

    • Author(s)
      亀田 雅之, 石岡 恒憲, 劉 東岳
    • Organizer
      言語処理学会第23回年次大会(NLP2017)
    • Place of Presentation
      筑波大学 春日キャンパス
    • Year and Date
      2017-03-13
    • Related Report
      2016 Annual Research Report
  • [Presentation] 人工知能を利用した短答式記述採点支援システムの開発2017

    • Author(s)
      石岡 恒憲, 亀田 雅之, 劉 東岳
    • Organizer
      計測自動制御学会, 第44回知能システムシンポジウム, SY0004/17/B2-3
    • Place of Presentation
      東海大学 高輪キャンパス
    • Year and Date
      2017-03-13
    • Related Report
      2016 Annual Research Report
  • [Presentation] 人工知能を利用した短答式記述採点支援システムの開発2016

    • Author(s)
      石岡 恒憲, 亀田 雅之, 劉 東岳
    • Organizer
      電子情報通信学会, 信学技報NLC, 87-92
    • Place of Presentation
      NTT武蔵野研究開発センタ
    • Year and Date
      2016-12-21
    • Related Report
      2016 Annual Research Report
  • [Presentation] 経験的パターンと機械学習手法を利用した現状,要望の抽出2016

    • Author(s)
      佐野 優太, 峯 恒憲
    • Organizer
      JAWS2016
    • Place of Presentation
      岐阜羽島,岐阜
    • Year and Date
      2016-09-15
    • Related Report
      2016 Annual Research Report
  • [Presentation] コンピュータ上で実施する記述式試験2016

    • Author(s)
      石岡 恒憲
    • Organizer
      2016年度 統計関連学会連合大会
    • Place of Presentation
      金沢大学 角間キャンパス
    • Year and Date
      2016-09-05
    • Related Report
      2016 Annual Research Report
  • [Presentation] コンピュータ上で実施する記述式試験―エッセイタイプ,短答式,マルチメディア利用について―2016

    • Author(s)
      石岡 恒憲
    • Organizer
      平成28年度全国大学入学者選抜研究連絡協議会大会(第11回)
    • Place of Presentation
      立命館大学 茨木キャンパス
    • Year and Date
      2016-06-01
    • Related Report
      2016 Annual Research Report
  • [Presentation] コンピュータ上で実施する記述式試験について[招待講演]2016

    • Author(s)
      石岡 恒憲
    • Organizer
      情報処理学会,第133回 コンピュータと教育研究会
    • Place of Presentation
      東京農工大・東小金井キャンパス(東京都小金井市)
    • Year and Date
      2016-02-13
    • Related Report
      2015 Research-status Report
    • Invited
  • [Presentation] Exploring Students’ Learning Attributes in Consecutive Lessons to Improve Prediction Performance2016

    • Author(s)
      Shaymaa E. Sorour, Tsunenori Mine
    • Organizer
      Eighteenth Australasian Computing Education Conference (ACE)
    • Place of Presentation
      Canberra (Australia)
    • Year and Date
      2016-02-02
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] コンピュータ上で実施する記述式試験 ~人工知能活用の観点から~ [特別講演]2016

    • Author(s)
      石岡 恒憲
    • Organizer
      電子情報通信学会, 信学技報AI, 23-25
    • Place of Presentation
      クアージュ湯布院
    • Related Report
      2016 Annual Research Report
  • [Presentation] 大学入試改革の概要と課題(指定討論)2016

    • Author(s)
      石岡 恒憲
    • Organizer
      日本テスト学会第14回公開シンポジウム2
    • Place of Presentation
      電気通信大学
    • Related Report
      2016 Annual Research Report
  • [Presentation] コンピュータで実施するテストの採点をめぐる課題2016

    • Author(s)
      石岡 恒憲
    • Organizer
      大学入試センターシンポジウム
    • Place of Presentation
      東京工業大学 大岡山キャンパス
    • Related Report
      2016 Annual Research Report
  • [Presentation] 地域苦情データの現状,要望表現への分割2016

    • Author(s)
      佐野 優太, 峯 恒憲
    • Organizer
      電子情報通信学会技術研究報告-人工知能と知識処理-
    • Place of Presentation
      クアージュ湯布院
    • Related Report
      2016 Annual Research Report
  • [Presentation] Estimation of Student Performance by Considering Consecutive Lessons2015

    • Author(s)
      Shaymaa E. Sorour, Kazumasa Goda, Tsunenori Mine
    • Organizer
      Proc. of IIAI AAI ESKM
    • Place of Presentation
      Okayama Convention Center, Japan(岡山県岡山市)
    • Year and Date
      2015-07-12
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] Correlation of Grade Prediction Performance and Characteristics of Lesson Subject2015

    • Author(s)
      Shaymaa E. Sorour, Jingyi Luo, Kazumasa Goda, Tsunenori Mine
    • Organizer
      the 15th IEEE International Conference on Advanced Learning Technologies (ICALT 2015)
    • Place of Presentation
      Hualien (Taiwan)
    • Year and Date
      2015-07-06
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] Predicting Studnet Grade based on Free-style Comments using Word2Vec and ANN by Considering Prediction Results Obtained in Consecutive Lessons2015

    • Author(s)
      Jingyi Luo, Shaymaa E. Sorou, Kazumasa Goda, Tsunenori Mine
    • Organizer
      The 8th International Conference on Educational Data Mining
    • Place of Presentation
      Madrid (Spain)
    • Year and Date
      2015-06-22
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] Student Performance Estimation based on Topic Models Considering a range of Lessons2015

    • Author(s)
      Shaymaa E. Sorour, Kazumasa Goda, Tsunenori Mine
    • Organizer
      AIED 2015
    • Place of Presentation
      Madrid (Spain)
    • Year and Date
      2015-06-22
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] 再設計される (redesigned)SAT について ― 改訂の 意図と背景 ―2015

    • Author(s)
      石岡恒憲
    • Organizer
      平成27年度 全国大学入学者選抜連絡協議会
    • Place of Presentation
      東京電機大・北千住キャンパス(東京都足立区)
    • Year and Date
      2015-05-27
    • Related Report
      2015 Research-status Report
  • [Presentation] 半教師学習データにおけるRandom Forestsを用いた欠測値補完の手順について2014

    • Author(s)
      石岡恒憲
    • Organizer
      合同エージェントワークショップ&シンポジウム2014(JAWS-2014)
    • Place of Presentation
      ANA ホリデイ・イン リゾート 宮崎(宮崎県宮崎市)
    • Year and Date
      2014-10-27 – 2014-10-29
    • Related Report
      2014 Research-status Report
  • [Presentation] Predicting Students' grades based on free style Comments Data by Artificial Neural Network2014

    • Author(s)
      Shaymaa Sorour, Tsunenori Mine, Kazumasa Goda, Sachio Hirokawa
    • Organizer
      The 44th Annual Frontiers in Education (FIE) Conference
    • Place of Presentation
      Madrid, Spain
    • Year and Date
      2014-10-01 – 2014-10-05
    • Related Report
      2014 Research-status Report
  • [Presentation] Comments data mining for evaluating student's performance2014

    • Author(s)
      Shaymaa Sorour, Tsunenori Mine, Kazumasa Goda, Sachio Hirokawa
    • Organizer
      The 5th IIAI International Conference on e-Services and Knowledge Management (IIAI ESKM 2014)
    • Place of Presentation
      Kitakyushu, Fukuoka, Japan
    • Year and Date
      2014-08-31 – 2014-09-02
    • Related Report
      2014 Research-status Report
  • [Presentation] Prediction of Students' Grades based on Free-style Comments Data2014

    • Author(s)
      Shaymaa Sorour, Tsunenori Mine, Kazumasa Goda, Sachio Hirokawa
    • Organizer
      The 13th International Conference on Web-based Learning, LNCS 8613
    • Place of Presentation
      Tallinn, Estonia
    • Year and Date
      2014-08-14 – 2014-08-17
    • Related Report
      2014 Research-status Report
  • [Presentation] 全文検索による試験問題検索システム ―新規作成問題の類似文書検索を中心として―2014

    • Author(s)
      石岡恒憲,橋本貴充,大津起夫
    • Organizer
      平成26年度 全国大学入学者選抜連絡協議会
    • Place of Presentation
      アイーナ いわて県民情報交流センター(岩手県盛岡市)
    • Year and Date
      2014-05-28 – 2014-05-30
    • Related Report
      2014 Research-status Report
  • [Book] 米国におけるSATの改革と入試研究「大学入試における共通試験」2017

    • Author(s)
      石岡 恒憲(分担執筆)
    • Total Pages
      221
    • Publisher
      東北大学出版会
    • Related Report
      2016 Annual Research Report
  • [Book] テストの現代化と大学入試(繁桝算男 編「新しい時代の大学入試」,第2章)2015

    • Author(s)
      石岡 恒憲
    • Total Pages
      205
    • Publisher
      金子書房
    • Related Report
      2014 Research-status Report
  • [Remarks] Jess 日本語小論文 評価採点システム

    • URL

      http://tk2-203-11024.vs.sakura.ne.jp/jess/

    • Related Report
      2015 Research-status Report

URL: 

Published: 2014-04-04   Modified: 2018-03-22  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi