• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

AI-based Japanese Short-answer Scoring and Support System

Research Project

Project/Area Number 17H01843
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Learning support system
Research InstitutionThe National Center for University Entrance Examinations

Principal Investigator

Ishioka Tsunenori  独立行政法人大学入試センター, 研究開発部, 教授 (80311166)

Co-Investigator(Kenkyū-buntansha) 峯 恒憲  九州大学, システム情報科学研究院, 准教授 (30243851)
宮澤 芳光  独立行政法人大学入試センター, 研究開発部, 助教 (70726166)
橋本 貴充  独立行政法人大学入試センター, 研究開発部, 准教授 (20399489)
Project Period (FY) 2017-04-01 – 2020-03-31
Project Status Completed (Fiscal Year 2019)
Budget Amount *help
¥10,010,000 (Direct Cost: ¥7,700,000、Indirect Cost: ¥2,310,000)
Fiscal Year 2019: ¥2,080,000 (Direct Cost: ¥1,600,000、Indirect Cost: ¥480,000)
Fiscal Year 2018: ¥3,770,000 (Direct Cost: ¥2,900,000、Indirect Cost: ¥870,000)
Fiscal Year 2017: ¥4,160,000 (Direct Cost: ¥3,200,000、Indirect Cost: ¥960,000)
Keywords自動採点 / 自然言語処理 / 機械学習 / 深層学習 / 情報システム / 人工知能 / CBT
Outline of Final Research Achievements

We have developed a short answer scoring and support system. To evaluate the performance of the scoring engine, we participated in the task-answering international research meeting NTCIR-13 organized by the National Institute of Informatics, and won the top performer alongside Yokohama National University among the 11 participating research institutes around the world in the question-answering sub-task. The challenge of the competition is the automatic scoring of the 500-character essay examination in the world history of the University of Tokyo Second Examination for the past five years. The results were shown in WI 2007, one of the top international conferences. After that, we worked together with Kyushu University to improve system performance. We devised a stream-type language model called Long Short-term Memory (LSTM) to improve learning accuracy. The result was announced at the joint agent workshop & symposium (JAWS2019), which is well known in Japan.

Academic Significance and Societal Importance of the Research Achievements

記述式テストはいままでの多肢選択テストに比べ、より正統あるいは真正で信頼できると広く考えられており、採点のための技術的な課題が克服されてさえいれば、これを使う潜在的な需要は計りしれない。本研究ではセンター試験など大学入試試験レベルの短答式記述試験の自動採点および人間による採点を支援する実用可能なシステムを試作・実装する。
この研究は文部科学省の高大接続部会・最終答申にある「採点業務の効率・安定化のためにコンピュータの効果的な活用」や「人工知能の利用」に位置づけられる、重要かつ極めて緊急性の高い課題である。試作システムは最先端の技術を実装し、人工知能の活用の名に値するといってよい。

Report

(4 results)
  • 2019 Annual Research Report   Final Research Report ( PDF )
  • 2018 Annual Research Report
  • 2017 Annual Research Report
  • Research Products

    (17 results)

All 2020 2019 2018 2017

All Journal Article (8 results) (of which Int'l Joint Research: 5 results,  Peer Reviewed: 6 results) Presentation (8 results) (of which Int'l Joint Research: 2 results,  Invited: 2 results) Book (1 results)

  • [Journal Article] Does Crime Activity Report Reveal Regional Characteristics?2019

    • Author(s)
      Tsunenori Mine and Sachio Hirokawa and Takahiko Suzuki
    • Journal Title

      The 13th International Conference on Ubiquitous Information Management and Communication

      Volume: IMCOM2019

    • Related Report
      2018 Annual Research Report
  • [Journal Article] AI-based Automated Japanese Short-answer Scoring and Support System2018

    • Author(s)
      Tsunenori Ishioka and Masayuki Kameda
    • Journal Title

      International Conference on Pattern Recognition and Artificial Intelligence

      Volume: ICPRAI 2018 Pages: 138-143

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] 地域問題レポートに対する担当課推定手法の提案2018

    • Author(s)
      山口 晃平,峯 恒憲
    • Journal Title

      電子情報通信学会論文誌:特集号「ソフトウェアエージェ ントとその応用」

      Volume: Vol.J101-D, No.9 Pages: 1334-1342

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Predicting if students will pursue a STEM career using School-Aggregated Data from their usage of an Intelligent Tutoring System2018

    • Author(s)
      Jihed Makhlouf and Tsunenori Mine
    • Journal Title

      EDM 2018 poster

      Volume: EDM 2018 Pages: 533-536

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Is SVM+FS better to satisfy Decision by Majority ?2018

    • Author(s)
      Yao Lin, Kohei Yamaguchi, Tsunenori Mine, Sachio Hirokawa
    • Journal Title

      The 3rd International Conference on Soft Computing and Data Mining 2018

      Volume: SCDM 2018 Pages: 261-271

    • DOI

      10.1007/978-3-319-72550-5_26

    • ISBN
      9783319725499, 9783319725505
    • Related Report
      2017 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Overwritable automated japanese short-answer scoring and support system2017

    • Author(s)
      Ishioka Tsunenori、Kameda Masayuki
    • Journal Title

      The IEEE/WIC/ACM International Conference on Web Intelligence,

      Volume: WI 2017 Pages: 50-56

    • DOI

      10.1145/3106426.3106513

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Rubric-based Automated Japanese Short-answer Scoring and Support System Applied to QALab-32017

    • Author(s)
      Tsunenori Ishioka, Kohei Yamaguchi, Tsuneori Mine
    • Journal Title

      Proceedings of the 13th NTCIR Confereof Information Access Technologiesnce on Evaluation

      Volume: NTCIR 13 Pages: 152-158

    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Journal Article] Machine Learning is better than Human to satisfy Decision by Majority2017

    • Author(s)
      Sachio Hirokawa, Takahiko Suzuki, Tsunenori Mine
    • Journal Title

      The IEEE/WIC/ACM International Conference on Web Intelligence

      Volume: WI 2017 Pages: 694-701

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Presentation] 短答式試験における自動採点のための品詞別ノイズ付与手法の提案2019

    • Author(s)
      加藤博之, 石岡恒憲, 峯恒憲
    • Organizer
      合同エージェントワークショップ&シンポジウム 2019 (JAWS2019)
    • Related Report
      2019 Annual Research Report
  • [Presentation] Investigating Reading Behaviors within Student Reading Sessions to Predict their Performance2019

    • Author(s)
      Jihed Makhlouf and Tsunenori Mine
    • Organizer
      International Workshop on Predicting Performance Based on the Analysis of Reading Behavior:A Data Challenge 2019
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] エッセイおよび論述解答試験採点に関する最近の話題と自動採点にむけた現在の技術水準2018

    • Author(s)
      石岡恒憲, 劉東岳, 峯恒憲
    • Organizer
      日本テスト学会第16回大会
    • Related Report
      2018 Annual Research Report
  • [Presentation] Investigating How School-Aggregated Data Can Influence in Predict2018

    • Author(s)
      Jihed Makhlouf and Tsunenori Mine
    • Organizer
      EDM 2018 Workshop on Scientific Findings from the ASSISTments Longitudinal Data
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 警察の犯罪レポートメールに基づく地域の識別2018

    • Author(s)
      峯 恒憲,廣川 佐千男,鈴木 孝彦
    • Organizer
      合同エージェントワークショップ&シンポジウム2018
    • Related Report
      2018 Annual Research Report
  • [Presentation] 人工知能を利用した記述採点支援システム2017

    • Author(s)
      石岡 恒憲
    • Organizer
      高校教科「情報」シンポジウム2017秋, 情報処理学会
    • Related Report
      2017 Annual Research Report
    • Invited
  • [Presentation] 記述解答採点におけるAI応用の現状と将来2017

    • Author(s)
      石岡 恒憲
    • Organizer
      ICT CONNECT 21
    • Related Report
      2017 Annual Research Report
    • Invited
  • [Presentation] 地域問題レポートに対する担当課の自動推定2017

    • Author(s)
      山口 晃平, 峯 恒憲
    • Organizer
      合同エージェントワークショップ&シンポジウム 2017(JAWS2017)
    • Related Report
      2017 Annual Research Report
  • [Book] 自動採点研究のこれから(分担執筆)「外国語教育研究における自動採点の現状と課題」2020

    • Author(s)
      石岡恒憲
    • Publisher
      ひつじ書房
    • Related Report
      2019 Annual Research Report

URL: 

Published: 2017-04-28   Modified: 2021-02-19  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi