• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

An Implementation of Automated Japanese Essay Scoring System

Research Project

Project/Area Number 16500628
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field Educational technology
Research InstitutionThe National Center for University Entrance Examinations

Principal Investigator

ISHIOKA Tsunneori  The National Center for University Entrance Examinations, Reseach Division, Associated Professor, 助教授 (80311166)

Co-Investigator(Kenkyū-buntansha) IKUTA Kazushige  Tokushima Bunri University, Literature, Professor, 文学部, 教授 (60289311)
INOUE Tatsuki  Weseda University, Asia-Pacific Studies, Lecturer, アジア太平洋研究科, 講師 (60298065)
Project Period (FY) 2004 – 2006
Project Status Completed (Fiscal Year 2006)
Budget Amount *help
¥2,200,000 (Direct Cost: ¥2,200,000)
Fiscal Year 2006: ¥800,000 (Direct Cost: ¥800,000)
Fiscal Year 2005: ¥500,000 (Direct Cost: ¥500,000)
Fiscal Year 2004: ¥900,000 (Direct Cost: ¥900,000)
Keywordsessay / essay evaluation / natural Language processing / outlier detection / statistical approach / 外れ値検出
Research Abstract

We have developed an automated Japanese essay scoring system called Jess. The system needs expert writings rather than expert raters to build the evaluation model. By detecting statistical outliers of predetermined aimed essay features compared with many professional writings for each prompt, our system can evaluate essays. The following three features are examined : (1) rhetoric -- syntactic variety, or the use of various structures in the arrangement of phases, clauses, and sentences, (2) organization -- characteristics associated with the orderly presentation of ideas, such as rhetorical features and linguistic cues, and (3) content -- vocabulary related to the topic, such as relevant information and precise or specialized vocabulary. The final evaluation score is calculated by deducting from a perfect score assigned by a learning process using editorials and columns from the Mainichi Daily News newspaper. A diagnosis for the essay is also given.
In this research, we have done followings :
1. Jess has been public on the Web at http://coca.rd.dnc.ac.jp/jess/.
The system is valid for essays of 800 to 1,600 characters ; the program is written in C shell script, jgawk, jsed, and C, and comes to just under 10,000 lines.
2. We investigated the criteria given for scoring essays by statistical approaches, and have revised the model. Better criteria have been adopted.
3. We ported the system of Linux to Windows. In closed environment, the data information such as posted essay and its score are not leaked out of networks.

Report

(4 results)
  • 2006 Annual Research Report   Final Research Report Summary
  • 2005 Annual Research Report
  • 2004 Annual Research Report
  • Research Products

    (24 results)

All 2006 2005 2004 2002

All Journal Article (20 results) Patent(Industrial Property Rights) (4 results)

  • [Journal Article] Automated Japanese Essay Scoring System based on Articles Written by Experts2006

    • Author(s)
      Ishioka, T., Kameda, M
    • Journal Title

      Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics

      Pages: 233-240

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Statistical Analysis of Letters to Newspaper Written by Students in Literature Department2006

    • Author(s)
      Ikuta, K., Ishioka, T.
    • Journal Title

      Educ. Technol. Res. 29

      Pages: 37-46

    • NAID

      110002983353

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Annual Research Report 2006 Final Research Report Summary
  • [Journal Article] Statistical Analysis of Letters to Newspaper Written by Students in Literature Department2006

    • Author(s)
      Ikuta, K., Ishioka, T.
    • Journal Title

      Educ. Technol. Res. Vol.29

    • NAID

      110002983353

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Automated Japanese Essay Scoring System based on Articles Written by Experts2006

    • Author(s)
      Ishioka, T., Kameda, M.
    • Journal Title

      Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics

      Pages: 233-240

    • Related Report
      2006 Annual Research Report
  • [Journal Article] x-means法改良の一提案-k-means法の逐次繰り返しとクラスターの再併合-2006

    • Author(s)
      石岡 恒憲
    • Journal Title

      計算機統計学 第18巻1号

      Pages: 1-11

    • NAID

      110004818389

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 論文/エッセイの自動採点システム-過去,現在,そして未来-2006

    • Author(s)
      石岡 恒憲
    • Journal Title

      大学入試研究ジャーナル 第16号

    • Related Report
      2005 Annual Research Report
  • [Journal Article] An Expansion of X-means for Automatically Determining the Optimal Number of Clusters2005

    • Author(s)
      Ishioka, T
    • Journal Title

      The Fourth IASTED International Conference on Computational Intelligence (CI 2005), Calgary Canada

      Pages: 91-96

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] x-means法改良の一提案-k-means法の逐次繰り返しとクラスターの再併合-2005

    • Author(s)
      石岡 恒憲
    • Journal Title

      計算機統計学 第18巻1号

      Pages: 3-13

    • NAID

      110004818389

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] 文科系学生が作成した投稿文の統計的分析2005

    • Author(s)
      生田和重, 石岡 恒憲
    • Journal Title

      日本教育工学会論文誌 第29巻1号

      Pages: 34-42

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] 論文/エッセイの自動採点システム-過去,現在,そして未来-2005

    • Author(s)
      石岡 恒憲
    • Journal Title

      大学入試研究ジャーナル 第16号

      Pages: 41-48

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] 文科系学生が作成した投稿文の統計的分析2005

    • Author(s)
      生田和重, 石岡恒憲
    • Journal Title

      日本教育工学会論文誌 29・1

      Pages: 35-42

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary 2004 Annual Research Report
  • [Journal Article] An Expansion of X-means for Automatically Determining the Optimal Number of Clusters2005

    • Author(s)
      Ishioka, T.
    • Journal Title

      The Fourth TASTED International Conference on Computational Intelligence (CI 2005) (Calgary Canada)

      Pages: 91-96

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] An Expansion of X-means for Automatically Determining the Optimal Number of Clusters2005

    • Author(s)
      Ishioka, T
    • Journal Title

      The Fourth IASTED International Conference on Computational Intelligence (CI 2005), Calgary Canada, July 4-6

      Pages: 91-96

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 文科系学生が作成した投稿文の統計的分析2005

    • Author(s)
      生田和重, 石岡 恒憲
    • Journal Title

      日本教育工学会論文誌 第29巻,第1号

      Pages: 34-42

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Automated Japanese Essay Scoring System : Jess2004

    • Author(s)
      Ishioka, T., Kameda, M
    • Journal Title

      Proceeding of DEXA 2004 (15th International Conference on Database and Expert Systems Applications)

      Pages: 4-8

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary 2004 Annual Research Report
  • [Journal Article] Evaluation of Criteria for Information Retrieval2004

    • Author(s)
      Ishioka, T.
    • Journal Title

      System and Computers in Japan, Wiley Vol.35,No.6

      Pages: 42-49

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] 記述式テストにおける自動採点システムの最新動向2004

    • Author(s)
      石岡 恒憲
    • Journal Title

      行動計量学 31・2

      Pages: 67-87

    • NAID

      110003812951

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Evaluation of Criteria for Information Retrieval2004

    • Author(s)
      Ishioka, T.
    • Journal Title

      System and Computers in Japan, Wiley Vol.35, No.6

      Pages: 42-49

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Evaluation of Criteria for Information Retrieval2004

    • Author(s)
      Ishioka, T
    • Journal Title

      System and Computers in Japan, Wiley Vol.35, No.6

      Pages: 42-49

    • Related Report
      2004 Annual Research Report
  • [Journal Article] 記述式テストにおける自動採点システムの最新動向2004

    • Author(s)
      石岡恒憲
    • Journal Title

      行動計量学 31・2

      Pages: 67-87

    • NAID

      110003812951

    • Related Report
      2004 Annual Research Report
  • [Patent(Industrial Property Rights)] 商標:JESS2005

    • Industrial Property Rights Holder
      石岡恒憲
    • Filing Date
      2005-09-29
    • Acquisition Date
      2006-06-09
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Patent(Industrial Property Rights)] 特許:文章評価採点装置、プログラム及び記憶媒体2005

    • Inventor(s)
      石岡恒憲, 亀田雅之
    • Industrial Property Rights Holder
      株式会社リコー
    • Filing Date
      2005-09-29
    • Acquisition Date
      2006-06-09
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Patent(Industrial Property Rights)] 商標 : JESS2005

    • Industrial Property Rights Holder
      石岡恒憲
    • Filing Date
      2005-09-29
    • Acquisition Date
      2006-06-09
    • Related Report
      2006 Annual Research Report
  • [Patent(Industrial Property Rights)] 文章評価採点装置、プログラム及び記憶媒体2002

    • Inventor(s)
      石岡 恒憲, 亀田 雅之
    • Industrial Property Rights Holder
      株式会社リコー
    • Patent Publication Number
      2004-151757
    • Filing Date
      2002-10-28
    • Acquisition Date
      2004-05-27
    • Related Report
      2005 Annual Research Report

URL: 

Published: 2004-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi