• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Development of an automated essay-scoring system for task-based writing tests

Research Project

Project/Area Number 25370723
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Research Field Foreign language education
Research InstitutionMeiji Gakuin University (2015-2016)
Yamanashi Prefectural University (2013-2014)

Principal Investigator

SUGITA Yoshihito  明治学院大学, 文学部, 准教授 (70363885)

Project Period (FY) 2013-04-01 – 2017-03-31
Project Status Completed (Fiscal Year 2016)
Budget Amount *help
¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Fiscal Year 2015: ¥780,000 (Direct Cost: ¥600,000、Indirect Cost: ¥180,000)
Fiscal Year 2014: ¥260,000 (Direct Cost: ¥200,000、Indirect Cost: ¥60,000)
Fiscal Year 2013: ¥390,000 (Direct Cost: ¥300,000、Indirect Cost: ¥90,000)
Keywords教育評価・測定 / ライティング / 自動採点 / 評価タスク / 研究動向把握 / サーバー用コンピューター
Outline of Final Research Achievements

This study focused on the validity of objective rating indices to an automated essay-scoring system for task-based writing tests. The relationship between the holistic ratings of Accuracy and Communicability tasks and their objective indices was examined. Independent variables to measure the holistic ratings were chosen from existing objective indices based on the constructs of each task: organizational skills, linguistic accuracy, communicative quality and effects. As a result of the correlation analyses, a moderately high correlation was found to exist between the holistic ratings of the Accuracy task and its indices (tokens and type levels). A moderately high correlation was also found between the holistic ratings of the Communicability task and its indices (type levels and relevant ideas). Through multiple regression analysis, the scores of each task could be predicted with moderately high dimensional accuracy.

Report

(5 results)
  • 2016 Annual Research Report   Final Research Report ( PDF )
  • 2015 Research-status Report
  • 2014 Research-status Report
  • 2013 Research-status Report
  • Research Products

    (12 results)

All 2016 2015 2014 2013 Other

All Journal Article (3 results) (of which Peer Reviewed: 3 results,  Open Access: 2 results,  Acknowledgement Compliant: 1 results) Presentation (6 results) (of which Int'l Joint Research: 2 results,  Invited: 1 results) Remarks (3 results)

  • [Journal Article] Examination of objective rating indices to an automated essay-scoring system for task-based writing tests2016

    • Author(s)
      Yoshihito SUGITA
    • Journal Title

      Annual Review of English Language Education in Japan (ARELE)

      Volume: 27 Pages: 17-32

    • NAID

      130005549241

    • Related Report
      2015 Research-status Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] English teachers' perceptions of on-line rater training programs for a task-based writing performance test2014

    • Author(s)
      Yoshihito Sugita
    • Journal Title

      Proceedings of the 19th Conference of Pan-Pacific Association of Applied Linguistics

      Volume: 1 Pages: 29-30

    • Related Report
      2014 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Comparability of Accuracy and Communicability Tasks: Are They All Equally Difficult?2013

    • Author(s)
      杉田由仁
    • Journal Title

      日本言語テスト学会誌

      Volume: 16 Pages: 67-86

    • NAID

      110009767203

    • Related Report
      2013 Research-status Report
    • Peer Reviewed
  • [Presentation] Objective rating indices to automated essay-scoring systems for writing assessment2016

    • Author(s)
      Yoshihito SUGITA
    • Organizer
      50th Annual International IATEFL Conference
    • Place of Presentation
      The International Convention Centre (英国・バーミンガム)
    • Year and Date
      2016-04-14
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] Objective rating indices to automated essay-scoring system for writing assessment2016

    • Author(s)
      Yoshihito Sugita
    • Organizer
      The 50th IATEFL Annual Conference
    • Place of Presentation
      The International Convention Centre (Birmingham, UK)
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] タスクに基づくライティングテスト自動評価採点システムにおける客観的評価指標の検討2015

    • Author(s)
      杉田由仁
    • Organizer
      第40回全国英語教育学会熊本研究大会
    • Place of Presentation
      熊本学園大学 (熊本県熊本市)
    • Year and Date
      2015-08-23
    • Related Report
      2015 Research-status Report
  • [Presentation] English reachers' perceptions of on-line rater training programs for a task-based writing performance test2014

    • Author(s)
      Yoshihito Sugita
    • Organizer
      Pan-Pacific Association of Applied Linguistics
    • Place of Presentation
      早稲田大学
    • Year and Date
      2014-08-17 – 2014-08-19
    • Related Report
      2014 Research-status Report
  • [Presentation] オン・ライン評定者トレーニングに対する英語教師の評価2014

    • Author(s)
      杉田由仁
    • Organizer
      中部地区英語教育学会
    • Place of Presentation
      山梨大学
    • Year and Date
      2014-06-21 – 2014-06-22
    • Related Report
      2014 Research-status Report
  • [Presentation] ライティングテストの基本概念と評価方法2014

    • Author(s)
      杉田由仁
    • Organizer
      千葉大学教育学部英語科教育セミナー
    • Place of Presentation
      千葉大学
    • Related Report
      2013 Research-status Report
    • Invited
  • [Remarks] 明治学院大学文学部 英語教授法研究室

    • URL

      http://www.meijigakuin.ac.jp/~ysugita/homepage/

    • Related Report
      2016 Annual Research Report 2015 Research-status Report
  • [Remarks] TBWTトレーニングサイト

    • URL

      http://www2.yamanashi-ken.ac.jp/~sugita/

    • Related Report
      2014 Research-status Report
  • [Remarks] TBWT トレーニング・サイト

    • URL

      http://www2.yamanashi-ken.ac.jp/~sugita/

    • Related Report
      2013 Research-status Report

URL: 

Published: 2014-07-25   Modified: 2019-07-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi