Development of a task-based writing performance test and comprehensive assessment of the usability

• Project/Area Number: 22520572
• Research Category: Grant-in-Aid for Scientific Research (C)
• Allocation Type: Single-year Grants
• Section: 一般
• Research Field: Foreign language education
• Research Institution: Yamanashi Prefectural University
• Principal Investigator: SUGITA Yoshihito 山梨県立大学, 看護学部, 准教授 (70363885)
• Project Period (FY): 2010 – 2012
• Project Status: Completed (Fiscal Year 2012)
• Budget Amount: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000); Fiscal Year 2012: ¥650,000 (Direct Cost: ¥500,000、Indirect Cost: ¥150,000); Fiscal Year 2011: ¥390,000 (Direct Cost: ¥300,000、Indirect Cost: ¥90,000); Fiscal Year 2010: ¥520,000 (Direct Cost: ¥400,000、Indirect Cost: ¥120,000)
• Keywords: 教育評価・測定 / ライティング / 評価タスク / タスク・タイプ / 平行形式信頼性 / 評価行動 / 評定トレーニング / タスクの困難さ / FACETS / 信頼性 / 妥当性

Research Abstract

The overriding positive contribution of this research is as follows:
(a) a clear definition of the writing abilities to be assessed in performance assessment was established
(b) how to develop the task-based writing performance test that has Japanese educational applications was clarified
and (c) the writing performance test confirmed usability to some extent through investigating reliability and construct validity. All of them can contribute to the effective writing assessment in the classroom in Japan and to improvements in teaching writing as its washback.

Research Products

• [Journal Article] Comparability of accuracy and communicability tasks: Are they all equally difficult? (2012)
  • Author(s): Yoshihito Sugita
  • Journal Title: Proceedings of the 17th Conference of Pan-Pacific Association of Applied Linguistics Pages: 81-82
  • NAID: 110009767203
  • Peer Reviewed
• [Journal Article] The effects of rater training on raters'severity, consistency, and biased interactions in a task-based writing assessment (2012)
  • Author(s): Yoshihito Sugita
  • Journal Title: 日本言語テスト学会誌 Volume: 第15号 Pages: 61-80
  • Peer Reviewed
• [Journal Article] ライティング評価における評定者の行動分析と評価基準の妥当性検証 (2012)
  • Author(s): 杉田由仁
  • Journal Title: JACET 関東支部学会誌 Pages: 14-26
  • NAID: 110009561370
  • Peer Reviewed
• [Journal Article] The effects of rater training on raters’severity, consistency, and biased interactions in a task-based writing assessment (2012)
  • Author(s): Yoshihito Sugita
  • Journal Title: 日本言語テスト学会誌 Volume: 15 Pages: 61-80
• [Journal Article] Comparability of accuracy and communicability tasks: Are they all equally difficult? (2012)
  • Author(s): Yoshihito Sugita
  • Journal Title: Proceedings of the 17th Conference of Pan-Pacific Association of Applied Linguistics, Volume: 17 Pages: 81-82
  • NAID: 110009767203
• [Journal Article] ライティング評価における評定者の行動分析と評価基準の妥当性検証 (2012)
  • Author(s): 杉田由仁
  • Journal Title: JACET関東支部学会誌(JACET-KANTO Journal) Volume: 8 Pages: 14-26
  • NAID: 110009561370
  • Peer Reviewed
• [Journal Article] Differences in raters'severity, consistency, and biased interactions between trained and untrained raters (2011)
  • Author(s): Yoshihito Sugita
  • Journal Title: Proceedings of the 16th Conference of Pan-Pacific Association of Applied Linguistics Pages: 73-78
  • Peer Reviewed
• [Journal Article] Differences in raters' severity, consistency and biased interactions between trained and untrained raters (2011)
  • Author(s): Yoshihito Sugita
  • Journal Title: Proceedings of The 16th Conference of Pan-Pacific Association of Applied Linguistics Pages: 171-176
• [Journal Article] Reliability and validity of a task-based writing performance assessment for Japanese learners of English (2010)
  • Author(s): Yoshihito Sugita
  • Journal Title: 日本言語テスト学会誌 Volume: 第13号 Pages: 21-40
  • NAID: 110009561395
  • Peer Reviewed
• [Journal Article] Reliability and validity of a task-based writing performance assessment for Japanese learners of English (2010)
  • Author(s): Yoshihito SUGITA
  • Journal Title: 日本言語テスト学会紀要(JLTA Journal) Volume: 13 Pages: 21-40
  • NAID: 110009561395
  • Peer Reviewed
• [Presentation] Comparability of accuracy and communicability tasks: Are they all equally difficult? (2012)
  • Author(s): Yoshihito Sugita
  • Organizer: The 17th Conference of PAAL
  • Place of Presentation: 北京・中国
  • Year and Date: 2012-08-22
• [Presentation] Comparability of accuracy and communicability tasks: Are they all equally difficult? (2012)
  • Author(s): Yoshihito Sugita
  • Organizer: The 17th Conference of Pan-Pacific Association of Applied Linguistics
  • Place of Presentation: 北京文津国際ホテル(中国)
• [Presentation] Differences in raters' severity, consistency and biased interactions between trained and untrained raters (2011)
  • Author(s): Yoshihito Sugita
  • Organizer: The 16th Conference of Pan-Pacific Association of Applied Linguistics
  • Place of Presentation: 香港中文大学(中国)
  • Year and Date: 2011-08-10
• [Presentation] Differences in raters'severity, consistence, and biased interactions between trained and untrained raters (2011)
  • Author(s): Yoshihito Sugita
  • Organizer: The 16th Conference of PAAL
  • Place of Presentation: 香港・中国
  • Year and Date: 2011-08-09
• [Presentation] ライティング評価における評定者の行動分析と評価基準の妥当性検証 (2011)
  • Author(s): 杉田由仁
  • Organizer: 第5回大学英語教育学会・関東支部大会
  • Place of Presentation: 大東文化大学
  • Year and Date: 2011-06-26
• [Presentation] ライティング評価における評定者の行動分析と評価基準の妥当性検証 (2011)
  • Author(s): 杉田由仁
  • Organizer: 第5回大学英語教育学会・関東支部大会
  • Place of Presentation: 大東文化大学(東京)
  • Year and Date: 2011-06-26
• [Presentation] Reliability and validity of a task-based writing performance assessment of L2 writing (2010)
  • Author(s): Yoshihito Sugita
  • Organizer: The 44th Annual Conference of IATEFL
  • Place of Presentation: ハロゲイト, 英国
  • Year and Date: 2010-04-11
• [Presentation] Reliability and validity of a task-based writing performance assessment of L2 writing (2010)
  • Author(s): Yoshihito SUGITA
  • Organizer: The 44^<th> Annual Conference of IATEFL
  • Place of Presentation: イギリス(ハロゲイト)
  • Year and Date: 2010-04-11
• [Book] 日本人学習者のためのタスクによるライティング評価法-構成概念に基づく言語処理的テスト法- (2013)
  • Author(s): 杉田由仁
  • Total Pages: 232
  • Publisher: 大学教育出版
• [Book] 日本人学習者のためのタスクによるライティング評価法―構成概念に基づく言語処理的テスト法― (2013)
  • Author(s): 杉田由仁
  • Total Pages: 210
  • Publisher: 大学教育出版
• [Remarks]
  • URL: http://homepage3.nifty.com/~sugita/index.html
• [Remarks] 山梨県立大学看護学部 杉田研究室
  • URL: http://homepage3.nifty.com/~sugita/index.html
• [Remarks]
  • URL: http://homepage3.nifty.com/~sugita/index.html
• [Remarks]
  • URL: http://homepage3.nifty.com/~sugita/index.html