Concrete standard setting for contents of utterance in oral summary tasks

2023 Fiscal Year Final Research Report

• Project/Area Number: 20K13101
• Research Category: Grant-in-Aid for Early-Career Scientists
• Allocation Type: Multi-year Fund
• Review Section: Basic Section 02100:Foreign language education-related
• Research Institution: Hirosaki University
• Principal Investigator: Yokouchi Yuichiro 弘前大学, 教育推進機構, 助教 (40782800)
• Project Period (FY): 2020-04-01 – 2024-03-31
• Keywords: PDT / 妥当性 / 信頼性 / 実用性 / 波及効果 / ルーブリック評価 / パフォーマンス評価

Outline of Final Research Achievements

In this study, two rubrics were developed with the purpose of developing more effective rubrics for assessing performance on oral summary tasks. The Performance Decision Tree (PDT; Fulcher, et al., 2011) rubric format, while complicated to create, was found to be effective because it provides an extremely wide variety of feedback to students. Since the PDT can increase the number of feedback types up to the nth power of 2 when the number of items (descriptors) is n, it was determined that the performance of the PDT can be fine-tuned to the actual performance of the learner.
However, at present, the validity, reliability, practicality, and washback have not been fully examined, and only partial examination of these factors has been completed. It is recognized that additional research is needed in the future to collect comments from learners, mainly to examine the study of washback effects.

Free Research Field

言語テスティング

Academic Significance and Societal Importance of the Research Achievements

本研究の背景として，現在外国語教育のみならず，他の教科教育，人事評価，医療現場における診断など，様々な領域において評価が行われている現状においてより効果的である可能性の高いルーブリックの形式（PDT）を示すことができたことに学術的・社会的意義があるといえるだろう。
現状，公開済みの研究成果，及び現在査読中の論文では部分的なものであはあるが，PDTの有用性を示すことができた。この形式のルーブリックの有用性をさらなる研究を通じ示すと同時に，今後この形式のルーブリックを応用した教材・教科書を刊行し，学習者・指導者に使用してもらえるように努めたい。