Developing online system to help users reflect upon their rating tendency on speaking skills

2018 Fiscal Year Final Research Report

• Project/Area Number: 26381206
• Research Category: Grant-in-Aid for Scientific Research (C)
• Allocation Type: Multi-year Fund
• Section: 一般
• Research Field: Education on school subjects and activities
• Research Institution: Shimane University
• Principal Investigator: Nekoda Hidenobu 島根大学, 学術研究院教育学系, 准教授 (80452598)
• Project Period (FY): 2014-04-01 – 2019-03-31
• Keywords: スピーキング評価

Outline of Final Research Achievements

This study discusses a new online system that allows Japanese teachers of English (JTEs) to reflect on their internal speaking assessment criteria. The user (an English teacher) watches three movie clips of student speaking performances and then rates them using one or more scales on vocabulary, accuracy, fluency, and pronunciation. The system then employs the Many-facet Rasch Measurement (MFRM) to immediately analyze the user ratings by accessing a database developed from JTE mass speech sample ratings data (approximately 7,500 ratings). Sixteen English teacher trainees were tentatively analyzed using both the new system and FACETS (an MFRM statistical software), and the results were compared. It was confirmed that the newly developed system was able to accurately detect any deviations in the user ratings.

Free Research Field

言語テスト

Academic Significance and Societal Importance of the Research Achievements

社会的意義：2020年度から実施される大学入学共通テストや、2019年度から3年ごとに全国の中学校で実施される外国語科（英語）の全国学力調査において4技能型の試験が導入され（てい）る。これを踏まえ、評価基準などに基づくスピーキングの評価に対する英語教員の意識を高め、自身の評価の妥当性について内省を促すことを目指す。
学術的意義：先行研究からも，評定者の特性によりスピーキングに対する評価の傾向が異なる可能性が示唆されている。本研究が開発したオンライン評価システムを活用することで、多様な評価者による評価データの収集・分析が容易になることは確実であり、今後の研究の発展につながる。