• 研究課題をさがす
  • 研究者をさがす
  • KAKENの使い方
  1. 課題ページに戻る

2023 年度 実施状況報告書

Investigating the extent to which speech rater judgement relates to objective speech measures

研究課題

研究課題/領域番号 19K00931
研究機関大阪女学院大学

研究代表者

Head Philip  大阪女学院大学, 国際・英語学部, 専任講師 (30801998)

研究分担者 山根 典子  広島大学, 総合科学研究科, 准教授 (70319391)
CLENTON JONATHAN  広島大学, 総合科学研究科, 准教授 (80762434)
研究期間 (年度) 2019-04-01 – 2025-03-31
キーワードSpeech assessment
研究実績の概要

We completed data collection. In total 347 people signed up to participate in the study and 200 completed the procedures. Results of a post-evaluation questionnaire indicated that Japanese L1 students and teachers had significantly less confidence in their ability to rate English L2 speech than other rater groups. Also, a qualitative analysis of reasons for confidence found that Japanese L1 raters were mostly confident based on their effort and ability, whereas non-Japanese L1 raters were confident due to their training and experience as teachers as well as their exposure to different English varieties. Next, an analysis of different vocabulary measures and human ratings found that human ratings are heavily influenced by the number of words produced, so basic measures of lexical density correspond more closely to human ratings than measures that control for text length. Also, different rater groups show similar correlation patterns with lexical density measures, although severity of judgment may vary between groups. Finally, looking at factors affecting ratings, a RASCH analysis followed by Linear Mixed Effects modelling indicated that English L1 raters gave significantly higher ratings than non-English L1 raters. Also, Japan-based raters gave higher scores than Canada-based raters, but there were no differences between student and teacher raters. In addition, scores were lower when the rater and the speaker had the same L1, but higher when the rater lived in a country where the speaker L1 is primarily spoken.

現在までの達成度 (区分)
現在までの達成度 (区分)

3: やや遅れている

理由

The project was slightly delayed due to difficulty recruiting sufficient numbers of Canada-based teachers to participate in the study. We now have finished collecting responses from this group and are proceeding with the final data analysis.

今後の研究の推進方策

We will complete the data analysis of our samples and submit the results to various journals for publication this year.

次年度使用額が生じた理由

The remaining funds will be used to pay assistants to help with the final data processing and analysis. Funds may also be used for journal publication and conference presentation expenses.

  • 研究成果

    (3件)

すべて 2023

すべて 学会発表 (3件) (うち国際学会 3件)

  • [学会発表] Effect of listener background on English L2 speech ratings.2023

    • 著者名/発表者名
      Head, P., & Yamane, N.
    • 学会等名
      JALT2023 Growth Mindset in Language Education. Tsukuba, Japan.
    • 国際学会
  • [学会発表] Exploring the relationship between spoken lexical diversity scores and human rater vocabulary scores.2023

    • 著者名/発表者名
      Head, P., & Myint Maw, T. M.
    • 学会等名
      The Association for Language Testing and Assessment of Australia and New Zealand (ALTAANZ) Conference 2023.
    • 国際学会
  • [学会発表] Confidence and challenges in Rating L2 speech: A comparative study of Japanese and Canadian Raters.2023

    • 著者名/発表者名
      Head, P., Yamane, N., & Clenton, J.
    • 学会等名
      The 9th Annual International Conference of the Asian Association for Language Assessment. Tokyo, Japan
    • 国際学会

URL: 

公開日: 2024-12-25  

サービス概要 検索マニュアル よくある質問 お知らせ 利用規程 科研費による研究の帰属

Powered by NII kakenhi