• 研究課題をさがす
  • 研究者をさがす
  • KAKENの使い方
  1. 前のページに戻る

Investigating the extent to which speech rater judgement relates to objective speech measures

研究課題

研究課題/領域番号 19K00931
研究種目

基盤研究(C)

配分区分基金
応募区分一般
審査区分 小区分02100:外国語教育関連
研究機関大阪女学院大学 (2021-2023)
広島修道大学 (2019-2020)

研究代表者

Head Philip (Philip Head)  大阪女学院大学, 国際・英語学部, 専任講師 (30801998)

研究分担者 山根 典子  広島大学, 総合科学研究科, 准教授 (70319391)
CLENTON JONATHAN  広島大学, 総合科学研究科, 准教授 (80762434)
研究期間 (年度) 2019-04-01 – 2025-03-31
研究課題ステータス 交付 (2023年度)
配分額 *注記
4,420千円 (直接経費: 3,400千円、間接経費: 1,020千円)
2021年度: 780千円 (直接経費: 600千円、間接経費: 180千円)
2020年度: 2,080千円 (直接経費: 1,600千円、間接経費: 480千円)
2019年度: 1,560千円 (直接経費: 1,200千円、間接経費: 360千円)
キーワードSpeech assessment / speech comprehensibility / speech assessment / Speech Comprehensibility / Speech Ratings / Listener backgrounds / Gender / Vocabulary / Phonology / Assessment / Speaking / Fluency
研究開始時の研究の概要

2019 Prepare questionnaires, speech samples, and obtain rating data from Japan-based English L1 and L2 raters. Analyze speech sample phonological and lexical measures.
2020 Analysis of 2019 Japan-based data. Obtain data from English L1 and L2 raters unfamiliar with Japanese-accented English.

研究実績の概要

We completed data collection. In total 347 people signed up to participate in the study and 200 completed the procedures. Results of a post-evaluation questionnaire indicated that Japanese L1 students and teachers had significantly less confidence in their ability to rate English L2 speech than other rater groups. Also, a qualitative analysis of reasons for confidence found that Japanese L1 raters were mostly confident based on their effort and ability, whereas non-Japanese L1 raters were confident due to their training and experience as teachers as well as their exposure to different English varieties. Next, an analysis of different vocabulary measures and human ratings found that human ratings are heavily influenced by the number of words produced, so basic measures of lexical density correspond more closely to human ratings than measures that control for text length. Also, different rater groups show similar correlation patterns with lexical density measures, although severity of judgment may vary between groups. Finally, looking at factors affecting ratings, a RASCH analysis followed by Linear Mixed Effects modelling indicated that English L1 raters gave significantly higher ratings than non-English L1 raters. Also, Japan-based raters gave higher scores than Canada-based raters, but there were no differences between student and teacher raters. In addition, scores were lower when the rater and the speaker had the same L1, but higher when the rater lived in a country where the speaker L1 is primarily spoken.

現在までの達成度 (区分)
現在までの達成度 (区分)

3: やや遅れている

理由

The project was slightly delayed due to difficulty recruiting sufficient numbers of Canada-based teachers to participate in the study. We now have finished collecting responses from this group and are proceeding with the final data analysis.

今後の研究の推進方策

We will complete the data analysis of our samples and submit the results to various journals for publication this year.

報告書

(5件)
  • 2023 実施状況報告書
  • 2022 実施状況報告書
  • 2021 実施状況報告書
  • 2020 実施状況報告書
  • 2019 実施状況報告書
  • 研究成果

    (9件)

すべて 2023 2022 2021 2020 2019

すべて 雑誌論文 (1件) (うち査読あり 1件、 オープンアクセス 1件) 学会発表 (8件) (うち国際学会 5件)

  • [雑誌論文] The effect of shadowing and the ability of Japanese EFL learners to evaluate L2 English pronunciation2022

    • 著者名/発表者名
      Philip Head, Noriko Yamane
    • 雑誌名

      大阪女学院大学紀要

      巻: 18 ページ: 109-126

    • 関連する報告書
      2021 実施状況報告書
    • 査読あり / オープンアクセス
  • [学会発表] Effect of listener background on English L2 speech ratings.2023

    • 著者名/発表者名
      Head, P., & Yamane, N.
    • 学会等名
      JALT2023 Growth Mindset in Language Education. Tsukuba, Japan.
    • 関連する報告書
      2023 実施状況報告書
    • 国際学会
  • [学会発表] Exploring the relationship between spoken lexical diversity scores and human rater vocabulary scores.2023

    • 著者名/発表者名
      Head, P., & Myint Maw, T. M.
    • 学会等名
      The Association for Language Testing and Assessment of Australia and New Zealand (ALTAANZ) Conference 2023.
    • 関連する報告書
      2023 実施状況報告書
    • 国際学会
  • [学会発表] Confidence and challenges in Rating L2 speech: A comparative study of Japanese and Canadian Raters.2023

    • 著者名/発表者名
      Head, P., Yamane, N., & Clenton, J.
    • 学会等名
      The 9th Annual International Conference of the Asian Association for Language Assessment. Tokyo, Japan
    • 関連する報告書
      2023 実施状況報告書
    • 国際学会
  • [学会発表] Student Reflections on Effectiveness of Shadowing and Listening Practice2021

    • 著者名/発表者名
      Philip Head, Noriko Yamane
    • 学会等名
      Hiroshima JALT
    • 関連する報告書
      2021 実施状況報告書
  • [学会発表] Student Reflections on Effectiveness of Shadowing and Listening Practice2021

    • 著者名/発表者名
      Philip Head, Noriko Yamane
    • 学会等名
      JALT
    • 関連する報告書
      2021 実施状況報告書
    • 国際学会
  • [学会発表] Investigating the effects of listener background on L2 English speech ratings2020

    • 著者名/発表者名
      Philip Head, Noriko Yamane, Jon Clenton, & Masahiro Shinya.
    • 学会等名
      Hiroshima Vocabulary Research Group
    • 関連する報告書
      2020 実施状況報告書
  • [学会発表] The effect of shadowing on Japanese EFL speaking ability and phonological awareness2020

    • 著者名/発表者名
      Philip Head & Noriko Yamane
    • 学会等名
      Phonological Society of Japan Zoom conference
    • 関連する報告書
      2020 実施状況報告書
  • [学会発表] Comparing raters: Investigating the effects of listener background on English speech comprehensibility ratings.2019

    • 著者名/発表者名
      Philip Head, Noriko Yamane, Jon Clenton, & Masahiro Shinya.
    • 学会等名
      7th British Council New Directions in English Language Assessment Conference, Yokohama, Japan.
    • 関連する報告書
      2019 実施状況報告書
    • 国際学会

URL: 

公開日: 2019-04-18   更新日: 2024-12-25  

サービス概要 検索マニュアル よくある質問 お知らせ 利用規程 科研費による研究の帰属

Powered by NII kakenhi