音響・調音データベースに基づくバイオフィードバックによる英文リズム学習方法の開発

2014 Fiscal Year Research-status Report

• Project/Area Number: 25370444
• Research Institution: Kanazawa Medical University
• Principal Investigator: 澁谷 良穂 金沢医科大学, 一般教育機構, 教授 (90154260)
• Co-Investigator(Kenkyū-buntansha): ERICKSON Donna 金沢医科大学, 一般教育機構, 非常勤講師 (80331586) ; WILSON Ian 会津大学, コンピュータ理工学部語学研究センター, 教授 (50444930) ; 末光 厚夫 北陸先端科学技術大学院大学, 情報科学研究科, 助教 (20422199)
• Project Period (FY): 2013-04-01 – 2016-03-31
• Keywords: English rhythm / Japanese phrasal stress / Mandarin phrasal stress / L2 learning / Jaw displacement / articulation / C/D model / Formants

Outline of Annual Research Achievements

Japanese has phrasal stress, which is manifested in terms of increased jaw displacement; pitch accent, which is manifested in terms of changes in fundamental frequency (laryngeal vibration patterns) are independent from phrasal stress, which is manifested by changes in jaw displacement and corresponding acoustic changes due to changes in the vocal tract shape, especially changes in the first formant resonating frequencies (F1). In Japanese, we see phrasal stress at the beginning and end of phrases (Kawahara et al. 2014). For English phrasal stress (rhythm), on the other hand, patterns of jaw displacement reflect the metrical patterning of strong and weak syllables in English phrases. Since these metrical stress patterns of English are different from those of Japanese, beginning and intermediate Japanese speakers of English tend to transfer their native stress patterns to spoken English; specifically, we see final phrasal stress even in cases where native speakers of English do not put final phrasal stress (Erickson et al. 2014).
In additional, new work this year has been looking at phrasal stress patterns in Mandarin Chinese. Here also we see patterns of jaw displacement reflecting the linguistic phrasal patterns (Erickson et al. 2015).
Also this year we have applied our findings about rhythm and jaw displacement patterns to implementing and developing an articulatory model of speech production, specifically, the C/D Model (Kim et al., 2014, Erickson, Kawahara, and Menezes et al. 2014b, Erickson, Kawahara, Williams et al. 2014, Erickson, Kawahara, Moore et al. 2014).

Current Status of Research Progress

2: Research has progressed on the whole more than it was originally planned.

Reason

The goal of the three year grant was to examine how Japanese and Chinse second language learners of English produce the rhythm patterns of spoken English. The working hypothesis is that jaw displacement patterns form the underlying articulatory framework for spoken rhythm. In year 1, we examined Japanese L1 and L2 jaw displacement patterns of rhythm; in year 2, we examined Chinese L1 and L2 jaw displacement patterns of rhythm. In year 3, our final year, we are working on developing an application to help Japanese and Chinese L2 speakers of English modify their jaw displacement patterns, and thereby improve their L2 (English) rhythm patterns.

Strategy for Future Research Activity

1.We will continue recording and analyzing Mandarin Chinese speakers of jaw displacement to see to what extent these patterns reflect Mandarin Chinese stress patterns, and how these L1 patterns affect their L2 (English) rhythm.
2.In order to help both Japanese and Chinese L2 English speakers improve their spoken English rhythm, we are working with Professors Wilson and Yaguchi at the University of Aizu to develop a software application to aid second language learners modify their jaw displacement patterns, and thus improve their ability to communicate effectively in English.

Causes of Carryover

今年度は研究代表者、分担者の本務の日程の関係で、予定していた実験の一部が実施できなかったことが最も大きな理由である。また、学会発表の際、同行する予定の分担者が参加できなかったため。

Expenditure Plan for Carryover Budget

次年度は研究最終年度にあたることから、当初予定していた実験をすべて行う予定である。また、学会発表も積極的に行う予定をしている。

Remarks

A open discussion about the C/D model: how it accounts for prominence and phrasing patterns, and its application to second language acquisition, especially, spoken rhythm.

Research Products

• [Journal Article] Quantifying the effects of vowel quality and preceding consonants on jaw displacement: Japanese data (2014)
  • Author(s): Kawahara, S., Masuda, H., Erickson, D., Moore, J., Suemitsu, A., Shibuya, Y.
  • Journal Title: Journal of Phonetic Society of Japan Volume: 18 Pages: 54-62
  • Peer Reviewed / Acknowledgement Compliant
• [Journal Article] Jaw displacement and metrical structure in Japanese: The effect of pitch accent, foot structure, and phrasal stress (2014)
  • Author(s): Kawahara, S., Erickson, D., Moore, J., Suemitsu, A., Shibuya, Y.
  • Journal Title: Journal of Phonetic Society of Japan Volume: 18 Pages: 77-87
  • Peer Reviewed / Acknowledgement Compliant
• [Journal Article] Comparison of jaw displacement patterns of Japanese and American speakers of English: A preliminary report. (2014)
  • Author(s): Erickson, D., Kawahara, S., Shibuya, Y., Suemitsu, A., and Tiede, M.
  • Journal Title: Journal of Phonetic Society of Japan Volume: 18 Pages: 88-94
  • Peer Reviewed / Acknowledgement Compliant
• [Journal Article] Acoustic correlates of English rhythmic patterns for American vs. Japanese speakers. (2014)
  • Author(s): Mori, Y., Hori, T., and Erickson, D.
  • Journal Title: Phonetica Volume: 71 Pages: 83-108
  • Peer Reviewed / Acknowledgement Compliant
• [Journal Article] A study of invariant properties and variation patterns in the converter/distributor model for emotional speech (2014)
  • Author(s): Kim, J., Erickson, D., Lee, S., Narayanan, S.
  • Journal Title: Proceedings of Interspeech Volume: 1 Pages: 413-417
  • Peer Reviewed / Acknowledgement Compliant
• [Journal Article] Metrical structure and jaw displacement: An exploration (2014)
  • Author(s): Erickson, D., Kawahara, S., Williams, J.C., Moore, J., Suemitsu, A., and Shibuya, Y.
  • Journal Title: Proceedings of Speech Prosody 2014 Volume: 1 Pages: 00-303
  • Peer Reviewed / Acknowledgement Compliant
• [Journal Article] Calculating articulatory syllable duration and phrase boundaries (2014)
  • Author(s): Erickson, D., Kawahara, S., Moore, J., Menezes, C. Suemitsu, A., Kim, J. and Shibuya, Y.
  • Journal Title: Proceedings of International Seminar on Speech Processing Volume: 1 Pages: 102-105
  • Peer Reviewed / Acknowledgement Compliant
• [Journal Article] Tongue width at rest versus tongue width during speech: A comparison of native and non-native speakers (2014)
  • Author(s): Kanada, S. & I. Wilson
  • Journal Title: Journal of the Acoustical Society of America Volume: 136 Pages: 2143
  • DOI: 10.1121/1.4899734
  • Acknowledgement Compliant
• [Journal Article] Pre-speech postures of second-language versus first-language speakers [母語・非母語話者における発話直前の舌形状] (2014)
  • Author(s): Wilson, I. & S. Kanada
  • Journal Title: Journal of the Phonetic Society of Japan [音声研究] Volume: 18 Pages: 106-109
  • Peer Reviewed / Acknowledgement Compliant
• [Presentation] Syllable triangles, syllable centers, articulatory syllable durations, shadow angles, oh my ! (2015)
  • Author(s): Erickson, D.
  • Organizer: GIPSA Labs research meeting
  • Place of Presentation: University of Grenoble, Grenoble, France
  • Year and Date: 2015-03-09 – 2015-03-09
• [Presentation] The jaw keeps the beat: Speech rhythm in English, Japanese and Mandarin (2015)
  • Author(s): Erickson, D., Iwata, R., Moore,J., Suemitsu, A., Shibuya, Y.
  • Organizer: NINJAL
  • Place of Presentation: 国立国語研究所（東京都・立川市）
  • Year and Date: 2015-02-01 – 2015-02-01
• [Presentation] Jaw displacement patterns as articulatory correlates of metrical structure (2014)
  • Author(s): Erickson, D., Kawahara, S., Wilson, I., Menezes, C., Suemitsu, A., Shibuya, Y., Moore, J.
  • Organizer: Phonetic Building Blocks of Speech, in Honor of John Esling
  • Place of Presentation: University of Victoria, Victoria, B.C., Canada
  • Year and Date: 2014-09-18 – 2014-09-21
• [Presentation] A study of invariant properties and variation patterns in the converter/distributor model for emotional speech (2014)
  • Author(s): Kim, J., Erickson, D., Lee, S., Narayanan, S.
  • Organizer: Interspeech 2014
  • Place of Presentation: Singapore (Singapore)
  • Year and Date: 2014-09-14 – 2014-09-18
• [Presentation] 調音フィードバックシステムによる発音訓練後の学習効果の持続性についての検討 (2014)
  • Author(s): 末光厚夫，党建武, 伊藤貴之, Tiede Mark
  • Organizer: 日本音響学会平成26年秋季研究発表会
  • Place of Presentation: 北海学園大学（北海道・札幌市）
  • Year and Date: 2014-09-03 – 2014-09-05
• [Presentation] Metrical structure and the C/D model (2014)
  • Author(s): Erickson, D., Kawahara, S., Menezes, C., Moore, J., Kim, J., Suemitsu, A., Shibuya, Y.
  • Organizer: Adventures in Speech Science Workshop in Honor of Osamu Fujimura
  • Place of Presentation: 東京大学（東京都・文京区）
  • Year and Date: 2014-07-22 – 2014-07-23
• [Presentation] The C/D model and emotional speech: preliminary findings (2014)
  • Author(s): Kim, J., Lee, S., Erickson, D., and Narayanan, S.
  • Organizer: Adventures in Speech Science Workshop in Honor of Osamu Fujimura
  • Place of Presentation: 東京大学（東京都・文京区）
  • Year and Date: 2014-07-22 – 2014-07-23
• [Presentation] Metrical structure and jaw displacement: An exploration. (2014)
  • Author(s): Erickson, D., Kawahara, S., Williams, J.C., Moore, J., Suemitsu, A., and Shibuya, Y.
  • Organizer: Speech Prosody
  • Place of Presentation: Dublin, Ireland
  • Year and Date: 2014-05-20 – 2014-05-23
• [Presentation] Calculating articulatory syllable duration and phrase boundaries (2014)
  • Author(s): Erickson, D., Kawahara, S., Moore, J., Menezes, C. Suemitsu, A., Kim, J. and Shibuya, Y.
  • Organizer: International Symposium on Speech Processing
  • Place of Presentation: Cologne, Germany
  • Year and Date: 2014-05-05 – 2014-05-08
• [Remarks] The C/D model forum
  • URL: www.cdmodel.wordpress.com