Exploration of methods of teaching English rhythm based on Acoustic and articulatory biofeedback

• Project/Area Number: 25370444
• Research Category: Grant-in-Aid for Scientific Research (C)
• Allocation Type: Multi-year Fund
• Section: 一般
• Research Field: Linguistics
• Research Institution: Kanazawa Medical University
• Principal Investigator: Shibuya Yoshiho 金沢医科大学, 一般教育機構, 教授 (90154260)
• Co-Investigator(Kenkyū-buntansha): ERICKSON Donna 金沢医科大学, 一般教育機構, 非常勤講師 (80331586) ; WILSON Ian 会津大学, コンピュータ理工学部, 教授 (50444930) ; SUEMITSU Atsuo 北陸先端科学技術大学院大学, 情報科学研究科, 助教 (20422199)
• Project Period (FY): 2013-04-01 – 2016-03-31
• Project Status: Completed (Fiscal Year 2015)
• Budget Amount: ¥4,810,000 (Direct Cost: ¥3,700,000、Indirect Cost: ¥1,110,000); Fiscal Year 2015: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000); Fiscal Year 2014: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000); Fiscal Year 2013: ¥1,820,000 (Direct Cost: ¥1,400,000、Indirect Cost: ¥420,000)
• Keywords: language rhythm / Teaching / English / Japanese / Chinese / articulation / jaw / F1 / Teaching English / Language Rhythm / Acoustics / Articulation / Biofeedback / English rhythm / Japanese phrasal stress / Mandarin phrasal stress / L2 learning / Jaw displacement / C/D model / Formants / 音声学 / 第二言語習得 / ＥＭＡ / 国際情報交換 アメリカ

Outline of Final Research Achievements

We explored acoustic/articulatory characteristics of language rhythm, to better understand how to give effective feedback to learners of English as a second language. We examined articulatory jaw displacement patterns of Japanese and Chinese utterances, and how these differ from those of English. We reported that the rhythmical organization of each of these languages is such that speakers use the jaw (mouth) to provide a basic underlying rhythmic structure of their language, as they produce each syllable in the utterance. Japanese and Chinese, for instance, tend to have increased syllable stress (implemented by increased jaw opening), at the end of phrases/ utterances, and maybe also at the beginning of phrases, while English has a hierarchical organization such that each syllable has a specific value of stress. For learning a second language, it is important to “retrain” articulatory mechanisms to produce the rhythmic pattern of the second language.

Research Products

• [Int'l Joint Research] University of Southern Californai/University of Arizona/University of Toledo, Toledo, Ohio(米国)
• [Int'l Joint Research] University of Bordeaux/LIMSI (orsay)/University of Grenoble(France)
• [Journal Article] Articulatory correlates of metrical structure: Studying jaw displacement patterns (2016)
  • Author(s): Erickson, D. and Kawahara, S.
  • Journal Title: Linguistic Vanguard Volume: 2 Issue: 1 Pages: 1-16
  • DOI: 10.1515/lingvan-2015-0025
  • Peer Reviewed / Open Access / Int'l Joint Research
• [Journal Article] Edge prominence and declination in Japanese jaw displacement patterns: A view from the C/D model (2015)
  • Author(s): Kawahara, S., Erickson, D., Suemitsu, A.
  • Journal Title: Special issue on the C/D model, Journal of the Phonetic Society of Japan Volume: 19.2 Pages: 33-43
  • Peer Reviewed / Open Access / Int'l Joint Research / Acknowledgement Compliant
• [Journal Article] A practical guide to calculating syllable prominence, timing and boundaries in the C/D model (2015)
  • Author(s): Erickson, D., Kawahara, S.
  • Journal Title: Special issue on the C/D model, Journal of the Phonetic Society of Japan Volume: 19.2 Pages: 16-21
  • Peer Reviewed / Open Access / Int'l Joint Research / Acknowledgement Compliant
• [Journal Article] More about contrastive emphasis and the C/D model (2015)
  • Author(s): Kim, J., Erickson, D., Lee, S.
  • Journal Title: Special issue on the C/D model, Journal of the Phonetic Society of Japan Volume: 19.2 Pages: 44-54
  • Peer Reviewed / Open Access / Int'l Joint Research / Acknowledgement Compliant
• [Journal Article] A real-time articulatory visual feedback approach with target presentation for second language pronunciation learning (2015)
  • Author(s): Suemitsu, A., Dang, J., Ito, T., Tiede, M.
  • Journal Title: JASA Express Letters Volume: 138.4 Pages: 382-387
  • Peer Reviewed / Open Access / Int'l Joint Research / Acknowledgement Compliant
• [Journal Article] Effect of a fixed ultrasound probe on jaw movement during speech. (2015)
  • Author(s): Villegas, J., Wilson, I., Iguro, Y., Erickson, D.
  • Journal Title: Proceedings of UltrafestVII Volume: 1 Pages: 4-7
  • Open Access / Int'l Joint Research / Acknowledgement Compliant
• [Journal Article] Spanish articulatory rhythm. (2015)
  • Author(s): Erickson, D., Villegas, J., Wilson, I., Iguro, Y.
  • Journal Title: Proceedings of Acoustical Society of Japan, Fall Meeting Volume: 1 Pages: 319-322
  • Open Access / Acknowledgement Compliant
• [Journal Article] Articulation of phrasal stress in Mandarin Chinese. (2015)
  • Author(s): Iwata,R., Erickson, D. Shibuya, Y., Suemitsu, A.
  • Journal Title: Proceedings of Acoustical Society of Japan, Fall Meeting Volume: 1 Pages: 207-213
  • Open Access / Acknowledgement Compliant
• [Journal Article] Articulatory movement in non-native consonant clusters (2015)
  • Author(s): Funatsu, S., Fujimoto, M., Imaizumi, S., Erickson, D.
  • Journal Title: Proceedings of International Congress of Phonetic Sciences 2015 Volume: 1 Pages: 1-4
  • Peer Reviewed / Open Access / Int'l Joint Research / Acknowledgement Compliant
• [Journal Article] Bridging articulation and perception: The C/D model and contrastive emphasis. (2015)
  • Author(s): Erickson, D., Kim, J., Kwahara, S., Wilson, I., Menezes, C., Suemitsu, A., Moore, J.
  • Journal Title: Proceedings of International Congress of Phonetic Sciences 2015 Volume: 1 Pages: 1-4
  • Peer Reviewed / Open Access / Int'l Joint Research / Acknowledgement Compliant
• [Journal Article] Quantifying the effects of vowel quality and preceding consonants on jaw displacement: Japanese data (2014)
  • Author(s): Kawahara, S., Masuda, H., Erickson, D., Moore, J., Suemitsu, A., Shibuya, Y.
  • Journal Title: Journal of Phonetic Society of Japan Volume: 18 Pages: 54-62
  • Peer Reviewed / Acknowledgement Compliant
• [Journal Article] Jaw displacement and metrical structure in Japanese: The effect of pitch accent, foot structure, and phrasal stress (2014)
  • Author(s): Kawahara, S., Erickson, D., Moore, J., Suemitsu, A., Shibuya, Y.
  • Journal Title: Journal of Phonetic Society of Japan Volume: 18 Pages: 77-87
  • Peer Reviewed / Acknowledgement Compliant
• [Journal Article] Comparison of jaw displacement patterns of Japanese and American speakers of English: A preliminary report. (2014)
  • Author(s): Erickson, D., Kawahara, S., Shibuya, Y., Suemitsu, A., and Tiede, M.
  • Journal Title: Journal of Phonetic Society of Japan Volume: 18 Pages: 88-94
  • Peer Reviewed / Acknowledgement Compliant
• [Journal Article] Acoustic correlates of English rhythmic patterns for American vs. Japanese speakers. (2014)
  • Author(s): Mori, Y., Hori, T., and Erickson, D.
  • Journal Title: Phonetica Volume: 71 Pages: 83-108
  • Peer Reviewed / Acknowledgement Compliant
• [Journal Article] A study of invariant properties and variation patterns in the converter/distributor model for emotional speech (2014)
  • Author(s): Kim, J., Erickson, D., Lee, S., Narayanan, S.
  • Journal Title: Proceedings of Interspeech Volume: 1 Pages: 413-417
  • Peer Reviewed / Acknowledgement Compliant
• [Journal Article] Metrical structure and jaw displacement: An exploration (2014)
  • Author(s): Erickson, D., Kawahara, S., Williams, J.C., Moore, J., Suemitsu, A., and Shibuya, Y.
  • Journal Title: Proceedings of Speech Prosody 2014 Volume: 1 Pages: 00-303
  • Peer Reviewed / Acknowledgement Compliant
• [Journal Article] Calculating articulatory syllable duration and phrase boundaries (2014)
  • Author(s): Erickson, D., Kawahara, S., Moore, J., Menezes, C. Suemitsu, A., Kim, J. and Shibuya, Y.
  • Journal Title: Proceedings of International Seminar on Speech Processing Volume: 1 Pages: 102-105
  • Peer Reviewed / Acknowledgement Compliant
• [Journal Article] Tongue width at rest versus tongue width during speech: A comparison of native and non-native speakers (2014)
  • Author(s): Kanada, S. & I. Wilson
  • Journal Title: Journal of the Acoustical Society of America Volume: 136 Issue: 4_Supplement Pages: 2143-2143
  • DOI: 10.1121/1.4899734
  • NAID: 130005478777
  • Acknowledgement Compliant
• [Journal Article] Pre-speech postures of second-language versus first-language speakers [母語・非母語話者における発話直前の舌形状] (2014)
  • Author(s): Wilson, I. & S. Kanada
  • Journal Title: Journal of the Phonetic Society of Japan [音声研究] Volume: 18 Pages: 106-109
  • Peer Reviewed / Acknowledgement Compliant
• [Journal Article] Articulation of Phrasal Stress: A comparison of American and Japanese speakers of English (2014)
  • Author(s): Erickson, D., Suemitsu, A., Shibuya, Y., and Tiede, M.
  • Journal Title: Journal of Phonetic Society of Japan Volume: in progress
  • Peer Reviewed
• [Journal Article] Speech rhythm in English and applications to second language teaching (2013)
  • Author(s): Erickson, D.
  • Journal Title: Acoustical Science and Technology Volume: 34 Pages: 153-158
  • NAID: 110009596746
  • Peer Reviewed
• [Journal Article] Normalization and matching routine for comparing first and second language tongue (2013)
  • Author(s): Moriya, S., Yaguchi, Y., Terunuma, N., Sato, T., and Wilson, I.
  • Journal Title: IEICE Technical Report Volume: 113 Pages: 53-57
  • Peer Reviewed
• [Presentation] About acoustic and articulatory correlates of phrasal stress in Spanish (2016)
  • Author(s): Erickson, D.
  • Organizer: Sophia University kenkyukai
  • Place of Presentation: Sophia University, Phonetics laboratory
  • Year and Date: 2016-03-03
  • Invited
• [Presentation] Jaw displacement patterns reflect metrical structure, Part II (2016)
  • Author(s): Erickson, D.
  • Organizer: University of Southern California Speech Lab (S. Narayanan)
  • Place of Presentation: University of Southern California Speech Lab (S. Narayanan)
  • Year and Date: 2016-01-11
  • Int'l Joint Research / Invited
• [Presentation] Jaw displacement patterns reflect metrical structure, Part III (2016)
  • Author(s): Erickson, D.
  • Organizer: University of California Los Angeles
  • Place of Presentation: University of California Los Angeles Phonetics Lab meeting
  • Year and Date: 2016-01-11
  • Int'l Joint Research / Invited
• [Presentation] Effect of a fixed ultrasound probe on jaw movement during speech. (2015)
  • Author(s): Villegas, J., Wilson, I., Iguro, Y., Erickson
  • Organizer: Ultrafest VII
  • Place of Presentation: University of Hong Kong
  • Year and Date: 2015-12-08
  • Int'l Joint Research
• [Presentation] Jaw displacement patterns reflect metrical structure. (2015)
  • Author(s): Erickson, D.
  • Organizer: International Congress on Phonetics and Phonology
  • Place of Presentation: Keio University, Minato-ku, Tokyo
  • Year and Date: 2015-09-25
  • Int'l Joint Research / Invited
• [Presentation] Spanish articulatory rhythm (2015)
  • Author(s): Erickson, D., Villegas, J., Wilson, I., Iguro, Y.
  • Organizer: Fall meeting Acoustical Society of Japan
  • Place of Presentation: The University of Aizu, Aizu-Wakamatsu
  • Year and Date: 2015-09-16
• [Presentation] Articulation of phrasal stress in Mandarin Chinese. (2015)
  • Author(s): Iwata, R., Erickson, D., Shibuya, Y., Suemitsu, A.
  • Organizer: Fall meeting Acoustical Society of Japan
  • Place of Presentation: The University of Aizu, Aizu-Wakamatsu
  • Year and Date: 2015-09-16
• [Presentation] Articulatory movement in non-native consonant clusters. (2015)
  • Author(s): Funatsu, S., Fujimoto, M., Imaizumi, S., Erickson, D.
  • Organizer: International Congress of Phonetic Sciences 2015
  • Place of Presentation: Glasgow, Scotland
  • Year and Date: 2015-08-10
  • Int'l Joint Research
• [Presentation] Bridging articulation and perception: The C/D model and contrastive emphasis (2015)
  • Author(s): Erickson, D., Kim, J., Kawahara, S., Wilson, I., Menezes, C., Suemitsu, A., Moore, J.
  • Organizer: International Congress of Phonetic Sciences 2015
  • Place of Presentation: Glasgow, Scotland
  • Year and Date: 2015-08-10
  • Int'l Joint Research
• [Presentation] Articulation of Rhythm: A Multilanguage Perspective (2015)
  • Author(s): Erickson, D.
  • Organizer: Yale University, Haskins Laboratories Kenkyukai
  • Place of Presentation: Yale University, Haskins Laboratories
  • Year and Date: 2015-06-11
  • Int'l Joint Research / Invited
• [Presentation] The C/D model and contrastive emphasis (2015)
  • Author(s): Erickson, D.
  • Organizer: Sophia University, Phonetics kenkyukai
  • Place of Presentation: Sophia University, Phonetics Laboratory
  • Year and Date: 2015-05-15
  • Invited
• [Presentation] Syllable triangles, syllable centers, articulatory syllable durations, shadow angles, oh my ! (2015)
  • Author(s): Erickson, D.
  • Organizer: GIPSA Labs research meeting
  • Place of Presentation: University of Grenoble, Grenoble, France
  • Year and Date: 2015-03-09
• [Presentation] The jaw keeps the beat: Speech rhythm in English, Japanese and Mandarin (2015)
  • Author(s): Erickson, D., Iwata, R., Moore,J., Suemitsu, A., Shibuya, Y.
  • Organizer: NINJAL
  • Place of Presentation: 国立国語研究所（東京都・立川市）
  • Year and Date: 2015-02-01
• [Presentation] Jaw displacement patterns as articulatory correlates of metrical structure (2014)
  • Author(s): Erickson, D., Kawahara, S., Wilson, I., Menezes, C., Suemitsu, A., Shibuya, Y., Moore, J.
  • Organizer: Phonetic Building Blocks of Speech, in Honor of John Esling
  • Place of Presentation: University of Victoria, Victoria, B.C., Canada
  • Year and Date: 2014-09-18 – 2014-09-21
• [Presentation] A study of invariant properties and variation patterns in the converter/distributor model for emotional speech (2014)
  • Author(s): Kim, J., Erickson, D., Lee, S., Narayanan, S.
  • Organizer: Interspeech 2014
  • Place of Presentation: Singapore (Singapore)
  • Year and Date: 2014-09-14 – 2014-09-18
• [Presentation] 調音フィードバックシステムによる発音訓練後の学習効果の持続性についての検討 (2014)
  • Author(s): 末光厚夫，党建武, 伊藤貴之, Tiede Mark
  • Organizer: 日本音響学会平成26年秋季研究発表会
  • Place of Presentation: 北海学園大学（北海道・札幌市）
  • Year and Date: 2014-09-03 – 2014-09-05
• [Presentation] Metrical structure and the C/D model (2014)
  • Author(s): Erickson, D., Kawahara, S., Menezes, C., Moore, J., Kim, J., Suemitsu, A., Shibuya, Y.
  • Organizer: Adventures in Speech Science Workshop in Honor of Osamu Fujimura
  • Place of Presentation: 東京大学（東京都・文京区）
  • Year and Date: 2014-07-22 – 2014-07-23
• [Presentation] The C/D model and emotional speech: preliminary findings (2014)
  • Author(s): Kim, J., Lee, S., Erickson, D., and Narayanan, S.
  • Organizer: Adventures in Speech Science Workshop in Honor of Osamu Fujimura
  • Place of Presentation: 東京大学（東京都・文京区）
  • Year and Date: 2014-07-22 – 2014-07-23
• [Presentation] Metrical structure and jaw displacement: An exploration. (2014)
  • Author(s): Erickson, D., Kawahara, S., Williams, J.C., Moore, J., Suemitsu, A., and Shibuya, Y.
  • Organizer: Speech Prosody
  • Place of Presentation: Dublin, Ireland
  • Year and Date: 2014-05-20 – 2014-05-23
• [Presentation] Calculating articulatory syllable duration and phrase boundaries (2014)
  • Author(s): Erickson, D., Kawahara, S., Moore, J., Menezes, C. Suemitsu, A., Kim, J. and Shibuya, Y.
  • Organizer: International Symposium on Speech Processing
  • Place of Presentation: Cologne, Germany
  • Year and Date: 2014-05-05 – 2014-05-08
• [Presentation] Metrical structure and jaw displacement (2014)
  • Author(s): Erickson, D., Kawahara, S., Moore, J., Suemitsu, A., and Shibuya, Y.
  • Organizer: Speech Prosody 2014
  • Place of Presentation: Dublin, Ireland
• [Presentation] Calculating articulatory syllable duration and phrase boundaries (2014)
  • Author(s): Erickson, D., Kawahara, S., Moore, J., Menezes, C. Suemitsu, A., and Shibuya, Y.
  • Organizer: ISSP2014
  • Place of Presentation: Cologne, Germany
• [Presentation] Effect of vowel height and position on jaw opening patterns in Japanese (2013)
  • Author(s): Erickson, D., Kawahara, S., Moore, J., Suemitsu, A., and Shibuya, Y.
  • Organizer: ICPP-3
  • Place of Presentation: Lyon, France
• [Presentation] 舌特徴空間における**言語学習者の違いを比較するための正規化とマッチング手法 (2013)
  • Author(s): Moriya, S., Yaguchi, Y., Terunuma, N., Sato, T., and Wilson, I.
  • Organizer: IEICE Technical Committee on Speech
  • Place of Presentation: 奈良先端科学技術大学院大学（奈良県生駒市）
• [Presentation] アメリカ英語発音学習における調音フィードバック提示による学習効果の検討 (2013)
  • Author(s): 末光厚夫，党建武，伊藤貴之，Tiede Mark
  • Organizer: 日本音響学会2013年秋季研究発表会
  • Place of Presentation: 豊橋技術科学大学（愛知県豊橋市）
• [Presentation] An electromagnetic articulography-based articulatory feedback approach to facilitate second language speech production learning (2013)
  • Author(s): Atsuo Suemitsu, Takayuki Ito, Mark Tiede
  • Organizer: The 21st International Congress on Acoustics
  • Place of Presentation: Palais des congrès, Montreal, Canada
• [Presentation] Neutralizing differences in jaw displacement for English vowels (2013)
  • Author(s): Williams, J.C., Erickson, D., Ozaki, Y., Suemitsu, A. Minematsu, N., Fujimura, O.
  • Organizer: The 21st International Congress on Acoustics
  • Place of Presentation: Palais des congrès, Montreal, Canada
• [Presentation] Intrinsic variations in jaw , deviation in English vowels (2013)
  • Author(s): Menezes, C., and Erickson, D.
  • Organizer: The 21st International Congress on Acoustics
  • Place of Presentation: Palais des congrès, Montreal, Canada
• [Presentation] Effect of syllable onset, coda, and nucleus on degree of skin stretching over the mandible (2013)
  • Author(s): Wilson, I. and Erickson, D.
  • Organizer: The 21st International Congress on Acoustics
  • Place of Presentation: Palais des congrès, Montreal, Canada
• [Remarks] The C/D model forum