感情音声の異文化間比較-調音音声学的・言語学的分析

2009 Fiscal Year Annual Research Report

• Project/Area Number: 19520371
• Research Institution: Showa University of Music
• Principal Investigator: ERICKSON Donna Showa University of Music, 音楽学部, 教授 (80331586)
• Keywords: 音声学 / 言語学 / 韻律 / 感情言語 / 調音

Research Abstract

異言語、異文化をもつ話者の感情音声(emotional speech)の生成過程の発見をテーマに研究を進めた。今回、実験の対象とした言語はアメリカ英語、日本語、ロシア語である。
1.アメリカ英語、日本語、韓国語を対象とし、EMA(Electro-Magnetic Articulograph)実験を実施した。この実験では、被験者と対話相手が隔離された部屋に入り、マイクロフォン、イアフォンを用いて自然な形式で対話を行った。会話の内容は、被験者の私生活に関して、特に感情を呼び起こす事柄をテーマとし、リハーサル抜きで行った。
2.ロシア語を対象とし、ラメント(lament)に関する研究を数多く発表しているロシアの民族音楽学者に依頼し、自然発話と歌唱及びそれらをラメントした(悲嘆の声で発声すること)時の録音を行い、EMAを採取したほか、声帯の高速イメージングの実験も合わせて行った。
[結果]
アメリカ英語では、悲嘆の声、喜びの声はいずれも上唇を後退・上昇させて生成され、また呼気の上昇に伴う高音によって特徴づけられる。また悲嘆の声では第4フォルマント周波数が下降し、これは喉頭の下降を示唆している。ロシアの悲嘆のラメントでは、最後の息を吸い、すすり泣く部分で、眉をひそめ、同時に上唇を後退させる。これはアメリカ英語、日本語の悲嘆の声でも見られる。韓国語の悲嘆の声はbreathyであり、怒りの発声と比べると柔らかく、また低音である。本研究では、自然な感情音声に関する調音データを収集しているので、体系的なコーパスを蓄積することはできない。しかしこのようなデータベースが斯界で活用され、感情音声の生成メカニズムの解明に貢献することが期待される。

Research Products

• [Journal Article] Comparison between linguistic and affective perception of sad & happy-A cross-linguistic study (2010)
  • Author(s): Menezes, C., Erickson, D., Franks, C.
  • Journal Title: Speech Prosody 2010 Pages: 2a-26
  • Peer Reviewed
• [Journal Article] Perception by Japanese, Korean and American listeners to a Korean speaker's recollection of past emotional events : Some acoustic cues. (2010)
  • Author(s): Erickson, D.
  • Journal Title: Speech Prosody 2010 Pages: 2a-11
  • Peer Reviewed
• [Journal Article] An articulatoryaccount of rhythm, prominence & phrasal articulation (2010)
  • Author(s): Erickson, D.
  • Journal Title: Speech Prosody 2010 Pages: W1-05
  • Peer Reviewed
• [Journal Article] Effect of language knowledge on perception of emotional utterances. (2010)
  • Author(s): Erickson, D., Menezes, C., Rilliard, Shochi, T.
  • Journal Title: Interspeech 2010
  • Peer Reviewed
• [Journal Article] Ah, how sweet the sound : Some acoustic characteristics of emotionally sung/ah/. (2010)
  • Author(s): Erickson, D., Suzuki, T., Tanosaki, K., Yahiro, K., Haneishi, E., Kishimoto, H.
  • Journal Title: Intersinging 2010
  • Peer Reviewed
• [Journal Article] Vocal fold vibration in lamenting, speaking and singing. (2010)
  • Author(s): Mazo, M., Sakakibara, K., Imagawa, H., Tayama, N., Erickson, D.
  • Journal Title: Intersinging 2010
  • Peer Reviewed
• [Journal Article] Differences in jaw, tongue, & lip articulation in lamenting, speaking and singing (2010)
  • Author(s): Mazo, M., Erickson, D.
  • Journal Title: The 4^<th> World Voice Congress
  • Peer Reviewed
• [Journal Article] Multimodal fEEG and fNIRS analysis of human emotional responses. (2010)
  • Author(s): Rutkowski, T., Cichocki, A., Erickson, D., Tanaka, T., Mandic
  • Journal Title: Neuroscience Research, Abstracts of the 32nd Annual Meeting of the Japan Neuroscience Society 6.1 Pages: S130
  • Peer Reviewed
• [Journal Article] An acoustical study of singing formants in female voices : Part I (2009)
  • Author(s): Erickson, D., Saitou, T., Hosokawa, K., Kishimoto, H., Haneishi, E.
  • Journal Title: 昭和音楽大学紀要 Pages: 13-26
  • Peer Reviewed
• [Journal Article] EEG dynamics of auditory and visually presented affective speech : Preliminary results (2009)
  • Author(s): Erickson, D., Rutkowski, T, Cichocki, A.
  • Journal Title: International Symposium on Biomechanical and Physiological Modeling and Speech Science, Feb.20-22, Kanazawa, Japan Pages: 63-67
• [Journal Article] Perception by Japanese and Korean listeners to a Korean speaker's recollection of past emotional events : Some acoustic cues. (2009)
  • Author(s): Erickson, D., Oomae, T., Tanaka, Y.
  • Journal Title: Proc.ASJ '2009 Fall Meeting Pages: 499-502
• [Journal Article] Comparison of emotion perception among different cultures (2009)
  • Author(s): Dang, J., Li, A., Erickson, D., Suemitsu, A., Akagi, M., Sakuraba, K., Minematsu, N., Hirose, K.
  • Journal Title: APSIPA2009 Pages: 538-544
  • Peer Reviewed
• [Journal Article] Are you laughing, smiling or crying? (2009)
  • Author(s): Erickson, D.Menezes, C., Sakakibara, K.
  • Journal Title: APSIPA2009 Pages: 530-537
  • Peer Reviewed
• [Journal Article] Japanese children's acquisition of prosodic politeness expressions (2009)
  • Author(s): Shochi, T., Erickson, D., Sekiyama, K., Rilliard, A., Auberge, V.
  • Journal Title: InterSpeech2009 Pages: 1743-1746
  • Peer Reviewed
• [Journal Article] Comparison between Japanese children and adult perception of prosodic politeness expressions. (2009)
  • Author(s): Shochi, T., Erickson, D., Rilliard, A., Sekiyama, K., Auberge, V.
  • Journal Title: Acoustical Society of American Pages: 2754-5
• [Journal Article] Some preliminary Observations about articulatory, acoustic and perceptual characteristics of laugh and smile speech in comparison with sad and neutral speech.
  • Author(s): Erickson, D., Shochi, T., Menezes, C., Dang, J.
  • Journal Title: Mouton de Gruyter, Special Issue on Laughing. conditional accept
  • Peer Reviewed
• [Journal Article] Comparison of emotion perception among different cultures.
  • Author(s): Dang, J, Li, A., Erickson, D., Suemitsu, A., Akagi, M., Sakuraba, K., Minematsu, N., Hirose, K.
  • Journal Title: Acoustical Science and Technology. conditional accept
  • Peer Reviewed
• [Journal Article] Comparison of Japanese expressive speech perception by Mandarin and Japanese listeners.
  • Author(s): Huang, C-F., Erickson, D., Akagi, M.
  • Journal Title: J.Phonetics. conditional accept
  • Peer Reviewed
• [Presentation] An articulatory account of rhythm, prominence and phrasal organization. (2010)
  • Author(s): Erickson, D.
  • Organizer: Sophia University Linguistics Club
  • Place of Presentation: Tokyo
  • Year and Date: 2010-01-27
• [Presentation] About phonetic and perceptual similarities in laughing, smiling, and crying speech. (2009)
  • Author(s): Erickson, D., Menezes, C., Sakakibara, K.
  • Organizer: Acoustical Society of America
  • Place of Presentation: San Antonio, Texas, USA
  • Year and Date: 20091026-20091030
• [Presentation] Comparison of emotion perception among different cultures (2009)
  • Author(s): Dang, J., Li, A., Erickson, D., Suemitsu, A., Akagi, M., Sakuraba, K., Minematsu, N., Hirose, K.
  • Organizer: APSIPA2009
  • Place of Presentation: Sapporo
  • Year and Date: 20091004-20091007
• [Presentation] Are you laughing, smiling or crying? (2009)
  • Author(s): Erickson, D.Menezes, C., Sakakibara, K.
  • Organizer: APSIPA2009
  • Place of Presentation: Sapporo
  • Year and Date: 20091004-20091007
• [Presentation] Interactive components extraction from fEEG and fNIRS for affective brain machine interfacing paradigms (2009)
  • Author(s): Rutkowsk, T.M., Tanaka, T.Cichocki, A., Erickson, D., Mandic, D.
  • Organizer: Fifth International Conference on Intelligent Computing(ICIC2009)
  • Place of Presentation: Ulsan, Korea
  • Year and Date: 20090916-20090919
• [Presentation] Perception by Japanese and Korean listeners to a Korean speaker's recollection of past emotional events : Some acoustic cues. (2009)
  • Author(s): Erickson, D., Oomae, T., Tanaka, Y.
  • Organizer: Acoustical Society of Japan Fall Meeting
  • Place of Presentation: Koriyama
  • Year and Date: 20090915-20090917
• [Presentation] Japanese children's acquisition of prosodic politeness expressions (2009)
  • Author(s): Shochi, T., Erickson, D., Sekiyama, K., Rilliard, A., Auberge, V.
  • Organizer: Interspeech2009
  • Place of Presentation: Brighton, England
  • Year and Date: 20090600-20091000
• [Presentation] How Emotion affects Voices. (2009)
  • Author(s): Erickson, D.
  • Organizer: School of Music, The Ohio State University
  • Place of Presentation: Columbus, Ohio, USA
  • Year and Date: 2009-10-26
• [Presentation] Are you laughing, smiling or crying. (2009)
  • Author(s): Erickson, D.
  • Organizer: Alfred I.duPont Hospital for Children Nemours Center
  • Place of Presentation: Wilmington, DE, USA
  • Year and Date: 2009-05-28
• [Presentation] Comparison between Japanese children and adult perception of prosodic politeness expressions. (2009)
  • Author(s): Shochi, T., Erickson, D., Rilliard, A., Sekiyama, K., Auberge, V.
  • Organizer: Acoustical Society of America
  • Place of Presentation: Portland, OR, USA
  • Year and Date: 2009-05-27
• [Presentation] 感情を込めて歌ったり話したりするとき、どのように思いを表現するのでしょうか? (2009)
  • Author(s): Erickson, D.
  • Organizer: 昭和音楽大学音声学の共同研究
  • Place of Presentation: 川崎市
  • Year and Date: 2009-05-22
• [Book] 「パラ言語情報にみられる異文化間の知覚の相違」林博司,定延利之(編)『コミュニケーション、どうする?どうなる?』 (2010)
  • Author(s): エリクソン、ドナ, 昇地, 崇明, 林, 定延(編集者)
  • Total Pages: 16
  • Publisher: ひつじ書房,東京
• [Book] Intercultural Perception of English, French and Japanese Social Affective Prosody. Affective Prosody (2009)
  • Author(s): Shochi, T., Rilliard, A., Auberge, V.Erickson, D.
  • Total Pages: 32
  • Publisher: (ed.)M.Gotti, series : Linguistic Insights, Peter Lang Publishing Group, New York, Bern, Berlin, Bruxelles, Frankfurt am Main, Oxford, Wien.
• [Book] 「日・英語母語者による感情音声知覚の比較-基周波数以外の音響的特徴から得られる情報に注目して-」『文法と音声』音声文法研究会編 (2009)
  • Author(s): エリクソン、ドナ, 昇地, 崇明、メネゼス、キャロリーヌ、川原秀紀、リリヤール, アルベール
  • Total Pages: 12
  • Publisher: くろしお出版,大阪.