• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Effects of Ultrasound Visual Feedback

Research Project

Project/Area Number 18K12411
Research Category

Grant-in-Aid for Early-Career Scientists

Allocation TypeMulti-year Fund
Review Section Basic Section 02080:English linguistics-related
Research InstitutionHiroshima University

Principal Investigator

Yamane Noriko  広島大学, 人間社会科学研究科(総), 准教授 (70319391)

Project Period (FY) 2018-04-01 – 2022-03-31
Project Status Completed (Fiscal Year 2021)
Budget Amount *help
¥4,030,000 (Direct Cost: ¥3,100,000、Indirect Cost: ¥930,000)
Fiscal Year 2020: ¥650,000 (Direct Cost: ¥500,000、Indirect Cost: ¥150,000)
Fiscal Year 2019: ¥910,000 (Direct Cost: ¥700,000、Indirect Cost: ¥210,000)
Fiscal Year 2018: ¥2,470,000 (Direct Cost: ¥1,900,000、Indirect Cost: ¥570,000)
Keywords超音波 / 発音 / 調音運動 / 英語 / 舌 / 模倣 / アルトラサウンド / ビジュアルフィードバック / トラブル音 / 日本語母語話者 / ピッチ幅 / 観察学習 / ミラーリング / 発音学習
Outline of Final Research Achievements

Research points to L1 Japanese L2 English learner sound challenges, where learner identification of such sounds improves following perception training. What remains unclear, however, is the extent to which such improvement is based on lingual motor control when producing sounds. Clinical linguistic research has reported that patient articulatory controls improve following real-time ultrasound technology training based on online visual feedback. The current study applied this training technique to teaching new sounds to L1 Japanese and L2 English learners. Results indicate that following visual feedback with explicit phonetic instruction, learner articulatory controls improved.

Academic Significance and Societal Importance of the Research Achievements

日本語にはない英語の音、例えばLやRの発音は知覚訓練によってある程度改善されるが、膨大な訓練時間が必要である。本研究では、聴覚に加えて視覚刺激を加え、モデルの顔の横から舌の動きを可視化して埋め込んだオーバーレイ動画や、自分の舌のアルトラサウンド映像をリアルタイムで観察しつつ、モデルの舌の動態を模倣する短期間の練習の効果が確かめられたことから、新たな発音の学習法として注目を集める可能性が高い。また舌や口に深い関わりがあるとされている話者の手のジェスチャーの模倣学習への応用も期待される。

Report

(5 results)
  • 2021 Annual Research Report   Final Research Report ( PDF )
  • 2020 Research-status Report
  • 2019 Research-status Report
  • 2018 Research-status Report
  • Research Products

    (30 results)

All 2022 2021 2020 2019 2018 Other

All Int'l Joint Research (3 results) Journal Article (10 results) (of which Int'l Joint Research: 7 results,  Peer Reviewed: 8 results,  Open Access: 6 results) Presentation (14 results) (of which Int'l Joint Research: 13 results,  Invited: 1 results) Book (2 results) Remarks (1 results)

  • [Int'l Joint Research] University of British Columbia/University of Ottawa(カナダ)

    • Related Report
      2020 Research-status Report
  • [Int'l Joint Research] University of British Columbia(カナダ)

    • Related Report
      2019 Research-status Report
  • [Int'l Joint Research] National Taiwan University(台湾)

    • Related Report
      2019 Research-status Report
  • [Journal Article] Pretest-posttest production and perception results of ultrasound pronunciation training2022

    • Author(s)
      Yamane Noriko, Sun Kunyang, Perkins Jeremy, Wilson Ian
    • Journal Title

      Proceedings of The 4th International Symposium on Applied Phonetics

      Volume: -

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Emotional Prosody of Condolence Letter Reading among English L12021

    • Author(s)
      Kaneko Ikuyo, Yamane Noriko
    • Journal Title

      Phonological Studies

      Volume: 24 Pages: 15-22

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Effects of Ultrasound Visual Feedback2020

    • Author(s)
      Yamane, N., Shinya, M., Wilson, I., and Gick, B.
    • Journal Title

      Impact, Science Impact Ltd.

      Volume: 8 Issue: 8 Pages: 35-37

    • DOI

      10.21820/23987073.2020.8.35

    • Related Report
      2020 Research-status Report
    • Open Access / Int'l Joint Research
  • [Journal Article] Deep Learning for Automatic Tracking of Tongue Surface in Real-time Ultrasound Videos, Landmarks instead of Contours2020

    • Author(s)
      Mozaffari, M. H., Yamane, N., Won-Sook, L.
    • Journal Title

      Proceedings of 2020 IEEE International Conference on Bioinformatics and Biomedicine (BIBM)

      Volume: - Pages: 2785-2792

    • DOI

      10.1109/bibm49941.2020.9313262

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Introduction: Prosody and Body2020

    • Author(s)
      Yamane, N. Teaman, T
    • Journal Title

      Proceedings of the 34th general meeting of the Phonetic Society of Japan

      Volume: -

    • Related Report
      2020 Research-status Report
    • Open Access / Int'l Joint Research
  • [Journal Article] Development of L2 Prosody: The Case of Information Focus2020

    • Author(s)
      Fujimori, A., Nakayama, M., Yoshimura, N., Yamane, N., Teaman T., and Yoneyama, K.
    • Journal Title

      XV Selected Proceedings of GASLA 15 (Generative Approaches to Second Language Acquisition)

      Volume: 15

    • Related Report
      2019 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Tokyo Japanese /u/ to be unrounded or rounded?: Redefining roundness, compression, and protrusion2019

    • Author(s)
      Nogita, A. & Yamane, N.
    • Journal Title

      Phonological Studies

      Volume: 23

    • Related Report
      2019 Research-status Report
    • Peer Reviewed
  • [Journal Article] Sibilant Fricative Merging in Taiwan Mandarin: An Investigation of Tongue Postures using Ultrasound Imaging2019

    • Author(s)
      Chiu Chenhao, Wei Po-Chun, Noguchi Masaki, Yamane Noriko
    • Journal Title

      Language and Speech

      Volume: 2019 Issue: 4 Pages: 1-21

    • DOI

      10.1177/0023830919896386

    • Related Report
      2019 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Mirroring Beat Gestures: Effects on EFL Learners2019

    • Author(s)
      Yamane, N., Shinya, M., Teaman, B., Ogawa, M., and Akahoshi, S.
    • Journal Title

      Proceedings of International Congress of Phonetic Sciences

      Volume: 2019 Pages: 3523-3527

    • Related Report
      2019 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] The kinesthetic effect on EFL learners’ intonation2018

    • Author(s)
      Yamane, N., Teaman, B., Fujimori, A., Wilson, I., and Yoshimura, N.
    • Journal Title

      Proceedings of ISAPh 2018 International Symposium on Applied Phonetics

      Volume: 2 Pages: 136-141

    • DOI

      10.21437/isaph.2018-25

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Presentation] Pretest-posttest production and perception results of ultrasound pronunciation training2022

    • Author(s)
      Yamane Noriko, Sun Kunyang, Perkins Jeremy, Wilson Ian
    • Organizer
      International Symposium on Applied Phonetics (ISAPh)
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Emotional prosody of love and sorrow: L1 English, TTS and EFL learners2021

    • Author(s)
      Kaneko Ikuyo, Yamane Noriko
    • Organizer
      Pronunciation in Second Language Learning and Teaching (PSLLT)
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 曖昧な時間表現「9時10分前」の異なる解釈が引き起こすイントネーションの違い2021

    • Author(s)
      牧野桃子・山根典子
    • Organizer
      日本音韻論学会
    • Related Report
      2021 Annual Research Report
  • [Presentation] Deep Learning for Automatic Tracking of Tongue Surface in Real-time Ultrasound Videos, Landmarks instead of Contours2020

    • Author(s)
      M. Hamed Mozaffari, Noriko Yamane, Won-Sook Lee
    • Organizer
      Workshop 24 Machine Learning and Artificial Intelligence in Bioinformatics and Medical Informatics, BIBM2020, IEEE, Online.
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] Symposium: Haptic, Kinematic, Phonetic Learning2020

    • Author(s)
      Yamane, N, Teaman, B.
    • Organizer
      Phonetic Society of Japan, Online.
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] Ultrasound and Shadowing for Japanese College Students Learning English L and R2020

    • Author(s)
      Sun, K., Watanabe, M., Wilson, I., and Yamane, N
    • Organizer
      Phonology Forum, Phonological Society of Japan, Online.
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] Relationship between Changes in Lip Motor Cortex Excitability and Phonetic Imitation Ability during Tongue Motion Video Observation2020

    • Author(s)
      Tan, X., Tanaka, S., Tian, H., Funase, K. and Yamane, N
    • Organizer
      Phonology Forum, Phonological Society of Japan, Online.
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] Mirroring, Shadowing, and Gesture Alignment in Interlanguage English Speech2020

    • Author(s)
      Yamane, N., Shinya, M., Teaman, B., and Fujimori, A
    • Organizer
      Online Conference of Laboratory Phonology, University of British Columbia
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] Phonetic imitation steps for the first 2 years of life2020

    • Author(s)
      Yamane, N. and Minagawa, Y.
    • Organizer
      ABA seminar
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] Mirroring Beat Gestures: Effects on EFL Learners2019

    • Author(s)
      Noriko Yamane, Masahiro Shinya, Brian Teaman, Marina Ogawa, and Soushi Akahoshi
    • Organizer
      ICPhS
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Mirroring Effects on Duration of EFL Learners2019

    • Author(s)
      Noriko Yamane, Masahiro Shinya, Brian Teaman, Marina Ogawa
    • Organizer
      New Sounds
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] L2 Japanese Prosody of Contrastive Focus and Information Focus2019

    • Author(s)
      Fujimori, A., Nakayama, M., Yamane, N., Yoshimura, N., Yusa, M., Yoneyama, K.
    • Organizer
      New Sounds
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Investigating the effects of listener background on L2 English speech ratings2019

    • Author(s)
      Head, P., Yamane, N., Clenton, J., and Shinya, M.
    • Organizer
      New Directions
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] The kinesthetic effect on EFL learners' intonation2018

    • Author(s)
      Yamane Noriko, Teaman Brian, Fujimori Atsushi, Wilson Ian, Yoshimura Noriko
    • Organizer
      ISAPh 2018 International Symposium on Applied Phonetics
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Book] ことばの不思議の国~言語学の魅力がわかる本~2020

    • Author(s)
      柴田美紀 (編著), 町田章 (著), 山根典子 (著)
    • Total Pages
      166
    • Publisher
      丸善出版
    • Related Report
      2019 Research-status Report
  • [Book] 言語におけるインターフェイス2019

    • Author(s)
      西原哲雄・都田青子・中村浩一郎・米倉陽子(編)
    • Total Pages
      304
    • Publisher
      開拓社
    • Related Report
      2019 Research-status Report
  • [Remarks] eNunciate! A Visual Language Learning Tool

    • URL

      https://enunciate.arts.ubc.ca/

    • Related Report
      2019 Research-status Report

URL: 

Published: 2018-04-23   Modified: 2023-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi