• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Robust and accurate analysis of pronunciation based on structural representation of speech and machine learning and its application to foreign language learning

Research Project

Project/Area Number 23300067
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Perception information processing/Intelligent robotics
Research InstitutionThe University of Tokyo

Principal Investigator

MINEMATSU Nobuaki  東京大学, 工学(系)研究科(研究院), 教授 (90273333)

Co-Investigator(Kenkyū-buntansha) 牧野 武彦  中央大学, 経済学部, 教授 (00269482)
山内 豊  東京国際大学, 商学部, 教授 (30306245)
Co-Investigator(Renkei-kenkyūsha) 山内 豊  東京国際大学, 商学部, 教授 (30306245)
Project Period (FY) 2011-04-01 – 2015-03-31
Project Status Completed (Fiscal Year 2014)
Budget Amount *help
¥20,410,000 (Direct Cost: ¥15,700,000、Indirect Cost: ¥4,710,000)
Fiscal Year 2013: ¥6,110,000 (Direct Cost: ¥4,700,000、Indirect Cost: ¥1,410,000)
Fiscal Year 2012: ¥5,980,000 (Direct Cost: ¥4,600,000、Indirect Cost: ¥1,380,000)
Fiscal Year 2011: ¥8,320,000 (Direct Cost: ¥6,400,000、Indirect Cost: ¥1,920,000)
Keywords音声の構造的表象 / 機械学習 / 外国語学習 / 発音教育 / 外国語訛り / 世界諸英語 / 外国語教育
Outline of Final Research Achievements

In this study, pronunciation analysis based on structural representation of speech was investigated and applied to foreign language learning, especially to pronunciation training. The following four results were obtained as contribution. 1) development of a technique to perform structural analysis of pronunciation even for a small number of utterances, 2) extension of a non-native speech corpus by labeling the utterances with IPA (International Phonetic Alphabets), 3) individual-based and precise clustering of native and non-native pronunciations of English, and 4) preliminary investigation of educationally-effective visualization of pronunciation diversity of English. In study 1), Chinese was adopted as target language and in studies 2), 3), and 4), English was used. The technical contributions of these studies are, however, language-independent and they can be applied to any language.

Report

(4 results)
  • 2014 Final Research Report ( PDF )
  • 2013 Annual Research Report
  • 2012 Annual Research Report
  • 2011 Annual Research Report
  • Research Products

    (35 results)

All 2013 2012 2011

All Journal Article (16 results) (of which Peer Reviewed: 16 results) Presentation (18 results) (of which Invited: 6 results) Book (1 results)

  • [Journal Article] 音声情報処理技術を用いた外国語学習支援2013

    • Author(s)
      河原達也,峯松信明
    • Journal Title

      電子情報通信学会論文誌

      Volume: J96-D Pages: 1549-1565

    • NAID

      110009615133

    • Related Report
      2013 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Automatic pronunciation clustering using a world English archive and pronunciation structure analysis2013

    • Author(s)
      H.-P. Shen, N. Minematsu, T. Makino, S. H. Weinberger, T. Pongkittiphan, C.-H. Wu
    • Journal Title

      Proc. ASRU

      Volume: 1 Pages: 222-227

    • Related Report
      2013 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Speaker-based accented English clustering using a world English archive2013

    • Author(s)
      H.-P. Shen, N. Minematsu, T. Makino, S. H. Weinberger, T. Pongkittiphan, C.-H. Wu
    • Journal Title

      Proc. SLaTE

      Volume: 1 Pages: 184-188

    • Related Report
      2013 Annual Research Report
    • Peer Reviewed
  • [Journal Article] An experimental study on dynamic features of speech structure2012

    • Author(s)
      S. Shimizu, M. Suzuki, N. Minematsu, K. Hirose
    • Journal Title

      Journal of Research Institute of Signal Processing

      Volume: 16 Pages: 319-322

    • NAID

      130004457023

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Performance improvement of automatic pronunciaiton assessment in a noisy classroom2012

    • Author(s)
      Y. Luan, M. Suzuki, Y. Yamauchi, N. Minematsu, K. Hirose
    • Journal Title

      Proc. Spoken Language Technology

      Volume: 1 Pages: 428-431

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Automatic Chinese pronunciation error detection using SVM trained with structural features2012

    • Author(s)
      T. Zhao, A. Hoshino, M. Suzuki, N. Minematsu, K. Hirose
    • Journal Title

      Proc. Spoken Language Technology

      Volume: 1 Pages: 473-476

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Effects of learners' language transfer on native listerners' evaluation of the prosodic naturalness of Japanese words2012

    • Author(s)
      S. Kato, G. Short, N. Minematsu, K. Hirose
    • Journal Title

      Proc. Speech Prosody

      Volume: 1 Pages: 198-201

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] An experimental study on dynamic features of speech structure2012

    • Author(s)
      S. Shimizu, M. Suzuki, N. Minematsu, K. Hirose
    • Journal Title

      Proc. RISP International Workshop on Nonlinear Circuits, Communication and Signal Processing

      Volume: 1 Pages: 166-169

    • NAID

      130004457023

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 音声の構造的表象に基づく学習者分類の検証と発音矯正度推定の高精度化2011

    • Author(s)
      峯松信明,鎌田圭,朝川哲,牧野武彦,西村多寿子,広瀬啓吉
    • Journal Title

      情報処理学会論文誌

      Volume: 52 Pages: 3671-3681

    • NAID

      110008719943

    • Related Report
      2011 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 音声の構造的表象と多段階の重回帰を用いた外国語発音評価2011

    • Author(s)
      鈴木雅之,峯松信明,広瀬啓吉,
    • Journal Title

      情報処理学会論文誌

      Volume: 52 Pages: 1899-1909

    • NAID

      110008508020

    • Related Report
      2011 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Structure constrained distributions matching using quadratic programming and its application to pronunciation evaluation2011

    • Author(s)
      Y. Qiao, M. Suzuki, N. Minematsu and K. Hirose
    • Journal Title

      Proc. Asian Conference on Pattern Recognition

      Volume: 1

    • Related Report
      2011 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Measurement of objective intelligibility of Japanese accented English using ERJ (English Read by Japanese) database2011

    • Author(s)
      N. Minematsu, K. Okabe, K. Ogaki, K. Hirose
    • Journal Title

      Proc. INTERSPEECH

      Volume: 1 Pages: 1481-1484

    • Related Report
      2011 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Comparison of native and non-native evaluations of the naturalness of Japanese words with proosdy modified through voice morphing2011

    • Author(s)
      S. Kato, G. Short, N. Minematsu, C. Tsurutani, K. Hirose
    • Journal Title

      Proc. Int. Workshop on Speech and Language Technology in Education

      Volume: 1

    • Related Report
      2011 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Are both American and British pronunciations necessary in learner's English dictionaries in Japan?2011

    • Author(s)
      T. Makino
    • Journal Title

      Proc. ASIALEX2011

      Volume: 1 Pages: 343-347

    • Related Report
      2011 Annual Research Report
    • Peer Reviewed
  • [Journal Article] How to assess shadowing performance: Manual or automatic?2011

    • Author(s)
      Yutaka Yamauchi
    • Journal Title

      Proceedings of the 16th World Congress of Applied Linguistics

      Volume: 1 Pages: 24-24

    • Related Report
      2011 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Investigation on the possibility of shadowing as an overall proficiency test2011

    • Author(s)
      Yutaka Yamauchi
    • Journal Title

      Proceedings of the 2nd Combined Conference of the Applied Linguistics Association of Australia and Applied Linguistics Association of New Zealand

      Volume: 1 Pages: 134-134

    • Related Report
      2011 Annual Research Report
    • Peer Reviewed
  • [Presentation] 音声情報処理技術を用いた計算機援用型外国語教育・学習2013

    • Author(s)
      峯松信明
    • Organizer
      電子情報通信学会音声研究会資料
    • Place of Presentation
      奈良先端大学
    • Year and Date
      2013-11-21 – 2013-11-22
    • Related Report
      2013 Annual Research Report
    • Invited
  • [Presentation] Automatic clustering of world English pronunciations on an individual basis2013

    • Author(s)
      N. Minematsu and T. Makino
    • Organizer
      Annual meeting of International Association of World Englishes
    • Place of Presentation
      Arizona State University(アリゾナ州,米国)
    • Year and Date
      2013-11-16 – 2013-11-18
    • Related Report
      2013 Annual Research Report
  • [Presentation] Tutorial on Computer-assissted language learning (CALL) systems2012

    • Author(s)
      T. Kawahara and N. Minematsu
    • Organizer
      INTERSPEECH
    • Place of Presentation
      Portland,USA
    • Related Report
      2012 Annual Research Report
    • Invited
  • [Presentation] ことばって一体何だろう? ~音声を物理的に眺める一人の研究者が考えること~2012

    • Author(s)
      峯松信明
    • Organizer
      第56回日私小連全国教育夏季研究会外国語部会
    • Place of Presentation
      東京,市ヶ谷
    • Related Report
      2012 Annual Research Report
    • Invited
  • [Presentation] ンプットの音的質について2012

    • Author(s)
      峯松信明
    • Organizer
      第56回日私小連全国教育夏季研究会外国語部会
    • Place of Presentation
      東京,市ヶ谷
    • Related Report
      2012 Annual Research Report
    • Invited
  • [Presentation] Automatic pronunciation error detection of Chinese using SVM with structural features2012

    • Author(s)
      T. Zhao, M. Suzuki, N. Minematsu, K. Hirose
    • Organizer
      電子情報通信学会音声研究会
    • Place of Presentation
      山形,天童
    • Related Report
      2012 Annual Research Report
  • [Presentation] Automatic pronunciation error detection of Chinese based on SVM and structural features2012

    • Author(s)
      T. Zhao, H. Akemi, M. Suzuki, N. Minematsu, K. Hirose
    • Organizer
      Proc. Autumn Meeting of Acoust. Soc. Japan
    • Place of Presentation
      長野,信州大学
    • Related Report
      2012 Annual Research Report
  • [Presentation] GOP performance improvement of automatic pronunciation assessment in a noisy environment2012

    • Author(s)
      L. Yi, M. Suzuki, Y. Yamauchi, N. Minematsu, S. Kato, K. Hirose
    • Organizer
      Proc. Autumn Meeting of Acoust. Soc. Japan
    • Place of Presentation
      長野,信州大学
    • Related Report
      2012 Annual Research Report
  • [Presentation] GOPと重回帰分析を用いたシャドーイング評価の高精度化2012

    • Author(s)
      加藤集平,鈴木雅之,峯松信明,広瀬啓吉
    • Organizer
      日本音響学会春季講演論文集
    • Place of Presentation
      神奈川大学(神奈川県横浜市)
    • Related Report
      2011 Annual Research Report
  • [Presentation] 構造的表象を用いた話者間の発音距離行列の可視化に関する検討2012

    • Author(s)
      黒瀧夏子,鈴木雅之,峯松信明,広瀬啓吉
    • Organizer
      日本音響学会春季講演論文集
    • Place of Presentation
      神奈川大学(神奈川県横浜市)
    • Related Report
      2011 Annual Research Report
  • [Presentation] Acquisition of L2 rhythm2011

    • Author(s)
      D. Erickson, Y. Tanaka, K. Hirose, N. Minematsu
    • Organizer
      Proc. Autum Meeting of Acoust. Soc. Japan
    • Place of Presentation
      島根大学(島根県松江市)
    • Related Report
      2011 Annual Research Report
  • [Presentation] Chinese language pronunciation proficiency estimation2011

    • Author(s)
      T. Zhao, M. Suzuki, C. Wang, N. Minematsu, K. Hirose
    • Organizer
      Proc. Autumn Meeting of Acoust. Soc. Japan
    • Place of Presentation
      島根大学(島根県松江市)
    • Related Report
      2011 Annual Research Report
  • [Presentation] 日本語単語の韻律モーフィング音声に対する母語話者と学習者による自然性評価の比較2011

    • Author(s)
      加藤集平,ショート・グレッグ,峯松信明,鶴谷千春,広瀬啓吉
    • Organizer
      日本音響学会秋季講演論文集
    • Place of Presentation
      島根大学(島根県松江市)
    • Related Report
      2011 Annual Research Report
  • [Presentation] 音声の構造的表象とそれに基づく外国語発音評定2011

    • Author(s)
      峯松信明
    • Organizer
      筑波大学留学生センター講演会
    • Place of Presentation
      筑波大学(茨城県つくば市)
    • Related Report
      2011 Annual Research Report
    • Invited
  • [Presentation] Tutorial on Computer-assissted language learning (CALL) based on speech technologies2011

    • Author(s)
      T. Kawahara and N. Minematsu
    • Organizer
      Tutorial session of Asia-Pasific Signal and Information Prosessing Asssociation (APSIPA) Conference
    • Place of Presentation
      Grand New World Hotel Xi'an(中国・西安)
    • Related Report
      2011 Annual Research Report
    • Invited
  • [Presentation] シャドーイン グの自動評価の妥当性に関する観点別評価面からの考察2011

    • Author(s)
      山内 豊,峯松信明,羅徳安,川村明美,西川 恵
    • Organizer
      外国語教育メディ ア学会第51回全国研究大会発表論文集
    • Place of Presentation
      東海学園大学(愛知県名古屋市)
    • Related Report
      2011 Annual Research Report
  • [Presentation] 英語シャドーイ ング評価の試み:全体的印象評価と観点別評価の関係2011

    • Author(s)
      山内 豊,峯松信明,羅徳安,川村明美,西川 恵
    • Organizer
      外国語教育メディア 学会関東支部126回研究大会発表要項
    • Place of Presentation
      学習院女子大学(東京都新宿区)
    • Related Report
      2011 Annual Research Report
  • [Presentation] 英語シャドーイング評価 における評価者間のずれと信頼性に関する分析2011

    • Author(s)
      山内 豊,峯松信明,川村明美,西川 恵
    • Organizer
      外国語教育メディア学会関 東支部第127回研究大会発表要項
    • Place of Presentation
      拓殖大学(東京都文京区)
    • Related Report
      2011 Annual Research Report
  • [Book] Exploring English Phonetics2012

    • Author(s)
      Tatjana Paunovic and Biljana Cubrovic (eds.)
    • Total Pages
      270
    • Publisher
      Cambridge Scholar Publishing
    • Related Report
      2011 Annual Research Report

URL: 

Published: 2011-04-06   Modified: 2019-07-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi