• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Development of an Automatic Evaluation System of Reading-Aloud and Shadowing Performances by Japanese EFL Learners Using the Latest Speech Technology

Research Project

Project/Area Number 21320105
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Foreign language education
Research InstitutionTokyo International University

Principal Investigator

YAMAUCHI Yutaka  東京国際大学, 商学部, 教授 (30306245)

Co-Investigator(Kenkyū-buntansha) MINEMATSU Nobuaki  東京大学, 大学院・工学系研究科, 教授 (90273333)
KAWAMURA Akemi  東京国際大学, 言語コミュニケーション学部, 准教授 (30326996)
HUSKY Kay  東京国際大学, 商学部, 准教授 (50237955)
SOMEYA Yasumasa  関西大学, 外国語学部, 教授 (40348454)
NISHIKAWA Megumi  東海大学, 外国語教育センター, 准教授 (10453705)
Project Period (FY) 2009 – 2012
Project Status Completed (Fiscal Year 2012)
Budget Amount *help
¥18,070,000 (Direct Cost: ¥13,900,000、Indirect Cost: ¥4,170,000)
Fiscal Year 2011: ¥3,510,000 (Direct Cost: ¥2,700,000、Indirect Cost: ¥810,000)
Fiscal Year 2010: ¥5,980,000 (Direct Cost: ¥4,600,000、Indirect Cost: ¥1,380,000)
Fiscal Year 2009: ¥8,580,000 (Direct Cost: ¥6,600,000、Indirect Cost: ¥1,980,000)
Keywords教育評価 / 測定 / シャドーイング / 自動評価 / 手動評価 / 観点別評価 / 発音評価 / 韻律評価 / 総合的熟達度 / 音声情報処理 / 外国語教育 / リズム / イントネーション / GOP / 音読 / TOEIC
Research Abstract

Although shadowing is considered to be effective in improving EFL learners’ listening and speaking skills, it is both difficult and time consuming to assess shadowing performance. To solve this problem, an automatic assessing system has been newly developed using the latest speech information technology: GOP (Goodness of Pronunciation). The computer automatically compares the learner’s shadowed speech with an acous tic model based on the original text on a phoneme basis and computes numerical scores which indicate how close the learner’s shadowed speech is to the original. To confirm the validity of this automatic assessment, an experiment was conducted. Japanese EFL learners with proficiency levels ranging from 200s to 900s measured by TOEIC scores were requested to record their shadowing into the computer while listening to passages, which had been never presented before, read by a native speaker of English at a speed of approximately 140 words per minute. Then the scores obtained by the automatic system were compared to those rated manually by veteran EFL instructors. A high correlation (r=0.85) was observed between the two; thus this system is significantly valid and also saves much time and energy in assessing shadowing performance. Since the automatic scores of the learners were also highly correlated with their TOEIC scores (r=0.82), the shadowing performance can predict their overall proficiency scores. Based on the regression model, this system can predict and present TOEIC score levels. Therefore this automatic assessing system enables EFL learners to understand objectively how well they have conducted shadowing and also grasp their own proficiency levels.

Report

(4 results)
  • 2012 Final Research Report ( PDF )
  • 2011 Annual Research Report
  • 2010 Annual Research Report
  • 2009 Annual Research Report
  • Research Products

    (45 results)

All 2011 2010 2009

All Journal Article (20 results) (of which Peer Reviewed: 18 results) Presentation (25 results)

  • [Journal Article] Investigation on the possibility of shadowing as an overall proficiency test2011

    • Author(s)
      Yutaka Yamauchi
    • Journal Title

      Proceedings of the 2nd Combined Conference of the Applied Linguistics Association of Australia and Applied Linguistics Association of New Zealand

      Pages: 134-134

    • Related Report
      2012 Final Research Report 2011 Annual Research Report
    • Peer Reviewed
  • [Journal Article] シャドーイングの自動評価の妥当性に関する観点別評価面からの考察2011

    • Author(s)
      山内豊,峯松信明,羅徳安,川村明美,西川惠
    • Journal Title

      外国語教育メディア学会第51回全国研究大会発表論文集

      Pages: 62-63

    • Related Report
      2012 Final Research Report
    • Peer Reviewed
  • [Journal Article] How to assess shadowing performance: Manual or automatic?2011

    • Author(s)
      Yutaka Yamauchi
    • Journal Title

      Proceedings of the 16th World Congress of Applied Linguistics

      Volume: 1 Pages: 24-24

    • Related Report
      2011 Annual Research Report
    • Peer Reviewed
  • [Journal Article] シャドーイングの自動評価の妥当性に関する観点別評価面からの考察2011

    • Author(s)
      山内 豊
    • Journal Title

      外国語教育メディア学会第51回全国研究大会発表論文集

      Volume: 1 Pages: 62-63

    • Related Report
      2011 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 英語シャドーイング評価の試み:全体的印象評価と観点別評価の関係2011

    • Author(s)
      山内 豊
    • Journal Title

      外国語教育メディア学会関東支部126回研究大会発表要項

      Volume: 1 Pages: 10-11

    • Related Report
      2011 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 英語シャドーイング評価における評価者間のずれと信頼性に関する分析2011

    • Author(s)
      山内 豊
    • Journal Title

      外国語教育メディア学会関東支部第127回研究大会発表要項

      Volume: 1 Pages: 30-31

    • Related Report
      2011 Annual Research Report
    • Peer Reviewed
  • [Journal Article] シャドーイングの評価方法:再生率と音響モデルによる評価法は韻律面をどれだけ反映できるのか?2010

    • Author(s)
      山内 豊,峯松信明,羅徳安,川村明美
    • Journal Title

      外国語教育メディア学会 50回全国研究大会講演集

      Pages: 178-179

    • Related Report
      2012 Final Research Report
    • Peer Reviewed
  • [Journal Article] Regularized-MLLR speaker adaptation for computer-aided language learning system2010

    • Author(s)
      D. Luo, Y. Qiao, N. Minematsu, Y. Yamauchi, and K. Hirose
    • Journal Title

      Proceedings of INTERSPEECH

      Pages: 594-597

    • Related Report
      2012 Final Research Report
    • Peer Reviewed
  • [Journal Article] 総合的英語熟達度がシャドーイング・パフォーマンスに与える影響の分析2010

    • Author(s)
      山内豊, 峯松信明, 羅徳安, 川村明美
    • Journal Title

      外国語教育メディア学会関東支部大会発表要項

      Volume: 1 Pages: 12-13

    • Related Report
      2010 Annual Research Report
    • Peer Reviewed
  • [Journal Article] シャドーイングの評価方法:再生率と音響モデルによる評価法は韻律面をどれだけ反映できるのか?2010

    • Author(s)
      山内豊, 峯松信明, 羅徳安, 川村明美
    • Journal Title

      外国語教育メディア学会全国研究大会講演集項

      Volume: 1 Pages: 178-179

    • Related Report
      2010 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Regularized-MLLR speaker adaptation for computer-aided language learnine system2010

    • Author(s)
      D.Luo, Y.Qiao, N.Minematsu, Y.Yamauchi, K.Hirose
    • Journal Title

      Proceedings of INTERSPEECH 2010

      Volume: 1 Pages: 594-597

    • Related Report
      2010 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Development of a Network-based Learning System to Enhance EFL Vocabulary Knowledge2009

    • Author(s)
      Y. Yamauchi, K.Husky and A. Kawamura
    • Journal Title

      東京国際大学論叢商学部編

      Volume: 第79号 Pages: 105-124

    • NAID

      40016623722

    • Related Report
      2012 Final Research Report 2009 Annual Research Report
    • Peer Reviewed
  • [Journal Article] TOEIC スコアが予測可能? 「シャドーイング自動評定システム」2009

    • Author(s)
      山内 豊,峯松信明,羅徳安
    • Journal Title

      多聴多読マガジン

      Volume: 17号 Pages: 30-32

    • Related Report
      2012 Final Research Report
  • [Journal Article] Analysis and Comparison of Automatic Language Proficiency Assessment between Shadowed Sentences and Read Sentences2009

    • Author(s)
      Dean Luo, Nobuaki Minematsu, Yutaka Yamauchi,Keikichi Hirose
    • Journal Title

      Proc. ISCA Workshop on Speech and Language Technology in Education

      Pages: 13-13

    • Related Report
      2012 Final Research Report
    • Peer Reviewed
  • [Journal Article] 音声情報処理技術を活用したシャドーイング自動評価システムの開発2009

    • Author(s)
      山内 豊, 峯松信明,羅徳安,川村明美
    • Journal Title

      外国語教育メディア学会 49回全国研究大会講演集

      Pages: 178-179

    • Related Report
      2012 Final Research Report
    • Peer Reviewed
  • [Journal Article] TOEICスコアが予測可能? シャドーイング自動評定システム2009

    • Author(s)
      山内豊・峯松信明・羅徳安
    • Journal Title

      多聴多読マガジン

      Volume: Vol.17 Pages: 30-32

    • Related Report
      2009 Annual Research Report
  • [Journal Article] Analysis and Comparison of Automatic Language Proficiency Assessment between Shadowed Sentences and Read Sentences2009

    • Author(s)
      Dean Luo, Nobuaki Minematsu, Yutaka Yamauchi, Keikichi Hirose
    • Journal Title

      Proc.ISCA Workshop on Speech and Language Technology in Education

      Volume: (www.eee.bham.ac.uk/SLaTE2009/papers/SLaTE2009-20-v2.pdf) Pages: 13-13

    • Related Report
      2009 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Analysis and Utilization of MLLR Speaker Adaptation Technique for Learners' Pronunciation Evaluation2009

    • Author(s)
      Dean Luo, Yu Qiao, Nobuaki Minematsu, Yutaka Yamauchi, Keikichi Hirose
    • Journal Title

      Proc.INTERSPEECH 2009

      Pages: 608-611

    • Related Report
      2009 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 音声情報処理技術を活用したシャドーイング自動評価システムの開発2009

    • Author(s)
      山内豊, 峯松信明, 羅徳安, 川村明美
    • Journal Title

      外国語教育メディア学会全国研究大会講演集

      Pages: 178-179

    • Related Report
      2009 Annual Research Report
    • Peer Reviewed
  • [Journal Article] コンテンツ・シャドーイングと英語熟達度の関係2009

    • Author(s)
      山内豊, 峯松信明, 羅徳安, 川村明美
    • Journal Title

      外国語教育メディア学会関東支部大会発表要項

      Pages: 6-7

    • Related Report
      2009 Annual Research Report
    • Peer Reviewed
  • [Presentation] Investigation on the possibility of shadowing as an overall proficiency test2011

    • Author(s)
      Yutaka Yamauchi
    • Organizer
      2nd Combined Conference of the Applied Linguistics Association of Australia and Applied Linguistics Association of New Zealand
    • Place of Presentation
      Australian National University, Australia
    • Year and Date
      2011-12-02
    • Related Report
      2012 Final Research Report
  • [Presentation] 英語シャドーイング評価における評価者間のずれと信頼性に関する分析2011

    • Author(s)
      山内豊,峯松信明,川村明美,西川惠
    • Organizer
      教育メディア学会関東支部第127回研究大会
    • Place of Presentation
      拓殖大学
    • Year and Date
      2011-11-12
    • Related Report
      2012 Final Research Report
  • [Presentation] How to assess shadowing performance: Manual or automatic?2011

    • Author(s)
      Yutaka Yamauchi
    • Organizer
      16th World Congress of Applied Linguistics
    • Place of Presentation
      Beijing Foreign Studies University, China
    • Year and Date
      2011-08-25
    • Related Report
      2012 Final Research Report
  • [Presentation] シャドーイングの自動評価の妥当性に関する観点別評価面からの考察2011

    • Author(s)
      山内豊,峯松信明,羅徳安,川村明美
    • Organizer
      外国語教育メディア学会第51回全国研究大会
    • Place of Presentation
      名古屋学院大学
    • Year and Date
      2011-08-07
    • Related Report
      2012 Final Research Report
  • [Presentation] 英語シャドーイング評価の試み:全体的印象評価と観点別評価の関係2011

    • Author(s)
      山内豊,峯松信明,羅徳安,川村明美,西川惠
    • Organizer
      外国語教育メディア学会関東支部 126回研究大会
    • Place of Presentation
      学習院女子大学
    • Year and Date
      2011-06-11
    • Related Report
      2012 Final Research Report
  • [Presentation] How to assess shadowing performance: Manual or automatic?2011

    • Author(s)
      Yutaka Yamauchi
    • Organizer
      16th World Congress of Applied Linguistics
    • Place of Presentation
      Beijing Foreign Studies University
    • Related Report
      2011 Annual Research Report
  • [Presentation] Investigation on the possibility of shadowing as an overall proficiency test2011

    • Author(s)
      Yutaka Yamauchi
    • Organizer
      2nd Combined Conference of the Applied Linguistics Association of Australia and Applied Linguistics Association of New Zealand
    • Place of Presentation
      Australian National University
    • Related Report
      2011 Annual Research Report
  • [Presentation] シャドーイングの自動評価の妥当性に関する観点別評価面からの考察2011

    • Author(s)
      山内 豊
    • Organizer
      外国語教育メディア学会第51回全国研究大会
    • Place of Presentation
      •名古屋学院大学(名古屋キャンパス)
    • Related Report
      2011 Annual Research Report
  • [Presentation] 英語シャドーイング評価の試み:全体的印象評価と観点別評価の関係2011

    • Author(s)
      山内 豊
    • Organizer
      外国語教育メディア学会関東支部126回研究大会
    • Place of Presentation
      学習院女子大学
    • Related Report
      2011 Annual Research Report
  • [Presentation] 英語シャドーイング評価における評価者間のずれと信頼性に関する分析2011

    • Author(s)
      山内 豊
    • Organizer
      外国語教育メディア学会関東支部第127回研究大会
    • Place of Presentation
      拓殖大学(文京キャンパス)
    • Related Report
      2011 Annual Research Report
  • [Presentation] Regularized-MLLR speaker adaptation for computer-aided language learning system2010

    • Author(s)
      D. Luo, Y. Qiao, N. Minematsu, Y. Yamauchi, and K. Hirose
    • Organizer
      INTERSPEECH 2010
    • Place of Presentation
      幕張メッセ国際会議場
    • Year and Date
      2010-09-27
    • Related Report
      2012 Final Research Report
  • [Presentation] Regularized-MLLR speaker adaptation for computer-aided language learnine system2010

    • Author(s)
      D.Luo, Y.Qiao, N.Minematsu, Y.Yamauchi, K.Hirose
    • Organizer
      INTERSPEECH 2010
    • Place of Presentation
      幕張メッセ国際会議場
    • Year and Date
      2010-09-27
    • Related Report
      2010 Annual Research Report
  • [Presentation] Speech analysis for automatic evaluation of shadowing2010

    • Author(s)
      D. Luo, Y. Yamauchi, and N. Minematsu
    • Organizer
      Second Language Studies: Acquisition, Learning, Education and Technology
    • Place of Presentation
      早稲田大学・国際会議場
    • Year and Date
      2010-09-23
    • Related Report
      2012 Final Research Report
  • [Presentation] Speech analysis for automatic evaluation of shadowing2010

    • Author(s)
      D.Luo, Y.Yamauchi, N.Minematsu
    • Organizer
      Second Language Studies : Acquisition, Learning, Education and Technology
    • Place of Presentation
      早稲田大学・国際会議場
    • Year and Date
      2010-09-23
    • Related Report
      2010 Annual Research Report
  • [Presentation] シャドーイングの評価方法:再生率と音響モデルによる評価法は韻律面をどれだけ反映できるのか?2010

    • Author(s)
      山内 豊, 峯松信明,羅徳安, 川村明美
    • Organizer
      外国語教育メディア学会全国研究大会
    • Place of Presentation
      横浜サイエンスフロンティア高校
    • Year and Date
      2010-08-06
    • Related Report
      2012 Final Research Report 2010 Annual Research Report
  • [Presentation] 総合的英語熟達度がシャドーイング・パフォーマンスに与える影響の分析2010

    • Author(s)
      山内 豊,峯松信明,羅徳安,川村明美
    • Organizer
      外国語教育メディア学会関東支部大会
    • Place of Presentation
      大東文化大学
    • Year and Date
      2010-06-05
    • Related Report
      2012 Final Research Report
  • [Presentation] 総合的英語熟達度がシャドーイング・パフォーマンスに与える影響の分析2010

    • Author(s)
      山内豊, 峯松信明, 羅徳安, 川村明美
    • Organizer
      外国語教育メディア学会関東支部大会
    • Place of Presentation
      大東文化大学(板橋キャンパス)
    • Year and Date
      2010-06-05
    • Related Report
      2010 Annual Research Report
  • [Presentation] Analysis and Utilization of MLLR Speaker Adaptation, Technique for Learners' Pronunciation Evaluation2009

    • Author(s)
      D. Luo, N, Minematsu, Y. Yamauchi
    • Organizer
      INTERSPEECH 2009
    • Place of Presentation
      Brighton Centre, Brighton, U.K
    • Year and Date
      2009-09-07
    • Related Report
      2012 Final Research Report
  • [Presentation] Analysis and Utilization of MLLR Speaker Adaptation Technique for Learners' Pronunciation Evaluation2009

    • Author(s)
      Dean Luo, Yu Qiao, Nobuaki Minematsu, Yutaka Yamauchi, Keikichi Hirose
    • Organizer
      INTERSPEECH 2009
    • Place of Presentation
      Brighton Centre, Brighton, U.K.
    • Year and Date
      2009-09-07
    • Related Report
      2009 Annual Research Report
  • [Presentation] Development of a CALL System to Enhance ESL/EFL Learners' Skills of Shadowing and Reading Aloud Using Speech Information Processing Technology2009

    • Author(s)
      D.Luo, N,Minematsu, Y.Yamauchi
    • Organizer
      ISCA Workshop on Speech and Language Technology in Education
    • Place of Presentation
      Mansion, Wroxall Abbey Estate, U.K.
    • Year and Date
      2009-09-04
    • Related Report
      2009 Annual Research Report
  • [Presentation] Analysis and comparison of automatic language proficiency Assessment between shadowed sentences and read sentences2009

    • Author(s)
      D. Luo, N, Minematsu, Y. Yamauchi, &K. Hirose
    • Organizer
      ISCA Workshop on Speech and Language, Technology in Education
    • Place of Presentation
      Wroxall Abbey Estate, U.K
    • Year and Date
      2009-09-03
    • Related Report
      2012 Final Research Report
  • [Presentation] Analysis and comparison of automatic language proficiency Assessment between shadowed sentences and read sentences2009

    • Author(s)
      D.Luo, N, Minematsu, Y.Yamauchi, K.Hirose
    • Organizer
      ISCA Workshop on Speech and Language Technology in Education
    • Place of Presentation
      Wroxall Abbey Estate, U.K.
    • Year and Date
      2009-09-03
    • Related Report
      2009 Annual Research Report
  • [Presentation] 音声情報処理技術を活用したシャドーイング自動評価システムの開発2009

    • Author(s)
      山内 豊,峯松信明,羅徳安,川村明美
    • Organizer
      外国語教育メディア学会全国研究大会
    • Place of Presentation
      流通経済大学(神戸市)
    • Year and Date
      2009-08-06
    • Related Report
      2012 Final Research Report 2009 Annual Research Report
  • [Presentation] コンテンツ・シャドーイングと英語熟達度の関係2009

    • Author(s)
      山内 豊,峯松信明,羅徳安,川村明美
    • Organizer
      外国語教育メディア学会関東支部大会
    • Place of Presentation
      拓殖大学
    • Year and Date
      2009-06-13
    • Related Report
      2012 Final Research Report
  • [Presentation] コンテンツ・シャドーイングと英語熟達度の関係2009

    • Author(s)
      山内豊・峯松信明・羅徳安・川村明美
    • Organizer
      外国語教育メディア学会関東支部大会
    • Place of Presentation
      拓殖大学(東京都文京区)
    • Year and Date
      2009-06-13
    • Related Report
      2009 Annual Research Report

URL: 

Published: 2009-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi