• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

The Research and Development of an Automatic Evaluation System for Oral Communication Proficiency

Research Project

Project/Area Number 17520406
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field Foreign language education
Research InstitutionOsaka Women's College

Principal Investigator

TEAMAN Brian D.  Osaka Women's College, English Department, Professor, 国際・英語学部, 教授 (20294481)

Co-Investigator(Kenkyū-buntansha) TAMURA Takeshi  Kobe Institute of Computing, Graduate School of Information Technology, Professor, 情報技術研究科, 教授 (60291605)
MCCARTY Steve A.  Osaka Women's Junior College, English Department, Professor, 英語科, 教授 (90290585)
Project Period (FY) 2005 – 2006
Project Status Completed (Fiscal Year 2006)
Budget Amount *help
¥1,800,000 (Direct Cost: ¥1,800,000)
Fiscal Year 2006: ¥600,000 (Direct Cost: ¥600,000)
Fiscal Year 2005: ¥1,200,000 (Direct Cost: ¥1,200,000)
KeywordsEnglish / Foreign Language / Phonetics / Education / CALL / Automatic Speech Recognition
Research Abstract

The current speaking test system consists of three types of users : students, teachers and administrators. Students can register, take tests and change their profile (including adding themselves to classes and changing their password). The teacher users are the most important part of the system and can perform many functions like the following: 1. Teachers can grade tests which involves selecting a student's tests and listening to it and applying a rating to it. From the test grading module, teachers can easily see a list of all students who have taken a particular test, choose tests to grade and then evaluate each item using a five-level scale that can be applied to any token depending how the teacher wants to grade it. For example the scale could refer to overall comprehensibility or focus on one aspect such as whether the answer is correct or the pronunciation is correct. 2. The teacher can also control the machine-grading system. To do this the teacher must create grammars and dictionaries in order to perform the machine grading. The machine-grader then gives a score from 0 to 100 depending on how accurately the spoken word matches the teacher-created model. 3. The teacher can also manage classes and tests. The administrator can use their account to manage teachers and their accounts.
There are currently 152 different users registered on the MASLE system. These users have taken ten different tests making a total of over 2000 different test items recorded. There are currently four different machine-gradable tests that have been given to 25 native Japanese speakers and five different native English speakers to test the accuracy of the speech recognition system. The results showed that machine recognition is very promising since non-native speakers ranged from about 30 to 80 (out of 100) and native speakers ranged from 80 to 100.

Report

(3 results)
  • 2006 Annual Research Report   Final Research Report Summary
  • 2005 Annual Research Report
  • Research Products

    (4 results)

All 2006 2005

All Journal Article (4 results)

  • [Journal Article] Machine-Aided Spoken Language Evaluation : The Current Approach2006

    • Author(s)
      Teaman, B.T.
    • Journal Title

      Osaka Jogakuin College Vol.2

      Pages: 75-81

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Machine-Aided Spoken Language Evaluation : The Test Delivery Module2005

    • Author(s)
      Teaman, B., T.Tamura, S.McCarty
    • Journal Title

      Proceedings of JELA

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Machine-Aided Spoken Language Evaluation : The Test Delivery Module2005

    • Author(s)
      Brian Teaman, Steve McCarty, 田村武志
    • Journal Title

      Proceedings of the Japan E-Learning Association

      Pages: 11-14

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Machine-Aided Spoken Language Evaluation : The Current Approach2005

    • Author(s)
      Brian Teaman
    • Journal Title

      大阪女学院大学紀要 2

      Pages: 75-81

    • Related Report
      2005 Annual Research Report

URL: 

Published: 2005-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi