• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Construction of Exam Corpus and its application to making and improving language tests

Research Project

Project/Area Number 20K00814
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Review Section Basic Section 02100:Foreign language education-related
Research InstitutionTokai University

Principal Investigator

Usami Hiroko  東海大学, 教養学部, 准教授 (20734825)

Project Period (FY) 2020-04-01 – 2024-03-31
Project Status Completed (Fiscal Year 2023)
Budget Amount *help
¥4,290,000 (Direct Cost: ¥3,300,000、Indirect Cost: ¥990,000)
Fiscal Year 2022: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Fiscal Year 2021: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Fiscal Year 2020: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Keywordsコーパス / 言語テスト / 日本の大学入試問題 / 語彙・文法問題 / 英検 / TEAP / TOEFL / TOEIC
Outline of Research at the Start

本研究は、日本人大学生英語学習者による英作文を収集した「英作文コーパス」を含め、大学入試問題、英検、TEAP、Cambridge English Qualifications、Linguaskill、TOEFL ITP、TOEICの語彙・文法の過去問題を収集し、各問題にテスト名、技能(語彙/文法)、語彙・文法項目、CEFRレベル、難易度、弁別度、錯乱肢の選択率をタグ付した「Exam Corpus」を構築して、コーパスとコーパスの検索・分析技術が言語テスト分野(言語テスト作成・改良)にどのように応用できるかについて検証する。

Outline of Final Research Achievements

In this research, I constructed the Exam Corpus containing multiple-choice vocabulary and grammar questions tested by 2023 and examined the English proficiency tests using corpus analytical techniques.
For example, (1) I extracted the vocabulary question items frequently tested across CEFR levels in the vocabulary questions in the English proficiency tests, (2) I examined the English used in the stems of vocabulary question items (e.g. phrasal verbs) frequently tested in the English proficiency tests and compared them to the British National Corpus, (3) I examined the English presented in short conversation questions in Japanese university entrance examination, (4) I examined how corpus analytical techniques (especially, search syntax) can be applied to make vocabulary and grammar questions in the English proficiency tests.

Academic Significance and Societal Importance of the Research Achievements

語彙・文法4択問題と会話問題を収集した「Exam Corpus」の構築と、コーパスの検索・分析技術を使用して英語検定テストを様々な点から検証した結果、
1)CEFRレベルごとにどの語彙項目が頻出か、2)語彙問題で使用されている問題文が実際に使用されている英語と異なること、3)短い会話問題に使用されている英語、出題されている項目、4)コーパスの検索技術を使用した効果的な語彙・文法問題の作成を検証・発見することができた。

Report

(5 results)
  • 2023 Annual Research Report   Final Research Report ( PDF )
  • 2022 Research-status Report
  • 2021 Research-status Report
  • 2020 Research-status Report
  • Research Products

    (13 results)

All 2024 2023 2022 2021 Other

All Int'l Joint Research (4 results) Journal Article (6 results) (of which Peer Reviewed: 6 results,  Open Access: 6 results) Presentation (3 results) (of which Int'l Joint Research: 3 results)

  • [Int'l Joint Research] Lancaster University(英国)

    • Related Report
      2023 Annual Research Report
  • [Int'l Joint Research] Lancaster University(英国)

    • Related Report
      2022 Research-status Report
  • [Int'l Joint Research] Lancaster University(英国)

    • Related Report
      2021 Research-status Report
  • [Int'l Joint Research] Lancaster University(英国)

    • Related Report
      2020 Research-status Report
  • [Journal Article] Using Corpus Search Syntax to Develop Vocabulary and Grammar Questions2024

    • Author(s)
      Hiroko Usami
    • Journal Title

      Hawaii International Conference on Education 2024 Conference Proceedings

      Volume: 22 Pages: 341-361

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Using Corpus Analytical Techniques for Language Testing: Identifying Frequent Question Items and Examining Authenticity2023

    • Author(s)
      Hiroko Usami
    • Journal Title

      Hawaii International Conference on Education 2023 Conference Proceedings

      Volume: 21 Pages: 418-438

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Examining short conversation questions' use of English with the Exam Corpus2023

    • Author(s)
      Hiroko Usami
    • Journal Title

      東海大学教養学部紀要

      Volume: 54 Pages: 15-32

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Applying the Exam Corpus to Inform Targeted Vocabulary in Synonym Questions in Japanese University Entrance Examinations2022

    • Author(s)
      Hiroko Usami
    • Journal Title

      東海大学紀要. 語学教育センター

      Volume: 1 Pages: 1-17

    • DOI

      10.18995/24367532.1.1

    • ISSN
      2436-7532
    • URL

      https://opac-t.time.u-tokai.ac.jp/iwjs0018opc/TC10001622

    • Year and Date
      2022-03-31
    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Examining targeted phrasal verb items and their stems in multiple choice vocabulary questions using authenticity and frequency in general corpora2022

    • Author(s)
      Hiroko Usami
    • Journal Title

      東海大学教養学部紀要

      Volume: 53 Pages: 15-29

    • Related Report
      2022 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Applying Specialised Corpora to Language Testing : Development of the Exam Corpus (Vocabulary and Grammar Sections)2021

    • Author(s)
      Hiroko Usami
    • Journal Title

      東海大学紀要. 国際教育センター

      Volume: 3 Issue: 1 Pages: 1-13

    • DOI

      10.18995/24347337.3-1.1

    • NAID

      120007017470

    • ISSN
      2434-7337
    • URL

      https://opac-t.time.u-tokai.ac.jp/iwjs0018opc/TC10003044

    • Year and Date
      2021-03-31
    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access
  • [Presentation] Using Corpus Search Syntax for Language Testing: Developing Vocabulary and Grammar Question Items2023

    • Author(s)
      Hiroko Usami
    • Organizer
      Hawaii International Conference on Education
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Using Corpus Analytical Techniques for Language Testing: Identifying Frequent Question Items and Examining Authenticity2022

    • Author(s)
      Hiroko Usami
    • Organizer
      Hawaii International Conference On Education
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] Examining the English used in multiple-choice vocabulary questions using authenticity presented in corpora2021

    • Author(s)
      Hiroko Usami
    • Organizer
      Language Testing Forum (LTF)
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research

URL: 

Published: 2020-04-28   Modified: 2025-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi