Developing and Validating AI-Powered Interactive Role-Play Tasks for Assessing L2 Pragmatic Competence

• Project/Area Number: 25K00483
• Research Category: Grant-in-Aid for Scientific Research (B)
• Allocation Type: Multi-year Fund
• Section: 一般
• Review Section: Basic Section 02100:Foreign language education-related
• Research Institution: Kansai University
• Principal Investigator: 新谷 奈津子 関西大学, 外国語学部, 教授 (60815778)
• Co-Investigator(Kenkyū-buntansha): 山下 太一 関西大学, 外国語学部, 助教 (50994620) ; 小泉 利恵 筑波大学, 人文社会系, 教授 (70433571) ; 大和 知史 関西大学, 外国語学部, 教授 (80370005) ; 水本 篤 関西大学, 外国語学部, 教授 (80454768) ; 菅井 康祐 近畿大学, 経済学部, 教授 (90454636)
• Project Period (FY): 2025-04-01 – 2029-03-31
• Project Status: Granted (Fiscal Year 2025)
• Budget Amount: ¥26,000,000 (Direct Cost: ¥20,000,000、Indirect Cost: ¥6,000,000); Fiscal Year 2028: ¥5,200,000 (Direct Cost: ¥4,000,000、Indirect Cost: ¥1,200,000); Fiscal Year 2027: ¥7,930,000 (Direct Cost: ¥6,100,000、Indirect Cost: ¥1,830,000); Fiscal Year 2026: ¥4,550,000 (Direct Cost: ¥3,500,000、Indirect Cost: ¥1,050,000); Fiscal Year 2025: ¥8,320,000 (Direct Cost: ¥6,400,000、Indirect Cost: ¥1,920,000)
• Keywords: L2 Pragmatics / TBLT / Study Abroad

Outline of Research at the Start

The project adopts a unique approach to assessing L2 learners' pragmatic abilities through the innovative use of AI technology. We will examine the reliability and validity of this system as a test of L2 pragmatic ability, with the secondary goal of proposing a practical tool for measuring pragmatic competence.
We will develop six role-play tasks incorporating various speech acts in scenarios relevant to university students. To validate our system, we will administer these role-play tasks to English learners with diverse proficiency levels and learning experiences, including study abroad.