• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

表情とパラ言語を自動評価する非言語コミュニケーション能力育成教材の開発と実践評価

Research Project

Project/Area Number 21K00675
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Review Section Basic Section 02100:Foreign language education-related
Research InstitutionUniversity of Toyama

Principal Investigator

COOPER T・D  富山大学, 学術研究部教養教育学系, 准教授 (70442449)

Co-Investigator(Kenkyū-buntansha) 的場 隆一  富山高等専門学校, その他部局等, 准教授 (30592323)
塚田 章  富山高等専門学校, その他部局等, 教授 (40236849)
Project Period (FY) 2021-04-01 – 2025-03-31
Project Status Granted (Fiscal Year 2023)
Budget Amount *help
¥3,770,000 (Direct Cost: ¥2,900,000、Indirect Cost: ¥870,000)
Fiscal Year 2023: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2022: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Fiscal Year 2021: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Keywordsfacial expression / eye gaze tracking / nonverbal communication / online job interviews / action research / Facial expression / AI / mock interviews / online interviews / gaze tracking / kinect camera / mock job interview / L1 L2 differences / paralanguage
Outline of Research at the Start

The system will automatically assess the NVC skills of both student’s language interviews and presentations; specifically, users will be given immediate feedback on the quantity and quality of their facial expression, and their spoken answers to real-life situations.

Outline of Annual Research Achievements

We increased the number of questions we asked to students to eleven questions, with five in Japanese and six in English. We also incorporated a Japanese native speaking English teacher to act as an interiewer and assessor for the interviews. Furthermore, we began testing a new group of interviewees to increase our data that we have collected over the last 3 years. The software and system that we designed was modified to include both AI-related facial expression assessment and eye gaze analysis. Our finding were presented at the ASIA TEFL 2023 conference in Daejeon, Korea, and the SITE 2024 conference in Nevada, USA. Our paper was aceepted by the proceedings for that conference and pub;ised in March.

Current Status of Research Progress
Current Status of Research Progress

3: Progress in research has been slightly delayed.

Reason

COVID delayed the start of this research grant, and forced us to pivot from carrying out face to face interviews into online only interviews. But we have gotten back on track with presenting our research to the public.

Strategy for Future Research Activity

Increase database to 15 questions with more students. Modification and design of software and system prototype. Write project report and publish and present at one domestic and one foreign conference.

Report

(3 results)
  • 2023 Research-status Report
  • 2022 Research-status Report
  • 2021 Research-status Report
  • Research Products

    (8 results)

All 2023 2022

All Journal Article (1 results) (of which Peer Reviewed: 1 results) Presentation (7 results) (of which Int'l Joint Research: 7 results)

  • [Journal Article] Culturally connecting online: how our facial expressions change across languages (a primary study)2023

    • Author(s)
      Todd Cooper, Akira Tsukada, Ryuichi Matoba, Ren No, Miho Takano
    • Journal Title

      Society for Information Technology & Teacher Education International Conference 2024

      Volume: 2023 Pages: 437-441

    • Related Report
      2023 Research-status Report
    • Peer Reviewed
  • [Presentation] Using AI to Ace Online Zoom Interviews2023

    • Author(s)
      Todd Cooper, Akira Tsukada, & Ryuichi Matoba
    • Organizer
      21st AsiaTEFL International Conference (AsiaTEFL 2023)
    • Related Report
      2023 Research-status Report
    • Int'l Joint Research
  • [Presentation] Tech Disruptors to Education: How artificial intelligence and Chat GPT influences the future2023

    • Author(s)
      Robert Dykes & Todd Cooper
    • Organizer
      21st AsiaTEFL International Conference (AsiaTEFL 2023)
    • Related Report
      2023 Research-status Report
    • Int'l Joint Research
  • [Presentation] Verification of the Emergence of a Hierarchical Structure of Language through Cultural Inheritance with Consideration of the Mother Tongue2023

    • Author(s)
      Taichi Masui, Ryuichi Matoba, Cooper Todd
    • Organizer
      AROB-ISBC-SWARM 2023
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] A Study of an Interview Evaluation System Considering Eye Gaze Information2023

    • Author(s)
      Takeru Kobayashi, Ryuichi Matoba, Kaori Fukagawa, Akira Tsukada, Cooper Todd
    • Organizer
      AROB-ISBC-SWARM 2023
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] De-Kinecting to Connect: Using Older Technology to Increase bettier learning connections2023

    • Author(s)
      Todd Cooper, Akira Tsukada, Kaori Fukagawa, Ryuichi Matoba
    • Organizer
      19th Annual CamTESOL Conference on English Language Teaching
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] Two Languages, One Face: a primary study in how our facial expressions change across languages2022

    • Author(s)
      Todd Cooper, Akira Tsukada, Kaori Fukagawa, Ryuichi Matoba
    • Organizer
      EDIL-EdMEDIA 2022
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] Two Languages, One Face: a primary study in how our facial expressions change across languages2022

    • Author(s)
      Todd Cooper, Akira Tsukada, Kaori Fukagawa
    • Organizer
      ALANZ/ALAA/ALTAANZ 2022
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research

URL: 

Published: 2021-04-28   Modified: 2024-12-25  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi