• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Development and Evaluation of Immersive VR Training System for English Learners4-skill Testing

Research Project

Project/Area Number 16H03079
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Educational technology
Research InstitutionKyushu University

Principal Investigator

Fuyuno Miharu  九州大学, 芸術工学研究院, 助教 (30642681)

Co-Investigator(Kenkyū-buntansha) 齊藤 剛史  九州工業大学, 大学院情報工学研究院, 教授 (10379654)
土屋 慶子  横浜市立大学, 国際教養学部(教養学系), 准教授 (20631823)
山田 祐樹  九州大学, 基幹教育院, 准教授 (60637700)
山下 友子  芝浦工業大学, 工学部, 准教授 (10726334)
中島 祥好  九州大学, 芸術工学研究院, 教授 (90127267)
川瀬 義清  西南学院大学, 文学部, 教授 (20108616)
Project Period (FY) 2016-04-01 – 2022-03-31
Project Status Completed (Fiscal Year 2021)
Budget Amount *help
¥16,770,000 (Direct Cost: ¥12,900,000、Indirect Cost: ¥3,870,000)
Fiscal Year 2019: ¥2,730,000 (Direct Cost: ¥2,100,000、Indirect Cost: ¥630,000)
Fiscal Year 2018: ¥3,510,000 (Direct Cost: ¥2,700,000、Indirect Cost: ¥810,000)
Fiscal Year 2017: ¥4,680,000 (Direct Cost: ¥3,600,000、Indirect Cost: ¥1,080,000)
Fiscal Year 2016: ¥5,850,000 (Direct Cost: ¥4,500,000、Indirect Cost: ¥1,350,000)
Keywordsバーチャルリアリティ / VR / パブリックスピーキング / プレゼンテーション / 教材開発 / マルチメディア教材 / 仮想現実 / 英語教育 / スピーチ / ヘッドマウントディスプレイ / AR / スピーチ教育 / 注視点解析 / バーチャルリアリティー / アイコンタクト / アイトラッキング / 学習支援システム / アバター / 教育工学 / 音声学 / 英語
Outline of Final Research Achievements

This study developed a virtual reality public speaking practice system for Japanese learners of English and verified its effectiveness. As virtual audience, we implemented two modes, large-group scenes and a small-group scene, and developed a function to let users practice eye contact and appropriate speaking speed experientially, and to measure the degree of nervousness, and automatically give feedback on these. High evaluations were obtained for effectiveness and usability from verification experiments.

Academic Significance and Societal Importance of the Research Achievements

英語でのパブリックスピーキングスキルは、国際化が進む社会の中で強く求められているにも関わらず、一斉指導の難しさや自己練習の難しさ、また定量的観点に基づく教材の不足など複数の要因によって、英語教育の中でも習得や指導が難しいものである。本研究によって体感的な自己練習が可能なVR学習システムが開発されたことで、学校・大学における授業や自己練習など、さまざまな場面で教育に資すると期待される。

Report

(6 results)
  • 2021 Annual Research Report   Final Research Report ( PDF )
  • 2020 Annual Research Report
  • 2019 Annual Research Report
  • 2017 Annual Research Report
  • 2016 Annual Research Report
  • Research Products

    (32 results)

All 2021 2020 2019 2018 2017 2016 Other

All Journal Article (14 results) (of which Int'l Joint Research: 1 results,  Peer Reviewed: 10 results,  Open Access: 6 results,  Acknowledgement Compliant: 4 results) Presentation (15 results) (of which Int'l Joint Research: 11 results,  Invited: 1 results) Remarks (1 results) Patent(Industrial Property Rights) (2 results)

  • [Journal Article] Development of 3D Computer Graphics Avatars for VR Communication Education System based on Gesture Unit Analysis2021

    • Author(s)
      Miharu Fuyuno
    • Journal Title

      Proceedings of International Conference for Media in Education 2021

      Volume: - Pages: 303-308

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Immersive 360-degree video as a medium for teacher-led VR material development2021

    • Author(s)
      Blanco, L. M. C., Fuyuno, M., & Tomotari, M.
    • Journal Title

      Proceedings of The Japan Association for Language Education and Technology (LET) 60th Annual National Conference

      Volume: - Pages: 176-177

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 英語プレゼンテーション視聴時の学習者の視線解析:客観的指標の抽出2021

    • Author(s)
      大野幸久, 冬野美晴
    • Journal Title

      外国語教育メディア学会第60回全国研究大会要項集

      Volume: - Pages: 96-97

    • Related Report
      2021 Annual Research Report
  • [Journal Article] Development and Evaluation of 360-degree VR Training System for English Public Speaking: Cross-analysis with Participants' Proficiency2020

    • Author(s)
      Miharu Fuyuno
    • Journal Title

      Proceedings of International Conference for Media in Education 2020

      Volume: 1 Pages: 179-186

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Immersive video materials for standardized English-speaking tests: Development and ongoing application2020

    • Author(s)
      Laura Maria Cortes Blanco & Miharu Fuyuno
    • Journal Title

      Proceedings of International Conference for Media in Education 2020

      Volume: 1 Pages: 213-220

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Gaze-Point Analysis of EFL Learners while Watching English Presentations: Toward Effective Teaching2020

    • Author(s)
      Fuyuno, M., Saitoh, T., Yamashita, Y., & Yokomori, D.
    • Journal Title

      International Journal for Educational Media and Technology

      Volume: 14 Pages: 17-28

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] 360度没入体感型バーチャルリアリティ技術を用いた英語パブリックスピーキング練習用システムの開発2020

    • Author(s)
      冬野美晴・山下友子
    • Journal Title

      LET-KO Bulletin

      Volume: 20 Pages: 11-26

    • NAID

      130007878632

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] 英語プレゼンテーション動画視聴時の日本人英語学習者の注視点解析2019

    • Author(s)
      冬野美晴・山下友子・齊藤剛史・横森大輔
    • Journal Title

      本教育メディア学会年次大会プロシーディング

      Volume: 26 Pages: 127-128

    • Related Report
      2019 Annual Research Report
  • [Journal Article] Multimodal analysis of public speaking performance by EFL learners: Applying deep learning to understanding how successful speakers use facial movement2018

    • Author(s)
      Fuyuno, M., Komiya, R., and Saitoh, T.
    • Journal Title

      The Asian Journal of Applied Linguistics

      Volume: 4 Pages: 117-129

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] The effect of virtual eyes on psychological nervousness of public speakers2017

    • Author(s)
      Fuyuno, M., Yamashita, Y., Nakajima, Y.
    • Journal Title

      Proceedings of the 33rd Annual Meeting of the International Society for Psychophysics

      Volume: 33 Pages: 128-131

    • Related Report
      2017 Annual Research Report
  • [Journal Article] Semantic Structure, Speech Units and Facial Movements: Multimodal Corpus Analysis of English Public Speaking2017

    • Author(s)
      Fuyuno, M., Yamashita, Y., Saitoh, T., Nakajima, Y.
    • Journal Title

      EPiC Series in Language and Linguistics

      Volume: 1 Pages: 447-461

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] Head pose estimation and motion analysis of public speaking videos2017

    • Author(s)
      Komiya, R., Saitoh, T., Fuyuno, M., Yamashita, Y., Nakajima, Y.
    • Journal Title

      International Journal of Software Innovation

      Volume: 5 Pages: 57-71

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] 英語パブリックスピーキングにおける音声ポーズパターンとアイコンタクト動作パターンがパフォーマンスの総合評価へ及ぼす影響に関する統計的考察2017

    • Author(s)
      冬野美晴, 山下友子
    • Journal Title

      マルチモーダルコーパスデータに基づくパブリックスピーチの統計的解析

      Volume: なし Pages: 1-15

    • Related Report
      2016 Annual Research Report
    • Acknowledgement Compliant
  • [Journal Article] Head pose estimation and movement analysis for speech scene, Proc. of 15th IEEE/ACIS International Conference on Computer and Information Science2016

    • Author(s)
      Komiya, R., Saitoh, T., Fuyuno, M., Yamashita, Y., Nakajima, Y.
    • Journal Title

      Proc. of 15th IEEE/ACIS International Conference on Computer and Information Science

      Volume: なし Pages: 409-413

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Presentation] Applying Immersive Virtual Reality Technology for ELT2021

    • Author(s)
      Miharu FUYUNO
    • Organizer
      The British Association of Lecturers in English for Academic Purposes
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Multimodal Corpus Analysis of English Presentations for EFL teaching: Speech Contents, Speakers’ Behavior and Gaze Points of Audience2021

    • Author(s)
      Miharu Fuyuno & Takeshi Saitoh
    • Organizer
      CILC 2021
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Development of immersive virtual reality material for training English speech2021

    • Author(s)
      Miharu FUYUNO
    • Organizer
      The HKCPD International Conference 2021
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Multimodal Corpus Analysis of English Presentations for EFL teaching: Speech Contents, Speakers’ Behavior and Gaze Points of Audience2021

    • Author(s)
      Miharu Fuyuno & Takeshi Saitoh
    • Organizer
      International Conference on Corpus Linguistics 2021
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] プレゼンテーション時の話者の行動変化とオーディエンスの注視点解析の関連性2020

    • Author(s)
      冬野美晴・齊藤剛史
    • Organizer
      中島祥好先生退職記念ポスター・シンポジウム
    • Related Report
      2019 Annual Research Report
  • [Presentation] A quantitative analysis to characterize verbal and non-verbal behavior in public speaking performance2019

    • Author(s)
      uko Yamashita, Miharu Fuyuno, Yoshitaka Nakajima, Stanislava Antonijevic-Elliott, Mark A. Elliott & Sophia Arndt
    • Organizer
      35th Annual Meeting of the International Society for Psychophysics
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] The application of 360-degree video as a tool for standardized language testing material2019

    • Author(s)
      Laura Maria Cortes Blanco & Miharu Fuyuno
    • Organizer
      2019 Conference of Foreign Language Education and Technology (FLEAT) VII
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Development of 360-degree Immersive Virtual Reality Training System for English Speeches,2019

    • Author(s)
      Miharu Fuyuno & Yuko Yamashita
    • Organizer
      2019 Conference of Foreign Language Education and Technology (FLEAT) VII
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Virtual Reality Training System for English Public Speaking: Development and User Evaluation2019

    • Author(s)
      Miharu Fuyuno & Yuko Yamashita
    • Organizer
      17th Asia TEFL International Conference and the 6th FLLT International Conference
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 没入型バーチャル・リアリティによる英語パブリックスピーキング練習用システムの開発:マルチモーダルコーパス分析に基づく教材の展開2017

    • Author(s)
      冬野美晴
    • Organizer
      外国語教育メディア学会全国大会
    • Related Report
      2017 Annual Research Report
  • [Presentation] Analyzing Public Speaking for EAP Pedagogy: Factors of Better Performance2017

    • Author(s)
      Fuyuno, M., Komiya, R., Saitoh, T.
    • Organizer
      Faces of English 2: Teaching and Researching Academic and Professional English
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Quantitative analysis of English public speaking presented by Japanese EFL learners2017

    • Author(s)
      Liu, S., Nakajima, Y., Yamashita, Y., Fuyuno, M.
    • Organizer
      The 6th Conference of the Asia-Pacific Society for the Cognitive Sciences of Music
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] スピーチ訓練のためのバーチャルオーディエンスの開発と検証2016

    • Author(s)
      冬野美晴, 山田祐樹
    • Organizer
      日本教育メディア学会
    • Place of Presentation
      奈良教育大学
    • Related Report
      2016 Annual Research Report
  • [Presentation] Developing effective instructions to decrease Japanese speaker' s nervousness during English and Japanese public speeches: Evidence from psychological and physiological measurements2016

    • Author(s)
      Fuyuno, M., Yamada, Y., Yamashita, Y., Yoshitaka Nakajima.
    • Organizer
      31st International Congress of Psychology 2016 (ICP2016)
    • Place of Presentation
      パシフィコ横浜
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Multimodal Corpus Approach to Speech Psychology: The Effect of Public Speakers’ Facial Movements on Audience Reception2016

    • Author(s)
      Fuyuno, M., Yamashita, Y., Saitoh, T., Nakajima, Y.
    • Organizer
      31st International Congress of Psychology 2016 (ICP2016)
    • Place of Presentation
      パシフィコ横浜
    • Related Report
      2016 Annual Research Report
  • [Remarks] 冬野研究室研究シーズ紹介HP

    • URL

      https://fuyunolab.com/

    • Related Report
      2021 Annual Research Report
  • [Patent(Industrial Property Rights)] パブリックスピーキング支援装置、及びプログラム2017

    • Inventor(s)
      冬野美晴、山下友子、中島祥好、齊藤剛史
    • Industrial Property Rights Holder
      冬野美晴、山下友子、中島祥好、齊藤剛史
    • Industrial Property Rights Type
      特許
    • Industrial Property Number
      2017-185257
    • Filing Date
      2017
    • Acquisition Date
      2022
    • Related Report
      2021 Annual Research Report
  • [Patent(Industrial Property Rights)] パブリックスピーキング支援装置、及びプログラム2017

    • Inventor(s)
      冬野美晴、山下友子、齊藤剛史、中島祥好
    • Industrial Property Rights Holder
      冬野美晴、山下友子、齊藤剛史、中島祥好
    • Industrial Property Rights Type
      特許
    • Industrial Property Number
      2017-077706
    • Filing Date
      2017
    • Related Report
      2017 Annual Research Report

URL: 

Published: 2016-04-21   Modified: 2023-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi