• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Speech Intelligibility Model in Lecture Videos for Flipped Classrooms and Support for Creating Lecture Videos

Research Project

Project/Area Number 19K12266
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Review Section Basic Section 62030:Learning support system-related
Research InstitutionNagoya Institute of Technology

Principal Investigator

Ozono Tadachika  名古屋工業大学, 工学(系)研究科(研究院), 教授 (90324475)

Co-Investigator(Kenkyū-buntansha) 新谷 虎松  名古屋工業大学, 工学(系)研究科(研究院), 教授 (00252312)
Project Period (FY) 2019-04-01 – 2023-03-31
Project Status Completed (Fiscal Year 2022)
Budget Amount *help
¥4,420,000 (Direct Cost: ¥3,400,000、Indirect Cost: ¥1,020,000)
Fiscal Year 2021: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Fiscal Year 2020: ¥1,820,000 (Direct Cost: ¥1,400,000、Indirect Cost: ¥420,000)
Fiscal Year 2019: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Keywords反転講義 / オンデマンド講義 / 拡張現実感技術 / エージェント / 講義評価 / 受講態度評価 / エンゲージメント評価 / 表情推定 / 講義動画 / 講義映像作成支援 / 拡張現実感 / 受講態度推定 / 音声明瞭性
Outline of Research at the Start

授業と宿題の役割が反転した新たな授業形態である反転講義において,予習用の教材である講義映像の編集における負担を軽減するための支援が必要である.可聴性を阻害する話者の癖を調整し音声明瞭性の高い理想的な状態に講義映像を変換するための技術開発において「単に講義映像を理想的な音声に変換すれば講義理解度は高まるのか?」という問いに取り組む.本課題では(1)講義映像における音声明瞭性のモデル化,(2)音声明瞭性を向上させる音声処理の実現,(3)音声明瞭性を調整可能な講義映像作成支援システムの開発を行う.講義の聞きやすさに関する理解を深め,得られた知見を応用システムに反映するプロセスをスパイラルに進める.

Outline of Final Research Achievements

Creating lecture videos, such as flipped classrooms and on-demand lectures, is an onerous task, and technologies are needed to support the creation of lecture videos. Filming a lecture and editing the recorded video is complicated and time-consuming. For example, editing the recorded video to make it easier for students to understand the lecture content (e.g., deleting unnecessary parts of the video) is necessary but burdensome. In addition, it is sometimes challenging to estimate students' responses to an online lecture. In this study, we exploratory developed experimental prototypes of an effective system and method to address these issues. Specifically, we developed a system to support the creation of interactive lecture videos using augmented reality space, a system to enable direct manipulation of writing in lecture videos and a technology to estimate students' responses online.

Academic Significance and Societal Importance of the Research Achievements

本研究の学術的意義は,講師と受講者の双方にとって有益な講義動画作成に必要な要素技術を探索的に試作することによって明らかにしたことである.また,オンライン講義において,受講者の反応推定が課題であるが,本講義では積極的に反応しない受講者をも考慮した推定手法を見いだしており,高い学術的意義がある.
本研究の社会的意義は,オンライン環境における講義の質の向上に寄与することである.また,反応に乏しい受講者を考慮することは,社会全体における学力の底上げに寄与すると考えている.今後も,学習環境のオンライン化および個人化が進展することから,本研究の社会的意義はとても高いといえる.

Report

(5 results)
  • 2022 Annual Research Report   Final Research Report ( PDF )
  • 2021 Research-status Report
  • 2020 Research-status Report
  • 2019 Research-status Report
  • Research Products

    (38 results)

All 2023 2022 2021 2020 2019

All Journal Article (18 results) (of which Peer Reviewed: 16 results,  Open Access: 11 results) Presentation (20 results) (of which Int'l Joint Research: 12 results)

  • [Journal Article] Development and Experiment of Classroom Engagement Evaluation Mechanism during Real-Time Online Courses2023

    • Author(s)
      Yanyi Peng, Masato Kikuchi, Tadachika Ozono
    • Journal Title

      Proc. of The 24th International Conference on Artificial Intelligence in Education (AIED 2023)

      Volume: AIED 2023

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Developing an AR Lecture Recording System with Direct Manipulation of Virtual Slides by Physical Objects2023

    • Author(s)
      Yuma Ito, Masato Kikuchi, Tadachika Ozono
    • Journal Title

      International Journal of Service and Knowledge Management

      Volume: 7 Issue: 1 Pages: 1

    • DOI

      10.52731/ijskm.v7.i1.737

    • ISSN
      2189-9223, 2189-9231
    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Developing a Meta-AR Space Construction System and Mapping Coverage Visualization2023

    • Author(s)
      Koki Yasue, Masato Kikuchi, Tadachika Ozono
    • Journal Title

      Applied Systemic Studies

      Volume: ICSEng 2022 Pages: 222-231

    • DOI

      10.1007/978-3-031-27470-1_21

    • ISBN
      9783031274695, 9783031274701
    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Developing a Lecture Video Recording System Using Augmented Reality2021

    • Author(s)
      Yuma Ito, Masato Kikuchi, Tadachika Ozono, Toramatsu Shintani
    • Journal Title

      In Proceedings of the 12th International Conference on E-Service and Knowledge Management

      Volume: IEEE, ESKM

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Online Classroom Evaluation System Based on Multi-Reaction Estimation2021

    • Author(s)
      Yanyi PENG, Masato Kikuchi, Tadachika Ozono
    • Journal Title

      The 20th IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology

      Volume: ACM, WI-AIT Pages: 500-505

    • DOI

      10.1145/3486622.3493984

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Product Information Browsing Support System Using Analytic Hierarchy Process2021

    • Author(s)
      Weijian Li, Masato Kikuchi, Tadachika Ozono
    • Journal Title

      The 20th IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology

      Volume: ACM, WI-AIT Pages: 623-628

    • DOI

      10.1145/3486622.3493985

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] A Context-aware Image Recognition System with Self-localization in Augmented Reality2021

    • Author(s)
      Ryosuke Suzuki, Tadachika Ozono, Toramatsu Shintani
    • Journal Title

      International Journal of Service and Knowledge Management International

      Volume: Vol. 5, No. 1

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Developing a Lecture Video Recording System Using Augmented Reality2021

    • Author(s)
      Yuma Ito, Masato Kikuchi, Tadachika Ozono, Toramatsu Shintani
    • Journal Title

      In Proceedings of the 12th International Conference on E-Service and Knowledge Management

      Volume: IEEE, ESKM Pages: 65-70

    • DOI

      10.1109/iiai-aai53430.2021.00011

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Matching Social Issues to Technologies for Civic Tech by Association Rule Mining using Weighted Causal Confidence2021

    • Author(s)
      Masato Kikuchi, Shun Shiramatsu, Ryota Kozakai, and Tadachika Ozono
    • Journal Title

      The 20th IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology

      Volume: ACM, WI-AIT Pages: 68-75

    • DOI

      10.1145/3498851.3498931

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Feature Selective Likelihood Ratio Estimator for Low- and Zerofrequency N-grams2021

    • Author(s)
      Masato Kikuchi, Mitsuo Yoshida, Kyoji Umemura, Tadachika Ozono
    • Journal Title

      2021 8th International Conference on Advanced Informatics: Concepts, Theory and Applications

      Volume: ICAICTA Pages: 1-6

    • DOI

      10.1109/icaicta53211.2021.9640293

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Analysis of Interests of Civic Tech Communities in Japan towards Developing Civic Tech Community Recommendation System2021

    • Author(s)
      Ryota Kozakai, Shun Shiramatsu, Masato Kikuchi, Tadachika Ozono, Akira Kamiya, Tetsuji Ishii
    • Journal Title

      The 16th International Conference on Knowledge, Information and Creativity Support Systems

      Volume: KICSS

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] 拡張現実感技術ARを利用したオンデマンド型講義のためのプレゼンテーション支 援機構の試作2021

    • Author(s)
      伊東佑真, 大囿忠親, 新谷虎松
    • Journal Title

      信学技報

      Volume: 120 Pages: 36-41

    • Related Report
      2020 Research-status Report
  • [Journal Article] Developing an AR Pop-up Picture Book and its Effect Editor Based on Teaching Motions2021

    • Author(s)
      Hitomi Kataoka, Tadachika Ozono, Toramatsu Shintani
    • Journal Title

      Information Engineering Express

      Volume: 7-1 Pages: 1-10

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] AR技術に基づくライブパフォーマンスのためのエージェント制御機構について2020

    • Author(s)
      片岡 瞳, 伊東 佑真, 小中 祐希, 大囿 忠親, 新谷 虎松
    • Journal Title

      信学技報(受賞あり)

      Volume: 120 Pages: 7-12

    • Related Report
      2020 Research-status Report
  • [Journal Article] Cross-Road Accident Responsibility Prediction Based on a Multiagent System2020

    • Author(s)
      Helton Agbewonou Yawovi, Tadachika Ozono, Toramatsu Shintani
    • Journal Title

      The 2020 International Conference on Computational Science and Computational Intelligence

      Volume: 1

    • Related Report
      2020 Research-status Report
    • Peer Reviewed
  • [Journal Article] Any-Application Window Sharing Mechanism based on WebRTC and its Evaluations2019

    • Author(s)
      Satoru Iwata, Tadachika Ozono, Toramatsu Shintani
    • Journal Title

      Information Engineering Express

      Volume: Vol. 5, No. 1 Pages: 97-113

    • Related Report
      2019 Research-status Report
    • Peer Reviewed
  • [Journal Article] A Sentiment Polarity Classifier for Regional Event Reputation Analysis2019

    • Author(s)
      Tatsuya Ohbe, Tadachika Ozono, and Toramatsu Shintani
    • Journal Title

      International Journal of Service and Knowledge Management

      Volume: Vol. 3, No. 1 Pages: 51-65

    • Related Report
      2019 Research-status Report
    • Peer Reviewed
  • [Journal Article] A Layered Canvas Synchronization Mechanism for an Adaptable Presentation System2019

    • Author(s)
      Eishun Ito, Tadachika Ozono and Toramatsu Shintani
    • Journal Title

      International Journal of Service and Knowledge Management

      Volume: Vol. 3, No. 1 Pages: 19-34

    • Related Report
      2019 Research-status Report
    • Peer Reviewed
  • [Presentation] Development and Experiment of Classroom Engagement Evaluation Mechanism during Real-Time Online Courses2023

    • Author(s)
      Yanyi Peng, Masato Kikuchi, Tadachika Ozono
    • Organizer
      AIED 2023
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Developing a Component Comment Extractor from Product Reviews on E-Commerce Sites2022

    • Author(s)
      Shogo Anda, Masato Kikuchi, Tadachika Ozono
    • Organizer
      ESKM 2022
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Developing a Meta-AR Space Construction System and Mapping Coverage Visualization2022

    • Author(s)
      Koki Yasue, Masato Kikuchi, Tadachika Ozono
    • Organizer
      ICSEng 2022
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Developing a Lecture Video Recording System Using Augmented Reality2021

    • Author(s)
      Yuma Ito, Masato Kikuchi, Tadachika Ozono, Toramatsu Shintani
    • Organizer
      The 12th International Conference on E-Service and Knowledge Management
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Product Information Browsing Support System Using Analytic Hierarchy Process2021

    • Author(s)
      Yanyi PENG, Masato Kikuchi, Tadachika Ozono
    • Organizer
      The 20th IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Developing a Lecture Video Recording System Using Augmented Reality2021

    • Author(s)
      Kento Kaku, Masato Kikuchi, Tadachika Ozono, Toramatsu Shintani
    • Organizer
      The 12th International Conference on E-Service and Knowledge Management
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Matching Social Issues to Technologies for Civic Tech by Association Rule Mining using Weighted Causal Confidence2021

    • Author(s)
      Masato Kikuchi, Shun Shiramatsu, Ryota Kozakai, and Tadachika Ozono
    • Organizer
      The 20th IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Product Information Browsing Support System Using Analytic Hierarchy Process2021

    • Author(s)
      Weijian Li, Masato Kikuchi, Tadachika Ozono
    • Organizer
      The 20th IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Analysis of Interests of Civic Tech Communities in Japan towards Developing Civic Tech Community Recommendation System2021

    • Author(s)
      Ryota Kozakai, Shun Shiramatsu, Masato Kikuchi, Tadachika Ozono, Akira Kamiya, Tetsuji Ishii
    • Organizer
      The 16th International Conference on Knowledge, Information and Creativity Support Systems
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Feature Selective Likelihood Ratio Estimator for Low- and Zerofrequency N-grams2021

    • Author(s)
      Masato Kikuchi, Mitsuo Yoshida, Kyoji Umemura, Tadachika Ozono
    • Organizer
      2021 8th International Conference on Advanced Informatics: Concepts, Theory and Applications
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] 講義撮影のためのホワイトボードマーカによる拡張現実空間内講義資料への手書き機能の試作について2021

    • Author(s)
      伊東 佑真, 菊地 真斗, 大囿 忠親
    • Organizer
      SMASH21 Summer Symposium
    • Related Report
      2021 Research-status Report
  • [Presentation] 拡張現実感技術ARを利用したオンデマンド型講義のためのプレゼンテーション支 援機構の試作2021

    • Author(s)
      伊東佑真, 大囿忠親, 新谷虎松
    • Organizer
      電子情報通信学会 人工知能と知識処理研究会
    • Related Report
      2020 Research-status Report
  • [Presentation] Cross-Road Accident Responsibility Prediction Based on a Multiagent System2020

    • Author(s)
      Helton Agbewonou Yawovi, Tadachika Ozono, Toramatsu Shintani
    • Organizer
      The 2020 International Conference on Computational Science and Computational Intelligence
    • Related Report
      2020 Research-status Report
  • [Presentation] AR技術に基づくライブパフォーマンスのためのエージェント制御機構について2020

    • Author(s)
      片岡 瞳, 伊東 佑真, 小中 祐希, 大囿 忠親, 新谷 虎松
    • Organizer
      電子情報通信学会 人工知能と知識処理研究会・受賞あり)
    • Related Report
      2020 Research-status Report
  • [Presentation] ARパペットに基づく仮想プレゼンターを用いた反転講義用動画作成環境について2020

    • Author(s)
      片岡 瞳, 落合 裕也, 大囿 忠親, 新谷 虎松
    • Organizer
      SMASH20
    • Related Report
      2020 Research-status Report
  • [Presentation] ARパペット:ライブパフォーマンスのための拡張現実感による仮想エージェントの試作2020

    • Author(s)
      片岡 瞳,伊東 佑真,小中 祐希,大囿 忠親,新谷 虎松
    • Organizer
      SMASH20 Summer Symposyum
    • Related Report
      2020 Research-status Report
  • [Presentation] ARパペットに基づく仮想プレゼンターを用いた反転講義用動画作成環境について(受賞)2020

    • Author(s)
      片岡 瞳, 落合 裕也, 大囿 忠親, 新谷 虎松
    • Organizer
      SMASH20
    • Related Report
      2019 Research-status Report
  • [Presentation] Realizing an Effect Editor for AR Pop-up Picture Books by Teaching Motions2019

    • Author(s)
      Hitomi Kataoka, Tadachika Ozono and Toramatsu Shintani
    • Organizer
      IDDC2019
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] An Offline Mahjong Support System Based on Augmented Reality with Context-aware Image Recognition2019

    • Author(s)
      Ryosuke Suzuki, Tadachika Ozono and Toramatsu Shintani
    • Organizer
      ESKM2019
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] AR技術に基づく反転講義のための講義映像作成支援システムの試作2019

    • Author(s)
      大囿忠親, 落合裕也, 片岡瞳, 新谷 虎松
    • Organizer
      日本ソフトウェア科学会 第36回大会
    • Related Report
      2019 Research-status Report

URL: 

Published: 2019-04-18   Modified: 2024-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi