Estimating Learners' Mental State by Analyzing Voice Data and Individual Adaptive Support

• Project/Area Number: 23700980
• Research Category: Grant-in-Aid for Young Scientists (B)
• Allocation Type: Multi-year Fund
• Research Field: Educational technology
• Research Institution: Nagoya City University
• Principal Investigator: MIYAHARA Kazuhiro 名古屋市立大学, システム自然科学研究科, 助教 (90315903)
• Project Period (FY): 2011-04-28 – 2015-03-31
• Project Status: Completed (Fiscal Year 2014)
• Budget Amount: ¥2,860,000 (Direct Cost: ¥2,200,000、Indirect Cost: ¥660,000); Fiscal Year 2013: ¥780,000 (Direct Cost: ¥600,000、Indirect Cost: ¥180,000); Fiscal Year 2012: ¥780,000 (Direct Cost: ¥600,000、Indirect Cost: ¥180,000); Fiscal Year 2011: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
• Keywords: 心理状態推定 / 音声認識 / ｅラーニング / eラーニング / ため息 / 発声データ解析

Outline of Final Research Achievements

This study is to develop an easy method for estimating the mental state of the learner who learns by the e-Learning in real time. In the previous studies, specialized equipments are needed. In this study, we use a voice data obtained from the microphone.
First, collecting the voice data when students are learning with PC. Using the frequency and interval of sigh, cough and yawn, we tried to estimate the learners' mental state such as impasse, fatigue, and so on. We could not be obtained clear accomplishments.