研究課題
In the first year of the project we have achieved our goals in setting up an infrastructure for data collection and then in data collection itself. Using motion capture technology (single camera and open pose) and eye tracking technology we have collected the behaviour data of both the lecturer and the students. The data from the lecturer were used to define teaching styles and important teaching behaviours and gestures that support the lecture content and the lecture material to improve audience understanding and memorization. The students’ data collected have allowed to differentiate several behaviours during a lecture. Questionnaire were used to verify the students impressions during the experiment. Quizzes have been used to verify the learning ability of the students.
2: おおむね順調に進展している
The plan was well established and I didn't schedule things that we wouldn't be doing. So every goes very smoothly and we are on track with our objectives.
We are now entering phase B and C of the project:B.Big data/Machine learning: all the collected data in A are then processed to be ana-lysed in machine learning algorithms. We will use a recurrent neural network (RNN) architec-ture, known to be very powerful in highlighting features in complex data set and enabling be-haviour recognition. We will use language programming python and the open machine learning library “tensor flow” to develop our software. This will result in an offline behaviour analysis software of both lecturer and students’ behaviours, enabling us to choose the relevant features for step C. Relevant features will be compared with the know-how in education and see if they are in adequation or if other features need to be considered.C.Realtime behaviour recognition system: The relevant features found in B. will be used to develop a real-time algorithm to identify the changes in students’ behaviour. Again, this is based on an implementation of machine learning algorithm in real-time for classification. We propose here to use RNN or auto-encoders depending of the nature of the features found in B.
すべて 2020 2019 その他
すべて 国際共同研究 (2件) 雑誌論文 (5件) (うち国際共著 5件、 査読あり 5件、 オープンアクセス 3件) 学会発表 (5件) (うち国際学会 5件、 招待講演 2件)
Sensors
巻: 20 ページ: 1500～1500
10.3390/s20051500
International Journal of Mechanical Engineering and Robotics Research
巻: none ページ: 207～219
10.18178/ijmerr.8.2.207-219
Proc. of the Int. Conf. on Human-Agent Interaction
巻: none ページ: 200-201
Proc. of the 28th IEEE Int. Conf. on Robot & Human Interactive Communication, New Delhi, India, October 14-18, 2019
巻: none ページ: none
10.1109/RO-MAN46459.2019.8956400
ACM CHI Conference on Human Factors in Computing Systems Workshop on the Challenges of Working on Social Robots that Collaborate with People, Glasgow, UK
巻: none
