Development of Next-generation Skills Evaluation System Based on Multimodal Interaction Data in Collaborative Learning

• Project/Area Number: 26870588
• Research Category: Grant-in-Aid for Young Scientists (B)
• Allocation Type: Multi-year Fund
• Research Field: Educational technology; Human interface and interaction
• Research Institution: Osaka Prefecture University
• Principal Investigator: Hayashi Yuki 大阪府立大学, 人間社会システム科学研究科, 助教 (40633524)
• Project Period (FY): 2014-04-01 – 2017-03-31
• Project Status: Completed (Fiscal Year 2016)
• Budget Amount: ¥3,770,000 (Direct Cost: ¥2,900,000、Indirect Cost: ¥870,000); Fiscal Year 2016: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000); Fiscal Year 2015: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000); Fiscal Year 2014: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
• Keywords: マルチモーダルインタラクション / 協調学習 / 言語・非言語情報 / CSCL / 論理的思考能力 / 思考モニタリング / 自己内対話 / 論理的思考力 / メタ認知 / グループディスカッション / 非言語情報 / 性格特性 / 韻律特徴 / 発話タグ

Outline of Final Research Achievements

In this study, we have developed a system which is the basis for evaluating the skills required for the next generation. We have got the following three results: (1) we established evaluation models of collaborative attitudes and Big-five personality traits based on multimodal interaction data in collaborative learning; (2) we built a platform for development of CSCL systems that enables system developers to access the necessary verbal and nonverbal information in order to embed the skills evaluation models into the developed CSCL systems; (3) we developed an analysis system of metacognitive thinking processes toward the evaluation of logical thinking and critical thinking skills.

Research Products

• [Journal Article] Estimating Communication Skills based on Multimodal Information in Group Discussions (2016)
  • Author(s): 岡田将吾, 松儀良広, 中野有紀子, 林佑樹, 黄宏軒, 高瀬裕, 新田克己
  • Journal Title: Transactions of the Japanese Society for Artificial Intelligence Volume: 31 Issue: 6 Pages: AI30-E_1-12
  • DOI: 10.1527/tjsai.AI30-E
  • NAID: 130005277075
  • ISSN: 1346-0714, 1346-8030
  • Peer Reviewed / Open Access
• [Journal Article] グループディスカッションコーパスの構築および性格特性との関連性の分析 (2015)
  • Author(s): 林佑樹，二瓶芙巳雄，中野有紀子，黄宏軒，岡田将吾
  • Journal Title: 情報処理学会論文誌 Volume: 56 Pages: 1217-1227
  • NAID: 110009890361
  • Peer Reviewed / Acknowledgement Compliant
• [Presentation] Accessible Multimodal-interaction Platform for Computer-supported Collaborative Learning System (2017)
  • Author(s): Yuki Hayashi, Aoi Sugimoto, and Kazuhisa Seta
  • Organizer: 11th International Conference on Ubiquitous Information Management and Communication
  • Place of Presentation: Beppu, Japan
  • Year and Date: 2017-01-05
  • Int'l Joint Research
• [Presentation] Ontology-based Systemization Approach to Capture Meta-level Thinking Processes from Gaze Behaviors (2016)
  • Author(s): Yuki Hayashi, Kazuhisa Seta, and Mitsuru Ikeda
  • Organizer: 24th International Conference on Computers in Education
  • Place of Presentation: Bombay, India
  • Year and Date: 2016-11-28
  • Int'l Joint Research
• [Presentation] CSCLシステムのための言語・非言語アウェアなプラットフォーム開発 (2016)
  • Author(s): 杉本葵, 林佑樹, 瀬田和久
  • Organizer: 第41回教育システム情報学会全国大会
  • Place of Presentation: 帝京大学 宇都宮キャンパス
  • Year and Date: 2016-08-29
• [Presentation] Gaze-aware Thinking Training Environment to Analyze Internal Self-conversation Process (2016)
  • Author(s): Yuki HAYASHI, Kazuhisa SETA, and Mitsuru IKEDA
  • Organizer: 18th International Conference on Human-Computer Interaction (HCII2016)
  • Place of Presentation: The Westin Harbour Castle Hotel, Toronto, Canada
  • Year and Date: 2016-07-17
  • Int'l Joint Research
• [Presentation] 視線情報に着目した思考プロセス分析ツールの開発 (2016)
  • Author(s): 林佑樹，瀬田和久，池田満
  • Organizer: 第30回人工知能学会全国大会
  • Place of Presentation: 北九州国際会議場（福岡県北九州市）
  • Year and Date: 2016-06-06
• [Presentation] 視線情報に基づく思考外化プロセスの分析 (2016)
  • Author(s): 林佑樹，瀬田和久，池田満
  • Organizer: 第6回知識共創フォーラム
  • Place of Presentation: 石川県政記念しいのき迎賓館（石川県金沢市）
  • Year and Date: 2016-03-12
• [Presentation] 協調学習のための言語・非言語アウェアなツール間連携プラットフォーム (2016)
  • Author(s): 杉本葵, 林佑樹, 瀬田和久
  • Organizer: 人工知能学会 第77回 先進的学習科学と工学研究会
  • Place of Presentation: 広島市立大学 サテライトキャンパス
• [Presentation] 視線行為とメタ認知的思考プロセスに関するオントロジー構築の試み (2016)
  • Author(s): 林佑樹, 瀬田和久, 池田満
  • Organizer: 人工知能学会 第77回 先進的学習科学と工学研究会
  • Place of Presentation: 広島市立大学 サテライトキャンパス
• [Presentation] Predicting Participation Styles using Co-occurrence Patterns of Nonverbal Behaviors in Collaborative Learning (2015)
  • Author(s): Yukiko I. NAKANO, Sakiko NIHONYANAGI, Yutaka TAKASE, Yuki HAYASHI, and Shogo OKADA
  • Organizer: 17th ACM International Conference on Multimodal Interaction (ICMI2015)
  • Place of Presentation: Motif Seattle Hotel, Seattle, WA, USA
  • Year and Date: 2015-11-09
  • Int'l Joint Research
• [Presentation] Estimating Utterance Tags in Collaborative Learning using Prosodic Features (2014)
  • Author(s): Yuki HAYASHI, Shunsuke OSARAGI, and Yukiko I. NAKANO
  • Organizer: 10th International Conference on Knowledge Management (ICKM2014)
  • Place of Presentation: Antalya, Turkey
  • Year and Date: 2014-11-24 – 2014-11-26
• [Presentation] Estimating Collaborative Attitudes based on Non-verbal Features in Collaborative Learning Interaction (2014)
  • Author(s): Yuki HAYASHI, Haruka MORITA, and Yukiko I. NAKANO
  • Organizer: 18th International Conference on Knowledge-Based and Intelligent Information & Engineering Systems (KES2014)
  • Place of Presentation: Gdynia, Poland
  • Year and Date: 2014-09-15 – 2014-09-17
• [Presentation] 協調学習における韻律特徴を用いた発話タグ推定モデル (2014)
  • Author(s): 林佑樹，大佛駿介，中野有紀子
  • Organizer: 第39回教育システム情報学会全国大会
  • Place of Presentation: 和歌山県，和歌山大学
  • Year and Date: 2014-09-10 – 2014-09-12
• [Presentation] 協調学習インタラクションにおける非言語特性に基づく協調的態度の分析 (2014)
  • Author(s): 林佑樹，森田遥，中野有紀子
  • Organizer: 第28回人工知能学会全国大会
  • Place of Presentation: 愛媛県，ひめぎんホール
  • Year and Date: 2014-05-12 – 2014-05-15