Learning Support by using an Embodied Conversational Agent in E-Learinig

• Project/Area Number: 25870698
• Research Category: Grant-in-Aid for Young Scientists (B)
• Allocation Type: Multi-year Fund
• Research Field: Educational technology; Intelligent informatics
• Research Institution: Aoyama Gakuin University
• Principal Investigator: Hasegawa Dai 青山学院大学, 理工学部, 助教 (30633268)
• Project Period (FY): 2013-04-01 – 2017-03-31
• Project Status: Completed (Fiscal Year 2016)
• Budget Amount: ¥4,550,000 (Direct Cost: ¥3,500,000、Indirect Cost: ¥1,050,000); Fiscal Year 2016: ¥650,000 (Direct Cost: ¥500,000、Indirect Cost: ¥150,000); Fiscal Year 2015: ¥650,000 (Direct Cost: ¥500,000、Indirect Cost: ¥150,000); Fiscal Year 2014: ¥650,000 (Direct Cost: ¥500,000、Indirect Cost: ¥150,000); Fiscal Year 2013: ¥2,600,000 (Direct Cost: ¥2,000,000、Indirect Cost: ¥600,000)
• Keywords: e-Learing / 対話エージェント / ジェスチャ / ｅラーニング / e-learning / e-Learning / WebGL / 擬人化エージェント / 学習意欲 / 非言語インタラクション / インストラクショナルデザイン

Outline of Final Research Achievements

In this research, we develop a web-based e-learning system that employs a 3D embodied agent. We also empirically determine the effects of gestures performed by the agent on learning and understanding. The e-learning system was built by using HTML5, JavaScript, and WebGL. We conducted an experiment in which 140 undergraduate students were involved. The results showed that an embodied agent's gesture had positive effects on students' learning and understanding.

Research Products

• [Journal Article] Estimation of Gestures for Utterance Text Using Conditional Random Fields (2016)
  • Author(s): 塙 俊樹，白川 真一，長谷川 大，塩入 直哉，大原 剛三，佐久田 博司
  • Journal Title: IEEJ Transactions on Electronics, Information and Systems Volume: 136 Issue: 3 Pages: 308-317
  • DOI: 10.1541/ieejeiss.136.308
  • NAID: 130005132279
  • ISSN: 0385-4221, 1348-8155
  • Peer Reviewed
• [Journal Article] The Effect of Metaphoric Gestures on Schematic Understanding of Instruction Performed by a Pedagogical Conversational Agent (2015)
  • Author(s): Dai Hasegawa, Shinichi Shirakawa, Naoya Shioiri, Toshiki Hanawa, Hiroshi Sakuta, Kozo Ohara
  • Journal Title: Lecture Notes in Computer Science (LNCS) Volume: 9192 Pages: 361-371
  • DOI: 10.1007/978-3-319-20609-7_34
  • ISBN: 9783319206080, 9783319206097
  • Peer Reviewed / Int'l Joint Research / Acknowledgement Compliant
• [Presentation] Creating a Speech-Gesture Dataset for Speech-Based Automatic Gesture Generation (2017)
  • Author(s): Kenta Takeuchi, Dai Hasegawa, Hiroshi Sakuta
  • Organizer: the 19th International Conference on Human-Computer Interaction (HCII2017)
  • Place of Presentation: Vancouver, Canada
  • Year and Date: 2017-07-09
  • Int'l Joint Research
• [Presentation] Gesture Occurrence Analysis in Japanese Lecture Videos (2017)
  • Author(s): Dai Hasegawa, Hiroshi Sakuta
  • Organizer: the Proceedings of the 12th Annual Education and Development Conference (EDC2017)
  • Place of Presentation: Bangkok, Thailand
  • Year and Date: 2017-03-04
  • Int'l Joint Research
• [Presentation] PCA による学習プロセス制御を簡易に実現する電子教材作成ライブラリIDML.js の提案 (2015)
  • Author(s): 林 明大,長谷川 大,佐久田 博司
  • Organizer: 日本教育工学会第31回全国大会
  • Place of Presentation: 東京
  • Year and Date: 2015-09-21
• [Presentation] PC内蔵カメラを用いた学習態度把握方式の検討 (2015)
  • Author(s): 安彦智史, 池辺正典, 丸山広, 長谷川大
  • Organizer: 情報教育シンポジウム論文集
  • Place of Presentation: 鳥取
  • Year and Date: 2015-08-17
• [Presentation] The Effect of Metaphoric Gestures on Schematic Understanding of Instruction Performed by a Pedagogical Conversational Agent (2015)
  • Author(s): Dai Hasegawa, Shinichi Shirakawa, Naoya Shioiri, Toshiki Hanawa, Hiroshi Sakuta, Kozo Ohara
  • Organizer: the 17th International Conference on Human-Computer Interaction (HCII2015).
  • Place of Presentation: Los Angeles, CA, USA
  • Year and Date: 2015-08-02 – 2015-08-07
• [Presentation] Web-based Avatar Represented Lecture Viewer toward Interactive e-Lecture Performed by 3D Avatar (2015)
  • Author(s): Akihiro Takeuchi, Dai Hasegawa, Hiroshi Sakuta
  • Organizer: 2015 IEEE Global Engineering Education Conference (EDUCON)
  • Place of Presentation: Tallinn, Estonia
  • Year and Date: 2015-03-18 – 2015-03-20
• [Presentation] The Effects of Listening Agent in Speech-Based On-line Test System (2015)
  • Author(s): Hidemasa Kimura, Jumpei Hayashi, Yuichi Demise, Dai Hasegawa, Hiroshi Sakuta
  • Organizer: 2015 IEEE Global Engineering Education Conference (EDUCON)
  • Place of Presentation: Tallinn, Estonia
  • Year and Date: 2015-03-18 – 2015-03-20
• [Presentation] 条件付き確率場を用いた発話テキストに対するジェスチャの自動生成 (2015)
  • Author(s): 塙俊樹, 塩入直哉, 白川真一, 長谷川 大, 大原剛三, 佐久田博司
  • Organizer: IEEJシステム研究会
  • Place of Presentation: 青山学院大学相模原キャンパス（神奈川・相模原市）
  • Year and Date: 2015-03-11
• [Presentation] 3DアバタによるインタラクティブなWeb講義の実現に向けたWebブラウザにおける3次元骨格情報に基づく講義の実現 (2015)
  • Author(s): 竹内 章裕，長谷川 大，佐久田 博司
  • Organizer: インタラクション2015
  • Place of Presentation: 日本科学未来館（東京・江東区）
  • Year and Date: 2015-03-05 – 2015-03-07
• [Presentation] 擬人化エージェントの暗喩的ジェスチャ自動生成および教育教材への応用 (2014)
  • Author(s): 塩入 直哉, 塙 俊樹, 長谷川 大, 白川 真一, 佐久田 博司, 大原 剛三
  • Organizer: 電子情報通信学会技術報告
  • Place of Presentation: 静岡大学浜松キャンパス（静岡・浜松）
  • Year and Date: 2014-06-14
• [Presentation] A Human-like Embodied Agent Learning Tour Guide for E-learning Systems (2014)
  • Author(s): Dai Hasegawa, Yucel Ugurlu, Hiroshi Sakuta
  • Organizer: 2014 IEEE Global Engineering Education Conference (EDUCON)
  • Place of Presentation: Istanbul, Turkey
  • Year and Date: 2014-04-03 – 2014-04-05
• [Presentation] Student Interactions with E-learning Systems: User and Topic Analysis (2014)
  • Author(s): Yucel Ugurlu, Dai Hasegawa, Hiroshi Sakuta,
  • Organizer: 2014 IEEE Global Engineering Education Conference (EDUCON)
  • Place of Presentation: Istanbul, Turkey
  • Year and Date: 2014-04-03 – 2014-04-05
• [Presentation] A Human-like Embodied Agent Learning Tour Guide for E-learning Systems (2014)
  • Author(s): Dai Hasegawa, Yucel Ugurlu, Hiroshi Sakuta
  • Organizer: IEEE Global Engineering Education Conference
  • Place of Presentation: Istanbul, Turkey
• [Presentation] E-learningガイドエージェントの姿勢変更による学習への引き込み効果の測定 (2013)
  • Author(s): 長谷川 大, 佐久田 博司
  • Organizer: 電子情報通信学会技術研究報告
  • Place of Presentation: 広島