A Storyteling System with Mobile AR Animation and Its Evaluations

• Project/Area Number: 25282048
• Research Category: Grant-in-Aid for Scientific Research (B)
• Allocation Type: Partial Multi-year Fund
• Section: 一般
• Research Field: Educational technology
• Research Institution: Hokkaido University
• Principal Investigator: Sugimoto Masanori 北海道大学, 情報科学研究科, 教授 (90280560)
• Co-Investigator(Kenkyū-buntansha): INAGAKI Shigenori 神戸大学, 大学院人間発達環境学研究科, 教授 (70176387)
• Research Collaborator: Pantuwong Natapon モンクット王工科大学ラート クラバン校, 情報技術学科, 講師
• Project Period (FY): 2013-04-01 – 2016-03-31
• Project Status: Completed (Fiscal Year 2015)
• Budget Amount: ¥16,640,000 (Direct Cost: ¥12,800,000、Indirect Cost: ¥3,840,000); Fiscal Year 2015: ¥5,590,000 (Direct Cost: ¥4,300,000、Indirect Cost: ¥1,290,000); Fiscal Year 2014: ¥4,810,000 (Direct Cost: ¥3,700,000、Indirect Cost: ¥1,110,000); Fiscal Year 2013: ¥6,240,000 (Direct Cost: ¥4,800,000、Indirect Cost: ¥1,440,000)
• Keywords: コンピュータアニメーション / ストーリーテリング / ストーリテリング / 教育工学 / ユーザインタフェース / 教授学習支援システム

Outline of Final Research Achievements

For construction a storytelling system in mobile AR environments, we propose a rapid motion retrieval technique to represent motions of characters in stories.
Frames of motions are represented by feature vectors whose elements are integer values. The number of the feature vector dimension is reduced by using the Principal Component Analysis method and values of elements in the vector are quantized into two bits. Comparative experiments with existing methods have proved that our proposed technique can complete retrieval tasks more than 30 times faster than the traditional Dynamic Time Warping method and shown almost the same level of precision and rapid calculation time as existing methods. We also investigated evaluation methods of the proposed system to be used in elementary schools.

Research Products

• [Int'l Joint Research] モンクット王工科大学ラートクラバン校(タイ)
• [Presentation] A Rapid Motion Retrieval Technique using Simple and Discrete Representation of Motion Data (2015)
  • Author(s): N. Pantuwong, K. Takahara, M. Sugimoto
  • Organizer: IEEE ICITEE 2015
  • Place of Presentation: タイ国チェンマイ
  • Year and Date: 2015-10-29
  • Int'l Joint Research
• [Presentation] 特徴ベクトルの簡略離散表現によるモーション検索高速化手法 (2015)
  • Author(s): 高原 健輔, Pantuwong Napaton, 野中 秀俊, 吉川 毅, 杉本 雅則
  • Organizer: インタラクション2015
  • Place of Presentation: 東京
  • Year and Date: 2015-03-05 – 2015-03-07
• [Presentation] Interacting with 3D Model on Tabletop and Mobile Paper (2014)
  • Author(s): Yusuke Takeuchi, Masanori Sugimoto
  • Organizer: CollabTech 2014
  • Place of Presentation: サンチアゴ、チリ
  • Year and Date: 2014-09-08 – 2014-09-10
• [Presentation] An Iterative Motion Retrieval and Synthesis Technique Using a Multi-Touch Device (2013)
  • Author(s): Takahara, K., Pantuwong, N., Yoshikawa, T., Nonaka, H., Sugimoto, M.
  • Organizer: Motion in Games 2013
  • Place of Presentation: Trinity College Dublin (Ireland)
• [Presentation] A Kinetic Energy-based Feature for Unsupervised Motion Clustering, (2013)
  • Author(s): Nopparit, S., Pantuwong, N., Sugimoto, M.
  • Organizer: IEEE ICITEE 2013
  • Place of Presentation: The Sahid Rich Jogja Hotel (Indonesia)
• [Presentation] An Intuitive Computer Animation System for Enhancing Human Creativity (2013)
  • Author(s): Pantuwong, N., Sugimoto, M.
  • Organizer: IEEE SSCI 2013
  • Place of Presentation: Grand Copthorne Water Hotel (Singapore)
• [Presentation] Beyond Wow Effect: Making Fun Experience Learning and Learning Experience Fun (2013)
  • Author(s): Sugimoto, M.
  • Organizer: AECT-ICFER 2013
  • Place of Presentation: National Museum of Natural Science (Taiwan)
  • Invited
• [Book] Design of Technology-Enhanced Learning Environments That Connect Classrooms to the Real World (in "The New Development of Technology Enhanced Learning: Concept, Research and Best Practices") (2014)
  • Author(s): Masanori Sugimoto
  • Publisher: Springer
• [Funded Workshop] DLSA2015 (2015)
  • Place of Presentation: 北海道大学
  • Year and Date: 2015-05-08