Research and development on use and application for 3D multimedia learning materials based on Linked Open Data

• Project/Area Number: 16H02923
• Research Category: Grant-in-Aid for Scientific Research (B)
• Allocation Type: Single-year Grants
• Section: 一般
• Research Field: Learning support system
• Research Institution: Kyushu University
• Principal Investigator: OKADA Yoshihiro 九州大学, 附属図書館, 教授 (70250488)
• Co-Investigator(Kenkyū-buntansha): 金子 晃介 九州大学, サイバーセキュリティセンター, 准教授 (30735121) ; 石 偉 九州大学, 附属図書館, 助教 (30812680) ; 谷澤 亜里 九州大学, 総合研究博物館, 助教 (50749471) ; 吉田 素文 国際医療福祉大学, 医学部, 教授 (00291518) ; 緒方 広明 九州大学, 基幹教育院, 教授 (30274260)
• Project Period (FY): 2016-04-01 – 2019-03-31
• Project Status: Completed (Fiscal Year 2018)
• Budget Amount: ¥17,030,000 (Direct Cost: ¥13,100,000、Indirect Cost: ¥3,930,000); Fiscal Year 2018: ¥5,460,000 (Direct Cost: ¥4,200,000、Indirect Cost: ¥1,260,000); Fiscal Year 2017: ¥5,460,000 (Direct Cost: ¥4,200,000、Indirect Cost: ¥1,260,000); Fiscal Year 2016: ¥6,110,000 (Direct Cost: ¥4,700,000、Indirect Cost: ¥1,410,000)
• Keywords: リンクト・オープンデータ / 教材開発 / 電子教材 / 教育基盤 / 教育実践 / 学習コンテンツ開発支援 / ３次元マルチメディア / e-Learning / 学習ビックデータ

Outline of Final Research Achievements

In this research, for each mono-media included in existing 3D multimedia educational materials, by extracting the meaning and attribute information of its contents and storing them as Linked Open Data (LOD), it can enable computers to generate new 3D multimedia educational materials automatically. Then, teachers can obtain their desired educational materials only by interactively modifying the generated materials. We developed basic technology and tools for that. We also developed a browsing system for educational materials with a function that stores learning history data of learners, and a visualization tool for analyzing the stored learning history data. Furthermore, practically we developed 3D multimedia educational materials using the developed tools/systems.

Academic Significance and Societal Importance of the Research Achievements

３次元マルチメディアコンテンツの編集生成技術に関しては，モノメディアを対象にした研究開発は数多くあるが，複数のモノメディアの合成された教材としての自動合成の研究はほとんどない。本研究では，実用的なシステム開発までをも目指し，電子教材活用教育の推進を図るとともに，研究成果を多方面へ展開することにより社会還元を図るものである。オンライン教材の提供によるアクティブラーナの育成等から電子書籍やオンライン教材の需要が今後ますます増加すると考えられ，本研究成果の有用性は非常に高いと考えられる。

Research Products

• [Journal Article] A Framework for Automatically Generating IoT Security Quizzes in a Virtual 3D Environment Based on Linked Data (2019)
  • Author(s): Shi Wei、Ma Chenguang、Kulshrestha Srishti、Bose Ranjan、Okada Yoshihiro
  • Journal Title: Lecture Notes on Data Engineering and Communications Technologies Volume: 29 Pages: 103-113
  • DOI: 10.1007/978-3-030-12839-5_9
  • ISBN: 9783030128388, 9783030128395
  • Peer Reviewed / Int'l Joint Research
• [Journal Article] E-Learning Material Development Framework Supporting 360VR Images/Videos Based on Linked Data for IoT Security Education (2019)
  • Author(s): Okada Yoshihiro、Haga Akira、Wei Shi、Ma Chenguang、Kulshrestha Srishti、Bose Ranjan
  • Journal Title: Lecture Notes on Data Engineering and Communications Technologies Volume: 29 Pages: 148-160
  • DOI: 10.1007/978-3-030-12839-5_14
  • ISBN: 9783030128388, 9783030128395
  • Peer Reviewed / Int'l Joint Research
• [Journal Article] A Framework for Automatically Generating Quiz-Type Serious Games Based on Linked Data (2019)
  • Author(s): Wei Shi, Kosuke Kaneko, Chenguang Ma, Yoshihiro Okada
  • Journal Title: International Journal of Information and Education Technology Volume: 9 Issue: 4 Pages: 250-256
  • DOI: 10.18178/ijiet.2019.9.4.1208
  • Peer Reviewed / Open Access / Int'l Joint Research
• [Journal Article] Web Based Interactive Viewer for 360VR Images/Videos Supporting VR/AR Devices with Human Face Detection (2018)
  • Author(s): Haga Akira、Shi Wei、Hayashida Ginpei、Okada Yoshihiro
  • Journal Title: Lecture Notes on Data Engineering and Communications Technologies Volume: 25 Pages: 260-270
  • DOI: 10.1007/978-3-030-02613-4_23
  • ISBN: 9783030026127, 9783030026134
  • Peer Reviewed / Int'l Joint Research
• [Journal Article] A Framework for Automatically Generating Medical Quizzes with Multi-media Contents Based on Linked Data (2018)
  • Author(s): Shi Wei、Kaneko Kosuke、Ma Chenguang、Okada Yoshihiro
  • Journal Title: Lecture Notes on Data Engineering and Communications Technologies Volume: 25 Pages: 147-158
  • DOI: 10.1007/978-3-030-02613-4_13
  • ISBN: 9783030026127, 9783030026134
  • Peer Reviewed / Int'l Joint Research
• [Journal Article] Web-Based Operation Training System of Medical Therapy Devices Using VR/AR Devices (2018)
  • Author(s): Kuroda Kotaro、Kaneko Kosuke、Fujibuchi Toshioh、Okada Yoshihiro
  • Journal Title: Lecture Notes on Data Engineering and Communications Technologies Volume: 25 Pages: 250-259
  • DOI: 10.1007/978-3-030-02613-4_22
  • ISBN: 9783030026127, 9783030026134
  • Peer Reviewed
• [Journal Article] Web Based Interactive 3D Educational Material Development Framework Supporting 360VR Images/Videos and Its Examples (2018)
  • Author(s): Okada Yoshihiro、Haga Akira、Shi Wei
  • Journal Title: Lecture Notes on Data Engineering and Communications Technologie Volume: 22 Pages: 395-406
  • DOI: 10.1007/978-3-319-98530-5_33
  • ISBN: 9783319985299, 9783319985305
  • Peer Reviewed / Int'l Joint Research
• [Journal Article] Time-Tunnel: 3D Visualization Tool and Its Aspects as 3D Parallel Coordinates (2018)
  • Author(s): Okada Yoshihiro
  • Journal Title: Proc. of 22nd International Conference Information Visualisation (IV) Volume: - Pages: 50-55
  • DOI: 10.1109/iv.2018.00019
  • Peer Reviewed
• [Journal Article] Web-Based VR System for Operation Training of Medical Therapy Devices (2018)
  • Author(s): Kuroda Kotaro、Kaneko Kosuke、Fujibuchi Toshioh、Okada Yoshihiro
  • Journal Title: Advances in Intelligent Systems and Computing Volume: 772 Pages: 948-957
  • DOI: 10.1007/978-3-319-93659-8_88
  • ISBN: 9783319936581, 9783319936598
  • Peer Reviewed
• [Journal Article] LEARNING ANALYTICS FRAMEWORK FOR IOT SECURITY EDUCATION (2018)
  • Author(s): Chenguang Ma, Kulshrestha Srishti, Wei Shi, Yoshihiro Okada, Ranjan Bose
  • Journal Title: 12th International Technology Education and Development Conference Volume: - Pages: 9181-919
  • DOI: 10.21125/inted.2018.2251
  • Peer Reviewed / Int'l Joint Research
• [Journal Article] E-learning Material Development Framework Supporting VR/AR Based on Linked Data for IoT Security Education (2018)
  • Author(s): Chenguang Ma, Srishti Kulshrestha, Wei Shi, Yoshihiro Okada, Ranjan Bose
  • Journal Title: Advances in Internet Data & Web Technologies( The 6th International Conference on Emerging Internet Data & Web Technologies (EIDWT-2018)) Volume: - Pages: 479-491
  • DOI: 10.1007/978-3-319-75928-9_43
  • ISBN: 9783319759272, 9783319759289
  • Peer Reviewed / Open Access / Int'l Joint Research
• [Journal Article] Tourism Support System Using AR for Tourists’ Migratory Behaviors (2018)
  • Author(s): Haruna Sonobe, Hiroaki Nishino, Yoshihiro Okada, Kousuke Kaneko
  • Journal Title: Advances in Internet, Data & Web Technologies( The 6th International Conference on Emerging Internet, Data & Web Technologies (EIDWT-2018)) Volume: 978-3-319-75928-9 Pages: 699-710
  • DOI: 10.1007/978-3-319-75928-9_62
  • ISBN: 9783319759272, 9783319759289
  • Peer Reviewed / Open Access
• [Journal Article] 3D Model Generation of Cattle Using Multiple Depth-Maps for ICT Agriculture (2017)
  • Author(s): Maki N., Nakamura S., Takano S., Okada Y.
  • Journal Title: Complex, Intelligent, and Software Intensive Systems. CISIS 2017. Advances in Intelligent Systems and Computing Volume: 978-3-319-61566-0 Pages: 768-777
  • DOI: 10.1007/978-3-319-61566-0_72
  • ISBN: 9783319615653, 9783319615660
  • Peer Reviewed
• [Journal Article] 3D Model Generation of Black Cattle Using Multiple RGB Cameras for Their BCS (2017)
  • Author(s): Hiroki Tamari, Shohei Nakamura, Shigeru Takano, Yoshihiro Okada
  • Journal Title: Advances in Network-Based Information Systems: The 20th International Conference on Network-Based Information Systems (NBiS-2017) Volume: 978-3-319-65521-5 Pages: 812-821
  • Peer Reviewed
• [Journal Article] EDUCATIONAL MATERIAL DEVELOPMENT FRAMEWORK BASED ON LINKED DATA FOR IOT SECURITY (2017)
  • Author(s): Chenguang Ma, Kulshrestha Srishti, Wei Shi, Yoshihiro Okada, Ranjan Bose
  • Journal Title: 10th annual International Conference of Education Research and Innovation" Volume: - Pages: 8048-8057
  • DOI: 10.21125/iceri.2017.2151
  • Peer Reviewed / Int'l Joint Research
• [Journal Article] INTERACTIVE EDUCATIONAL CONTENTS DEVELOPMENT FRAMEWORK AND ITS EXTENSION FOR WEB BASED VR/AR APPLICATIONS (2017)
  • Author(s): Okada, Y., Kaneko, K. and Tanizawa, A.
  • Journal Title: Proc. of the GameOn 2017 Volume: 978-90-77381-99-1 Pages: 75-79
  • Peer Reviewed
• [Journal Article] Action Recognition for Videos by Long-term Point Trajectory Analysis with Background Removal (2016)
  • Author(s): Yu Xiang, Yoshihiro Okada, Kosuke Kaneko
  • Journal Title: Proc. of The 12th International Conference on SIGNAL IMAGE TECHNOLOGY & INTERNET BASED SYSTEMS(SITIS 2016) Volume: 978-1-5090-5698-9 Pages: 23-30
  • DOI: 10.1109/sitis.2016.13
  • Peer Reviewed / Int'l Joint Research / Acknowledgement Compliant
• [Journal Article] Interactive Educational Contents Development Framework Based on Linked Open Data Technology (2016)
  • Author(s): Yoshihiro Okada, Kosuke Kaneko, Ari Tanizawa
  • Journal Title: 9th annual International Conference of Education, Research and Innovation Volume: 978-84-617-5895-1 Pages: 5066-5075
  • DOI: 10.21125/iceri.2016.2204
  • Peer Reviewed
• [Journal Article] Robust Approach for Interesting Points Extraction of Moving Human from 2D Videos (2016)
  • Author(s): Yu Xiang, Yoshihiro Okada
  • Journal Title: ISIP2015 Post Proceedings, Springer series "Communications in Computer and Information Science" (CCIS) Volume: 978-3-319-43862-7 Pages: 88-104
  • DOI: 10.1007/978-3-319-43862-7_5
  • ISBN: 9783319438610, 9783319438627
  • Peer Reviewed / Int'l Joint Research
• [Journal Article] 3D Model Data Retrieval System Using KAZE Feature for Accepting 2D Image as Query (2016)
  • Author(s): Hideki Sagara, Shigeru Takano, Yoshihiro Okada
  • Journal Title: 10th International Conference on Complex, Intelligent, and Software Intensive Systems (CISIS) Volume: 978-1-5090-0987-9 Pages: 617-622
  • DOI: 10.1109/cisis.2016.103
  • Peer Reviewed
• [Presentation] A Framework for Automatically Generating IoT Security Quizzes in a Virtual 3D Environment Based on Linked Data (2019)
  • Author(s): Wei Shi, Chenguang Ma, Srishti Kulshrestha, Ranjan Bose, Yoshihiro Okada
  • Organizer: 7th International Conference on Emerging Internet, Data & Web Technologies (EIDWT 2019)
  • Int'l Joint Research
• [Presentation] E-Learning Material Development Framework Supporting 360VR Images/Videos Based on Linked Data for IoT Security Education (2019)
  • Author(s): Yoshihiro Okada, Akira Haga, Shi Wei, Chenguang Ma, Srishti Kulshrestha, Ranjan Bose
  • Organizer: 7th International Conference on Emerging Internet, Data & Web Technologies (EIDWT 2019)
  • Int'l Joint Research
• [Presentation] Web based Interactive Viewer for 360VR Images/Videos Supporting VR/AR devices with Human Face Detection (2018)
  • Author(s): Akira Haga, Wei Shi, Ginpei Hayashida, Yoshihiro Okada
  • Organizer: 13th International Conference on Broadband and Wireless Computing, Communication and Applications (BWCCA-2018)
  • Int'l Joint Research
• [Presentation] A Framework for Automatically Generating Medical Quizzes with Multi-Media Contents Based on Linked Data (2018)
  • Author(s): Wei Shi, Kosuke Kaneko, Chenguang Ma, Yoshihiro Okada
  • Organizer: 13th International Conference on Broadband and Wireless Computing, Communication and Applications (BWCCA-2018)
  • Int'l Joint Research
• [Presentation] Web-based Operation Training System of Medical Therapy Devices using VR/AR Devices (2018)
  • Author(s): Kotaro Kuroda, Kosuke Kaneko, Toshioh Fujibuchi, Yoshihiro Okada
  • Organizer: 13th International Conference on Broadband and Wireless Computing, Communication and Applications (BWCCA-2018)
  • Int'l Joint Research
• [Presentation] A Framework for Automatically Generating Quiz-Type Serious Games Based on Linked Data (2018)
  • Author(s): Wei Shi, Kosuke Kaneko, Chenguang Ma, Yoshihiro Okada
  • Organizer: 8th International Conference on Education, Research and Innovation (ICERI 2018)
  • Int'l Joint Research
• [Presentation] Web based Interactive 3D Educational Material Development Framework Supporting 360VR Images/Videos and Its Examples (2018)
  • Author(s): Yoshihiro Okada, Akira Haga, Wei Shi
  • Organizer: 21st International Conference on Network-Based Information Systems (NBiS-2018)
  • Int'l Joint Research
• [Presentation] 3D Visualization Tool and Its Aspects as 3D Parallel Coordinates (2018)
  • Author(s): Yoshihiro Okada
  • Organizer: 22nd International Conference Information Visualisation (IV)
  • Int'l Joint Research
• [Presentation] Web-Based VR System for Operation Training of Medical Therapy Devices (2018)
  • Author(s): Kotaro Kuroda, Kosuke Kaneko, Toshioh Fujibuchi, Yoshihiro Okada
  • Organizer: VENOA 2018 in Proc. of the 12th International Conference on Complex, Intelligent, and Software Intensive Systems (CISIS-2018)
  • Int'l Joint Research
• [Presentation] Interactive Web 3D Contents Development Framework Based on Linked Data for Japanese History Education (2018)
  • Author(s): Chenguang Ma, Wei Shi, Yoshihiro Okada
  • Organizer: 12th International Conference on E-Learning and Games (Edutainment-2018)
  • Int'l Joint Research
• [Presentation] 観光情報としての歴史学Web教材の開発 (2017)
  • Author(s): 岡田義広, 金子晃介
  • Organizer: 第14回観光情報学会全国大会
• [Presentation] 拡張現実を用いた観光回遊行動支援システム (2017)
  • Author(s): 園部 悠菜, 西野 浩明, 金子 晃介, 岡田 義広
  • Organizer: 観光情報学会第16回研究発表会
• [Presentation] Virtual Realityデバイスを活用した電子教材の開発 (2017)
  • Author(s): 岡田義広
  • Organizer: 2017年ソサイエティ大会
  • Invited
• [Presentation] 3D歴史学Web教材開発フレームワークのVR/ARへの応用 (2017)
  • Author(s): 岡田 義広, 金子 晃介, 谷澤 亜里
  • Organizer: メディアエクスペリエンス・バーチャル環境基礎研究会
• [Book] Integrated Studies of Cultural and Research Resources The National Museum of Japanese History (2019)
  • Author(s): Ayako Shibutani, Junko Uchida, Makoto Goto, Masashi Amano, Norio Togiya, Takayuki Ako, Tsutomu Saito, Yoshihiro Okada, Wei Shi, Kosuke Kaneko, and Yuta Hashimoto
  • Total Pages: 226
  • Publisher: fulcrum university of michigan