• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Development of an Immersive, VR-Based, Learning-Support System Using Augmented Reality and Kinect

Research Project

Project/Area Number 26330410
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Research Field Learning support system
Research InstitutionNagoya Bunri University

Principal Investigator

Zhou Xinxin  名古屋文理大学, 情報メディア学部, 教授 (30262645)

Co-Investigator(Renkei-kenkyūsha) SUGIHARA Kenichi  岐阜経済大学, 経営学部, 教授 (80259267)
Research Collaborator KOBASHI Kazuhide  
SAKUMA Shigeru  
TAKAHASHI Osamu  
Project Period (FY) 2014-04-01 – 2018-03-31
Project Status Completed (Fiscal Year 2017)
Budget Amount *help
¥4,810,000 (Direct Cost: ¥3,700,000、Indirect Cost: ¥1,110,000)
Fiscal Year 2016: ¥520,000 (Direct Cost: ¥400,000、Indirect Cost: ¥120,000)
Fiscal Year 2015: ¥2,080,000 (Direct Cost: ¥1,600,000、Indirect Cost: ¥480,000)
Fiscal Year 2014: ¥2,210,000 (Direct Cost: ¥1,700,000、Indirect Cost: ¥510,000)
Keywords教育支援 / ゲーム / VR / AR / 立体視 / 遺跡 / Kinect / AI / Virtual Reality / Mix Reality / Augmented Reality / Image Processing / Google Tango / Deep Learning / HTC Vive / Virtual Reality / Gear VR / Oculus Touch / Oculus Rift / HMD / 3D / 可視化 / 教育 / 歴史
Outline of Final Research Achievements

In this study, we proposed methods to visualize ruins and developed a history learning support system by generating the 3-dimentional models of ruins automatically and visualizing them in Google Earth. We recreated ruins and developed an AR app for smartphones to provide history learners with additional 3D information about historical sites. We developed a stereoscopic VR application by using the game integrated development environment Unity3D. Using Oculus Rift DK2, we developed a VR app to walk around inside of ancient Japanese ruin, and users can see a stereo vision of the heritage site. We developed a Kinect game for history learning, in which users can control two avatars using a Kinect sensor and their own body movements and proposed an education support system for history in which students can participate as a character in ancient history. The proposed methods can effectively support history study as well as medical anatomy imaging.

Report

(5 results)
  • 2017 Annual Research Report   Final Research Report ( PDF )
  • 2016 Research-status Report
  • 2015 Research-status Report
  • 2014 Research-status Report
  • Research Products

    (32 results)

All 2018 2017 2016 2015 2014

All Journal Article (22 results) (of which Int'l Joint Research: 4 results,  Peer Reviewed: 14 results,  Open Access: 4 results,  Acknowledgement Compliant: 11 results) Presentation (10 results) (of which Invited: 1 results)

  • [Journal Article] Performance evaluation of 2D and 3D deep learning approaches for automatic segmentation of multiple organs on CT images2018

    • Author(s)
      X. Zhou, K. Yamada, T. Kojima, R. Takayama, S. Wang, X.X. Zhou, T. Hara, and H. Fujita
    • Journal Title

      Proc. SPIE Medical Imaging

      Volume: 10575, 105752C Pages: 83-83

    • DOI

      10.1117/12.2295178

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Development of Virtual Reality Applications for Learning through Experience2017

    • Author(s)
      Xinxin Zhou,Kazuhide Kobashi,Xiangrong Zhou,Kenichi Sugihara
    • Journal Title

      Nicograph International (NicoInt), 2017, IEEE

      Volume: 16 Pages: 93-93

    • DOI

      10.1109/nicoint.2017.23

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Development of Participatory System to Support History Learning2017

    • Author(s)
      Xinxin Zhou, Kazuhide Kobashi, Xiangrong Zhou,Xiaoyu Ge, Kenichi Sugihara
    • Journal Title

      計測自動制御学会 (SICE),教育工学論文集

      Volume: 40

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 3D-DeepCNN を用いたCT 画像からの多臓器の自動抽出と性能評価2017

    • Author(s)
      周向栄,山田一馬,飯盛広規,周欣欣,原武史,藤田広志
    • Journal Title

      JAMIT(日本医用画像工学会大会) 予稿集

      Volume: 36 Pages: 74-76

    • Related Report
      2017 Annual Research Report
  • [Journal Article] Automated assessment of breast tissue density in non-contrast 3D CT images without image segmentation based on a deep CNN2017

    • Author(s)
      X.Zhou, T.Kano, H.Koyasu, S.Li, X.Zhou, T.Hara, M.Matsuo, and H.Fujita
    • Journal Title

      Proc. SPIE Medical Imaging 2017: Computer-Aided Diagnosis

      Volume: 10134 Pages: 101342Q-101342Q

    • DOI

      10.1117/12.2254320

    • Related Report
      2016 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research / Acknowledgement Compliant
  • [Journal Article] Development of history learning support system: 3D virtual reconstruction and visualization of ancient Japanese architectures2016

    • Author(s)
      Xinxin Zhou,Xiangrong Zhou,Kazuhide Kobashi,Kenichi Sugihara
    • Journal Title

      Computer Science & Education (ICCSE), 2016 11th International Conference

      Volume: - Pages: 317-320

    • DOI

      10.1109/iccse.2016.7581600

    • Related Report
      2016 Research-status Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] POLYGON PARTITION AND SHAPE RECTIFICATION FOR AUTOMATIC GENERATION OF 3D BUILDING MODEL2016

    • Author(s)
      Kenichi Sugihara, Takahiro Murase
    • Journal Title

      IEEE TENCON 2016, Oral Interactive Forum 847, Conference Publications

      Volume: 847 Pages: 2311-2314

    • DOI

      10.1109/tencon.2016.7848441

    • Related Report
      2016 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Kinect を利用した人体動きの検出および動画生成 -歴史動画生成のための実験2016

    • Author(s)
      周欣欣, 小橋一秀, 杉山舞奈, 周向栄, 村瀬孝宏
    • Journal Title

      計測自動制御学会 (SICE),教育工学論文集,

      Volume: 39 Pages: 28-30

    • Related Report
      2016 Research-status Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Automatic quantification of mammary glands on non-contrast X-ray CT by using a novel segmentation approach2016

    • Author(s)
      Xiangrong Zhou,Takuya Kano,Yunliang Cai,Shuo Li,Xinxin Zhou,Takeshi Hara,Ryujiro Yokoyama,Hiroshi Fujita
    • Journal Title

      Proc. SPIE, Medical Imaging: Computer-Aided Diagnosis

      Volume: 9785 Pages: 97851Z-97851Z

    • DOI

      10.1117/12.2217256

    • Related Report
      2015 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Kinectを利用した教育用体験型ARアプリの開発 **企業賞受賞2016

    • Author(s)
      周欣欣,杉原健一,村瀬孝宏
    • Journal Title

      映像情報メディア学会技術報告 Vol.40, NO.11 ISSN 1342-6893

      Volume: 40 Pages: 201-202

    • Related Report
      2015 Research-status Report
    • Acknowledgement Compliant
  • [Journal Article] Kinectを利用した人体動きの検出および動画生成2016

    • Author(s)
      周欣欣,小橋一秀,杉山舞奈,周向栄,村瀬孝宏
    • Journal Title

      計測自動制御学会 (SICE),教育工学論文集

      Volume: 39

    • Related Report
      2015 Research-status Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] CGソフトウエアの学習と応用2016

    • Author(s)
      小寺鋼志,木下慶祐,石原志織,伊藤将悟,周欣欣
    • Journal Title

      教育システム情報学会(JSiSE),学生研究発表会論文集

      Volume: pdf Pages: 53-54

    • Related Report
      2015 Research-status Report
    • Acknowledgement Compliant
  • [Journal Article] Automatic Generation of 3D Building Models from Building Polygons on Digital Maps2015

    • Author(s)
      K. Sugihara; T. Murase; X. Zhou
    • Journal Title

      IEEE Conference Publications, International Conference on 3D Imaging (IC3D), International Conference on Year: 2015

      Volume: 2015 Pages: 1-9

    • DOI

      10.1109/ic3d.2015.7391817

    • Related Report
      2015 Research-status Report
    • Peer Reviewed
  • [Journal Article] 歴史教育支援システムにおける立体視教育アプリの開発2015

    • Author(s)
      周欣欣,杉原健一,周向栄,小橋一秀
    • Journal Title

      JSiSE第40回全国大会講演論文集

      Volume: CD Pages: 55-56

    • Related Report
      2015 Research-status Report
    • Acknowledgement Compliant
  • [Journal Article] 教育用ゲーム・エンターテインメントの開発-歴史学習のためのAR立体視アプリケーションの試作2015

    • Author(s)
      周欣欣,小橋一秀,杉原健一,周向栄
    • Journal Title

      計測自動制御学会 (SICE),教育工学論文集

      Volume: 38 Pages: 55-57

    • Related Report
      2015 Research-status Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] ICTとShadeを利用した3DCGの生成2015

    • Author(s)
      周欣欣
    • Journal Title

      計測自動制御学会 (SICE),教育工学論文集

      Volume: 38 Pages: 37-39

    • Related Report
      2015 Research-status Report
    • Peer Reviewed
  • [Journal Article] Automatic anatomy partitioning of the torso region on CT images by using multiple organ localizations with a group-wise calibration technique2015

    • Author(s)
      Xiangrong Zhou; Syoichi Morita; Xinxin Zhou; Huayue Chen; Takeshi Hara; Ryujiro Yokoyama; Masayuki Kanematsu; Hiroaki Hoshi; Hiroshi Fujita
    • Journal Title

      SPIE Medical Imaging

      Volume: 94143K Pages: 94143K-94143K

    • DOI

      10.1117/12.2081786

    • Related Report
      2014 Research-status Report
    • Peer Reviewed
  • [Journal Article] Automatic Generation of 3D Building Models by Rectification of Building Polygons2014

    • Author(s)
      Kenichi Sugihara, Xinxin Zhou, Takahiro Murase
    • Journal Title

      The 2nd International Conferences on Computer Graphics, Visualization, Computer Vision, and Game Technology (VisioGame 2014)

      Volume: ISSN:1743-3517 Pages: 75-83

    • Related Report
      2014 Research-status Report
    • Peer Reviewed
  • [Journal Article] Automatic generation of 3D building models by building polygon rectification2014

    • Author(s)
      Kenichi SUGIHARA, Xinxin ZHOU, Zhen-jiang SHEN
    • Journal Title

      GIS Association of Japan, International Session(2)

      Volume: DVD

    • Related Report
      2014 Research-status Report
  • [Journal Article] 歴史教育支援システムにおける教育エンターテインメントの試作2014

    • Author(s)
      周欣欣, 泉雅人,芝田理菜,小橋一秀,吉岡真德,杉原健一,村瀬孝宏
    • Journal Title

      教育システム情報学会(JSiSE),第39回全国大会講演論文集

      Volume: ISSN1342-9477 Pages: 81-82

    • Related Report
      2014 Research-status Report
    • Acknowledgement Compliant
  • [Journal Article] Development of 3D Games for Educational Entertainment2014

    • Author(s)
      周欣欣, 泉雅人, 芝田理菜,小橋一秀,杉原健一
    • Journal Title

      NICOGRAPH2014 論文集

      Volume: USB disk Pages: 131-132

    • Related Report
      2014 Research-status Report
    • Acknowledgement Compliant
  • [Journal Article] 歴史題材の3Dモデルおよび3Dゲームの試作2014

    • Author(s)
      周欣欣, 泉雅人,芝田理菜,小橋一秀,杉原健一
    • Journal Title

      日本図学会2014年度秋季大会学術論文集

      Volume: ISSN2189-0072 Pages: 103-104

    • Related Report
      2014 Research-status Report
    • Acknowledgement Compliant
  • [Presentation] 3D-Deep CNN を用いたCT 画像から複数の臓器領域の自動抽出2017

    • Author(s)
      山田一馬,周 向栄,周 欣欣,原 武史,藤田 広志
    • Organizer
      平成29年度日本生体医工学会東海支部大会,抄録集 p.17,2017年10月14日,名古屋
    • Related Report
      2017 Annual Research Report
  • [Presentation] 医用画像のセグメンテーションための自然画像の転移学習に関する検討2017

    • Author(s)
      飯盛広規,周向栄,周欣欣,原武史,藤田広志
    • Organizer
      平成29年度日本生体医工学会東海支部大会,抄録集 p.16,2017年10月14日,名古屋
    • Related Report
      2017 Annual Research Report
  • [Presentation] Kinectを利用した体感ゲームの制作2017

    • Author(s)
      間瀬浩平、周欣欣、小橋一秀
    • Organizer
      JSiSE学会学生研究発表会論文集,pp.79-80
    • Place of Presentation
      愛知県立大学
    • Related Report
      2016 Research-status Report
  • [Presentation] Viveを用いたバーチャルリアリティゲームの開発2017

    • Author(s)
      瀧田澪,小寺剛志、小橋一秀、周欣欣
    • Organizer
      JSiSE学会学生研究発表会論文集,pp.81-82
    • Place of Presentation
      愛知県立大学
    • Related Report
      2016 Research-status Report
  • [Presentation] 街区における再生可能エネルギーに適した建物の3Dモデルの自動生成2016

    • Author(s)
      村瀬孝宏, 杉原健一, 周欣欣
    • Organizer
      第25回地理情報システム学会講演論文集Vol.25, CD収録4頁
    • Place of Presentation
      立正大学
    • Year and Date
      2016-10-15
    • Related Report
      2016 Research-status Report
  • [Presentation] 参加型歴史教育支援システムの構築とその評価2016

    • Author(s)
      周欣欣、周向栄、杉原健一
    • Organizer
      2016年日本教育工学会第32回全国大会 SIGセッション、論文集、pp.127-130
    • Place of Presentation
      大阪大学
    • Year and Date
      2016-09-16
    • Related Report
      2016 Research-status Report
    • Invited
  • [Presentation] 再生可能エネルギーに適した街づくりのための3Dモデルを利用した環境教育2016

    • Author(s)
      村瀬孝宏, 杉原健一, 周欣欣
    • Organizer
      2016年日本教育工学会第32回全国大会講演論文集, pp.1003-1004
    • Place of Presentation
      大阪大学
    • Year and Date
      2016-09-16
    • Related Report
      2016 Research-status Report
  • [Presentation] 環境教育のための太陽光発電の最適化を目的とした3次元建物の自動生成2016

    • Author(s)
      村瀬孝宏, 杉原健一, 周欣欣
    • Organizer
      日本教育情報学会 年会論文集 32, pp.278-279
    • Place of Presentation
      福山大学宮地茂記念館
    • Year and Date
      2016-08-20
    • Related Report
      2016 Research-status Report
  • [Presentation] 環境共生型まちづくりのための3次元建物モデルの自動生成2016

    • Author(s)
      村瀬孝宏, 杉原健一, 周欣欣
    • Organizer
      情報文化学会第24回全国大会講演予稿集, pp.53-57
    • Place of Presentation
      東京大学
    • Related Report
      2016 Research-status Report
  • [Presentation] Automatic Generation of 3D Building Models for2014

    • Author(s)
      K.Sugihara, Xinxin Zhou, Zhenjiang Shen
    • Organizer
      5th Digital Earth Summit
    • Place of Presentation
      International Digital Earth Applied Science Research Center (IDEAS), WINC Aichi, Nagoya, JAPAN
    • Year and Date
      2014-11-09 – 2014-11-11
    • Related Report
      2014 Research-status Report

URL: 

Published: 2014-04-04   Modified: 2019-03-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi