• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Communicative instruction media using X-person perspective video

Research Project

Project/Area Number 17H01772
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Human interface and interaction
Research InstitutionUniversity of Tsukuba

Principal Investigator

Kitahara Itaru  筑波大学, 計算科学研究センター, 教授 (70323277)

Co-Investigator(Kenkyū-buntansha) 亀田 能成  筑波大学, 計算科学研究センター, 教授 (70283637)
Project Period (FY) 2017-04-01 – 2021-03-31
Project Status Completed (Fiscal Year 2020)
Budget Amount *help
¥17,550,000 (Direct Cost: ¥13,500,000、Indirect Cost: ¥4,050,000)
Fiscal Year 2020: ¥3,640,000 (Direct Cost: ¥2,800,000、Indirect Cost: ¥840,000)
Fiscal Year 2019: ¥3,250,000 (Direct Cost: ¥2,500,000、Indirect Cost: ¥750,000)
Fiscal Year 2018: ¥4,160,000 (Direct Cost: ¥3,200,000、Indirect Cost: ¥960,000)
Fiscal Year 2017: ¥6,500,000 (Direct Cost: ¥5,000,000、Indirect Cost: ¥1,500,000)
Keywords臨場感コミュニケーション / 多視点映像 / 自由視点映像 / 教示メディア / インタラクティブメディア / 教示映像 / 映像コミュニケーション / 不特定人称視点 / 多人称視点映像 / 不特定人称視点映像 / インタフェース
Outline of Final Research Achievements

In this research project, we have developed a method for generating and displaying "X-person's view video", which enables 3D observation while freely switching between multiple perspectives, such as oneself (first person), the other person (second person), and an overall view (third person), by using a multi-viewpoint image sliding method that has the features of free viewpoint movement and high-quality image generation. In cooperation with researchers in a variety of fields, we have introduced the X-person's view video into the field of training in sports, therapist education, medical operation, etc., and verified the observation position and perspective suitable for grasping the content of the task. In this way, we conducted research on the realization of video media suitable for interactive instruction and teaching based on communication (communicative teaching) among multiple people .

Academic Significance and Societal Importance of the Research Achievements

基盤技術開発から実証実験の実施を通じて、多視点スライディング方式を用いた自由視点映像生成提示手法を、インタラクティブな指導・教示に資するレベルまで引き上げた。具体的には、撮影からコンテンツ生成までの作業軽減を含め、教示現場に導入可能な多視点映像撮影システムの実現に取り組んだ。また、直感的な視点操作とコンテキスト理解を可能とするタブレット型閲覧インタフェースを開発した。スポーツトレーニング、セラピスト育成、医療施術における実証実験を通じて、不特定人称映像の観察視点や人称を調査し、コミュニケーション型教示における要求と考案映像メディア方式の実用性を検証した。

Report

(5 results)
  • 2020 Annual Research Report   Final Research Report ( PDF )
  • 2019 Annual Research Report
  • 2018 Annual Research Report
  • 2017 Annual Research Report
  • Research Products

    (53 results)

All 2021 2020 2019 2018 2017 Other

All Int'l Joint Research (6 results) Journal Article (20 results) (of which Int'l Joint Research: 7 results,  Peer Reviewed: 20 results,  Open Access: 12 results) Presentation (20 results) (of which Int'l Joint Research: 9 results,  Invited: 3 results) Remarks (3 results) Patent(Industrial Property Rights) (4 results)

  • [Int'l Joint Research] Curtin University(オーストラリア)

    • Related Report
      2020 Annual Research Report
  • [Int'l Joint Research] University of Surrey(英国)

    • Related Report
      2020 Annual Research Report
  • [Int'l Joint Research] University of Surrey(英国)

    • Related Report
      2019 Annual Research Report
  • [Int'l Joint Research] Curtin University(オーストラリア)

    • Related Report
      2019 Annual Research Report
  • [Int'l Joint Research] University of Surrey(英国)

    • Related Report
      2017 Annual Research Report
  • [Int'l Joint Research] Curtin University(Australia)

    • Related Report
      2017 Annual Research Report
  • [Journal Article] マーカレス3次元骨格位置推定のためのカメラキャリブレーション手法とバドミントン競技映像処理への実践2020

    • Author(s)
      宍戸 英彦、北原 格
    • Journal Title

      情報処理学会論文誌デジタルプラクティス(TDP)

      Volume: Vol.1, No.1 Pages: 8-19

    • NAID

      170000183490

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Geometric Calibration of Projector Using a Mobile Camera for Spatial Augmented Reality2020

    • Author(s)
      Chun Xie, Hidehiko Shishido, Yoshinari Kameda, Itaru Kitahara
    • Journal Title

      Transactions of the Virtual Reality Society of Japan

      Volume: Vol.25, No.2 Pages: 138-147

    • NAID

      130007866524

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Accurate Overlapping Method of Ultra-Long Interval Time-Lapse Images for World Heritage Site Investigation2020

    • Author(s)
      Shishido Hidehiko、Kawasaki Emi、Kawamura Youhei、Matsui Toshiya、Kitahara Itaru
    • Journal Title

      Journal on Computing and Cultural Heritage

      Volume: 13 Pages: 1-18

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Method of Multiview Video Switching for Soccer Game Analysis in Large Scale Space2020

    • Author(s)
      Shishido Hidehiko、Okada Yosuke、Kameda Yoshinari、Koido Masaaki、Kitahara Itaru
    • Journal Title

      ITE Transactions on Media Technology and Applications

      Volume: 8 Pages: 70-80

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Image-quality Improvement of Omnidirectional Free-viewpoint Images by Generative Adversarial Networks2020

    • Author(s)
      Takeuchi Oto, Shishido Hidehiko, Kameda Yoshinari, Kim Hansung, Kitahara Itaru
    • Journal Title

      Proceedings of International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISAPP2020)

      Volume: - Pages: 299-306

    • DOI

      10.5220/0008959802990306

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Read-the-game: System for skill-based visual exploratory activity assessment with a full body virtual reality soccer simulation2020

    • Author(s)
      Rojas Ferrer Cesar Daniel, Shishido Hidehiko, Kitahara Itaru, Kameda Yoshinari
    • Journal Title

      PLOS ONE

      Volume: 15-3 Issue: 3 Pages: 1-29

    • DOI

      10.1371/journal.pone.0230042

    • NAID

      120007161351

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] [Papers] Method of Multiview Video Switching for Soccer Game Analysis in Large Scale Space2020

    • Author(s)
      Shishido Hidehiko、Okada Yosuke、Kameda Yoshinari、Koido Masaaki、Kitahara Itaru
    • Journal Title

      ITE Transactions on Media Technology and Applications

      Volume: 8 Issue: 2 Pages: 70-80

    • DOI

      10.3169/mta.8.70

    • NAID

      130007825881

    • ISSN
      2186-7364
    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Development of 3D rock fragmentation measurement system using photogrammetry2019

    • Author(s)
      Hyongdoo Jang, Itaru Kitahara, Youhei Kawamura, Yasunori Endo, Erkan Topal, Ryo Degawa & Samson Mazara
    • Journal Title

      International Journal of Mining, Reclamation and Environment

      Volume: なし Issue: 4 Pages: 294-305

    • DOI

      10.1080/17480930.2019.1585597

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Calibration of multiple sparsely distributed cameras using a mobile camera2019

    • Author(s)
      Shishido Hidehiko, Kitahara Itaru
    • Journal Title

      Proceedings of the Institution of Mechanical Engineers, Part P: Journal of Sports Engineering and Technology

      Volume: 234 Issue: 1 Pages: 37-48

    • DOI

      10.1177/1754337119874276

    • NAID

      120007132789

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] 視覚教示による学習支援のための大規模床面投影システム2019

    • Author(s)
      謝 淳, 高橋 一誠, 大木 美加, ブロー バティスト, 北原 格, 鈴木 健嗣
    • Journal Title

      電子情報通信学会和文論文誌A

      Volume: Vol.J102-A, No.2 Pages: 68-79

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed
  • [Journal Article] An Empathic Design Approach to an Augmented Gymnasium in a Special Needs School Setting2018

    • Author(s)
      Issey Takahashi, Mika Oki, Baptiste Bourreau, Itaru Kitahara, and Kenji Suzuki
    • Journal Title

      International Journal of Design

      Volume: Vol.12, No.3 Pages: 111-125

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] On-site Visual Feedback System with Multi-View Video Contents2018

    • Author(s)
      永井隆昌, 宍戸英彦, 亀田能成,北原格
    • Journal Title

      The Journal of The Institute of Image Information and Television Engineers

      Volume: 72 Issue: 9 Pages: J119-J124

    • DOI

      10.3169/itej.72.J119

    • NAID

      130007458333

    • ISSN
      1342-6907, 1881-6908
    • Related Report
      2018 Annual Research Report
    • Peer Reviewed
  • [Journal Article] A Calibration Method of Floor Projection System for Learning Aids at School Gym2018

    • Author(s)
      Chun Xie, Hidehiko Shishido, Mika Oki, Yoshinari Kameda, Kenji Suzuki and Itaru Kitahara
    • Journal Title

      Third IEEE International Conference on Image Processing, Applications and Systems (IPAS 2018)

      Volume: -

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] An On-site Visual Feedback Method Using Bullet-Time Video2018

    • Author(s)
      Takasuke Nagai, Hidehiko Shishido, Yoshinari Kameda, Itaru Kitahara
    • Journal Title

      ACM MM2018 First International Workshop on Multimedia Content Analysis in Sports

      Volume: - Pages: 39-44

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Xth Person View Video for Observation from Diverse Perspectives2018

    • Author(s)
      Naoki Shimura, Hidehiko Shishido, Yoshinari Kameda, Kenji Suzuki, Itaru Kitahara
    • Journal Title

      2018 Joint 7th International Conference on Informatics, Electronics & Vision (ICIEV) and 2018 2nd International Conference on Imaging, Vision & Pattern Recognition (icIVPR)

      Volume: -

    • NAID

      120007134097

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Generation Method for Immersive Bullet-Time Video Using an Omnidirectional Camera in VR Platform2018

    • Author(s)
      Oto Takeuchi, Hidehiko Shishido, Yoshinari Kameda, Hansung Kim, Itaru Kitahara
    • Journal Title

      ACM MM2018 Workshop on Audio-Visual Scene Understanding for Immersive Multimedia

      Volume: - Pages: 19-26

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] [Paper] Improvement of Badminton-Player Tracking Applying Image Pixel Compensation2017

    • Author(s)
      Takashi Kamiyama, Yoshinari Kameda, Yuichi Ohta, Itaru Kitahara
    • Journal Title

      ITE Transactions on Media Technology and Applications

      Volume: 5 Issue: 2 Pages: 36-41

    • DOI

      10.3169/mta.5.36

    • NAID

      130005530487

    • ISSN
      2186-7364
    • Related Report
      2017 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] [Paper] Visual Tracking Method of a Quick and Anomalously Moving Badminton Shuttlecock2017

    • Author(s)
      Hidehiko Shishido, Yoshinari Kameda, Yuichi Ohta, Itaru Kitahara
    • Journal Title

      ITE Transactions on Media Technology and Applications

      Volume: 5 Issue: 3 Pages: 110-120

    • DOI

      10.3169/mta.5.110

    • NAID

      130006907809

    • ISSN
      2186-7364
    • Related Report
      2017 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] A Method to Relieve Stress of Passenger on an Autonomous Vehicle Using See-Through Vision and Visualization of Vehicle Control Information2017

    • Author(s)
      笹井翔太, 亀田能成, 大田友一, 神原誠之, 萩田紀博, 北原格
    • Journal Title

      Transactions of the Virtual Reality Society of Japan

      Volume: 22 Issue: 2 Pages: 189-198

    • DOI

      10.18974/tvrsj.22.2_189

    • NAID

      130005701305

    • ISSN
      1344-011X, 2423-9593
    • Related Report
      2017 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] FUTUREGYM: A gymnasium with interactive floor projection for children with special needs2017

    • Author(s)
      Issey Takahashi, Mika Oki, Baptiste Bourreau, Itaru Kitahara, Kenji Suzuki
    • Journal Title

      International Journal of Child-Computer Interaction

      Volume: Vol.15 Pages: 37-47

    • DOI

      10.1016/j.ijcci.2017.12.002

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed / Open Access
  • [Presentation] A Dense 3D Organ Modeling from a Laparoscopic Video2021

    • Author(s)
      Ryosuke Maekawa, Hidehiko Shishido, Yoshinari Kameda, Itaru Kitahara
    • Organizer
      International Forums on Medical Imaging in Asia (IFMIA2021)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Interactive e-Book Linking Text and Multi-View Video2020

    • Author(s)
      Xinyi Qiu, Hidehiko Shishido, Ryuuki Sakamoto, Itaru Kitahara
    • Organizer
      IEEE 9th Global Conference on Consumer Electronics (GCCE2020)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] VR Interface for Designing Multi-view-Camera Layout in a Large-Scale Space2020

    • Author(s)
      Naoto Matsubara, Hidehiko Shishido, Itaru Kitahara
    • Organizer
      The 7th International Conference on Augmented Reality, Virtual Reality and Computer Graphics (SALENTO AVR2020)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 複数の曲面鏡像からの自由視点映像生成法2020

    • Author(s)
      蛭田 雄也,宍戸 英彦,北原 格
    • Organizer
      日本バーチャルリアリティ学会複合現実感研究会,
    • Related Report
      2020 Annual Research Report
  • [Presentation] 深層学習による3次元運動予測を用いた遠隔操作映像の時間補償2020

    • Author(s)
      上田 樹,宍戸 英彦,北原 格
    • Organizer
      情報処理学会コンピュータビジョンとイメージメディア研究会(CVIM)
    • Related Report
      2020 Annual Research Report
  • [Presentation] 投手正面から撮影した映像中での投球動作初期の分析2020

    • Author(s)
      野原 直翔,宍戸 英彦,北原 格,亀田 能成
    • Organizer
      電子情報通信学会 技術研究報告MVE
    • Related Report
      2019 Annual Research Report
  • [Presentation] 3次元画像処理と敵対的生成ネットワークを用いた全方位多視点画像閲覧法2020

    • Author(s)
      竹内 音,宍戸 英彦,亀田 能成,Kim Hansung,北原 格
    • Organizer
      日本バーチャルリアリティ学会複合現実感研究会
    • Related Report
      2019 Annual Research Report
  • [Presentation] 多視点映像を用いたインタラクティブ電子書籍による立体芸術鑑賞方式2019

    • Author(s)
      Qiu XinYi,宍戸 英彦,亀田 能成,坂本 竜基,北原 格
    • Organizer
      日本バーチャルリアリティ学会複合現実感研究会
    • Related Report
      2019 Annual Research Report
  • [Presentation] 多視点カメラ配置検討のためのVRインタフェース2019

    • Author(s)
      松原 尚利,宍戸 英彦,亀田 能成,北原 格
    • Organizer
      第24回日本バーチャルリアリティ学会大会
    • Related Report
      2019 Annual Research Report
  • [Presentation] 鏡面反射領域を用いた一人称視点映像生成法2019

    • Author(s)
      蛭田 雄也,宍戸 英彦,亀田 能成,北原 格
    • Organizer
      情報処理学会 第18回情報科学技術フォーラム(FIT2019)
    • Related Report
      2019 Annual Research Report
  • [Presentation] Free-Viewpoint Video Generation in Sports Stadium2018

    • Author(s)
      Itaru Kitahara
    • Organizer
      The 10th Three Dimensional Systems and Applications (3DSA2018)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Augmented Reality Display for Visually Supporting Human on a Vehicle2018

    • Author(s)
      Itaru Kitahara
    • Organizer
      International Workshop on Comfort Intelligence with AR for Autonomous Vehicle
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] 注目領域の見え方変化を軽減するバレットタイム映像スタビライジング法2018

    • Author(s)
      鳥屋 剛毅, 北原 格
    • Organizer
      第21回画像の認識・理解シンポジウム(MIRU2018)
    • Related Report
      2018 Annual Research Report
  • [Presentation] Automatic camera-work generation of bullet-time video for soccer scene2018

    • Author(s)
      Yosuke Okada, Hidehiko Shishido, Yoshinari Kameda, Masaaki Koido, Itaru Kitahara
    • Organizer
      The 15th ACM SIGGRAPH European Conference on Visual Media Production (CVMP2018)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Bullet-Time Book: Augmentation of Visual Information in Figures by Bullet-Time Video Display2018

    • Author(s)
      Qiu Xin Yi, Hidehiko Shishido, Yoshinari Kameda, Itaru Kitahara
    • Organizer
      The 2nd Asia-Pacific Workshop on Mixed and Augmented Reality (APMAR)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 発達教育支援に着目した多視点映像閲覧インタフェースの開発2018

    • Author(s)
      北村誠之, 宍戸英彦, 榎本拓哉, 亀田能成, 山本淳一, 北原格
    • Organizer
      情報処理学会CVIM研究会
    • Related Report
      2017 Annual Research Report
  • [Presentation] 全方位バレットタイム映像の生成提示システム2018

    • Author(s)
      竹内 音, 宍戸 英彦, 亀田 能成, キム ハンソン, 北原 格
    • Organizer
      情報処理学会CVIM研究会
    • Related Report
      2017 Annual Research Report
  • [Presentation] SMOOTHLY SWITCHING METHOD OF ASYNCHRONOUS MULTI-VIEW VIDEOS USING FRAME INTERPOLATION2017

    • Author(s)
      Hidehiko Shishido, Aoi Harazaki, Yoshinari Kameda, Itaru Kitahara
    • Organizer
      The 3DTV Conference 2017
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Pseudo-Dolly-In Video Generation Combining 3D Modeling and Image Reconstruction2017

    • Author(s)
      Hidehiko Shishido, Kazuki Yamanaka, Yoshinari Kameda, Itaru Kitahara
    • Organizer
      2017 IEEE International Symposium on Mixed and Augmented Reality Workshop on Highly Diverse Cameras and Displays for Mixed and Augmented Reality
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 多視点映像メディア技術に基づいた研究開発事例の紹介2017

    • Author(s)
      北原格
    • Organizer
      URCF超臨場感映像WG:医工連携の最前線とその周辺技術
    • Related Report
      2017 Annual Research Report
    • Invited
  • [Remarks] 筑波大学「大学『知』活用プログラム」Remote Museum Explorer

    • URL

      https://www.osi.tsukuba.ac.jp/fight_covid19/kitahara/

    • Related Report
      2020 Annual Research Report
  • [Remarks] 自由に視点を変えて展示物を楽しめる技術の開発

    • URL

      https://www.osi.tsukuba.ac.jp/fight_covid19_interview/kitahara/

    • Related Report
      2020 Annual Research Report
  • [Remarks] 筑波大学研究者総覧

    • URL

      https://trios.tsukuba.ac.jp/researcher/0000001021

    • Related Report
      2020 Annual Research Report
  • [Patent(Industrial Property Rights)] 多視点映像撮影装置2020

    • Inventor(s)
      北原格、小田竜也
    • Industrial Property Rights Holder
      北原格、小田竜也
    • Industrial Property Rights Type
      特許
    • Industrial Property Number
      2020-055921
    • Filing Date
      2020
    • Related Report
      2019 Annual Research Report
  • [Patent(Industrial Property Rights)] 映像処理システム及び映像処理装置2018

    • Inventor(s)
      北原格
    • Industrial Property Rights Holder
      北原格
    • Industrial Property Rights Type
      特許
    • Industrial Property Number
      2018-219927
    • Filing Date
      2018
    • Related Report
      2018 Annual Research Report
  • [Patent(Industrial Property Rights)] 撮像システム、撮像方式2017

    • Inventor(s)
      北原格、宍戸英彦
    • Industrial Property Rights Holder
      国立大学法人筑波大学
    • Industrial Property Rights Type
      特許
    • Industrial Property Number
      2017-152604
    • Filing Date
      2017
    • Related Report
      2017 Annual Research Report
  • [Patent(Industrial Property Rights)] 画像処理装置、画像表示装置及び画像処理プログラム2017

    • Inventor(s)
      北原格、宍戸英彦
    • Industrial Property Rights Holder
      国立大学法人筑波大学
    • Industrial Property Rights Type
      特許
    • Industrial Property Number
      2017-183910
    • Filing Date
      2017
    • Related Report
      2017 Annual Research Report

URL: 

Published: 2017-04-28   Modified: 2022-12-28  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi