• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Omnidirectional Cinemagraph Generation for Interactive Telepresence with High Realistic Sensation

Research Project

Project/Area Number 25540086
Research Category

Grant-in-Aid for Challenging Exploratory Research

Allocation TypeMulti-year Fund
Research Field Human interface and interaction
Research InstitutionNara Institute of Science and Technology

Principal Investigator

Yokoya Naokazu  奈良先端科学技術大学院大学, 情報科学研究科, 教授 (10252834)

Co-Investigator(Kenkyū-buntansha) SATO Tomokazu  奈良先端科学技術大学院大学, 情報科学研究科, 准教授 (50362835)
KAWAI Norihiko  奈良先端科学技術大学院大学, 情報科学研究科, 助教 (30610670)
Project Period (FY) 2013-04-01 – 2016-03-31
Project Status Completed (Fiscal Year 2015)
Budget Amount *help
¥3,770,000 (Direct Cost: ¥2,900,000、Indirect Cost: ¥870,000)
Fiscal Year 2015: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2014: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2013: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Keywordsシネマグラフ / 自由視点画像生成 / 動物体検出 / 動物体除去 / 自由視点画像 / バーチャルリアリティ / 背景画像生成 / 画像修復 / 全方位映像 / テレプレゼンス
Outline of Final Research Achievements

The objective of this project is to generate omnidirectional cinemagraphs for telepresence with high realistic sensation. For this objective, we developed a method for cinemagraph generation from an image sequence captured with a moving camera and its elemental technologies. Specifically, since each frame of video captured with a moving camera is required to be transformed to a different viewpoint in cinemagraph generation, we developed methods for novel view synthesis for static scenes and moving objects. We then developed methods for detecting and removing moving objects that do not perform cyclic motion because such objects hinder from generating cinemagraphs. Finally, by applying the developed methods, we developed a cinemagraph generation method from an image sequence captured with a moving camera.

Report

(4 results)
  • 2015 Annual Research Report   Final Research Report ( PDF )
  • 2014 Research-status Report
  • 2013 Research-status Report
  • Research Products

    (24 results)

All 2016 2015 2014 Other

All Journal Article (7 results) (of which Peer Reviewed: 7 results,  Acknowledgement Compliant: 7 results,  Open Access: 2 results) Presentation (16 results) (of which Int'l Joint Research: 1 results) Remarks (1 results)

  • [Journal Article] Novel view synthesis based on view-dependent texture mapping with geometry-aware color continuity2016

    • Author(s)
      K. Katagiri, Y. Nakashima, T. Sato, and N. Yokoya
    • Journal Title

      Transactions of the Virtual Reality Society of Japan

      Volume: 21 Pages: 153-162

    • Related Report
      2015 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] AR image generation using view-dependent geometry modification and texture mapping2015

    • Author(s)
      Y. Nakashima, Y. Uno, N. Kawai, T. Sato, and N. Yokoya
    • Journal Title

      Virtual Reality

      Volume: 19 Issue: 2 Pages: 83-94

    • DOI

      10.1007/s10055-015-0259-3

    • NAID

      120005867202

    • Related Report
      2015 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Removal of moving objects from point cloud data for 3D modeling of outdoor environments2015

    • Author(s)
      T. Kanatani, H. Kume, T. Taketomi, T. Sato, and N. Yokoya
    • Journal Title

      IIEEJ Transactions on Image Electronics and Visual Computing

      Volume: 3 Pages: 54-62

    • Related Report
      2015 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] Increasing pose comprehension through augmented reality reenactment2015

    • Author(s)
      F. Dayrit, Y. Nakashima, T. Sato, and N. Yokoya
    • Journal Title

      Multimedia Tools and Applications

      Volume: - Issue: 1 Pages: 1-22

    • DOI

      10.1007/s11042-015-3116-1

    • NAID

      120005867201

    • Related Report
      2015 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Background Estimation for a Single Omnidirectional Image Sequence Captured with a Moving Camera2014

    • Author(s)
      Norihiko Kawai, Naoya Inoue, Tomokazu Sato, Fumio Okura, Yuta Nakashima, and Naokazu Yokoya
    • Journal Title

      IPSJ Transactions on Computer Vision and Applications

      Volume: 6 Issue: 0 Pages: 68-72

    • DOI

      10.2197/ipsjtcva.6.68

    • NAID

      130004952378

    • ISSN
      1882-6695
    • Related Report
      2014 Research-status Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] Evaluation of image processing algorithms on vehicle safety system based on free-viewpoint image rendering2014

    • Author(s)
      Akitaka Oko, Tomokazu Sato, Hideyuki Kume, Takashi Machida, and Naokazu Yokoya
    • Journal Title

      Proc. IEEE Intelligent Vehicles Symposium (IV2014)

      Volume: - Pages: 706-711

    • DOI

      10.1109/ivs.2014.6856496

    • NAID

      120006659629

    • Related Report
      2014 Research-status Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Free-viewpoint AR human-motion reenactment based on a single RGB-D video stream2014

    • Author(s)
      Fabian Lorenzo Dayrit, Yuta Nakashima, Tomokazu Sato, and Naokazu Yokoya
    • Journal Title

      Proc. IEEE Int. Conf. on Multimedia and Expo (ICME2014)

      Volume: - Pages: 1-6

    • DOI

      10.1109/icme.2014.6890243

    • NAID

      120006659630

    • Related Report
      2014 Research-status Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Presentation] 奥行情報と輝度情報の整合性を利用した 屋外環境計測データからの移動物体検出2016

    • Author(s)
      髙部篤志
    • Organizer
      電子情報通信学会パターン認識・メディア理解研究会
    • Place of Presentation
      九州工業大学(福岡県飯塚市)
    • Year and Date
      2016-02-21
    • Related Report
      2015 Annual Research Report
  • [Presentation] Generating a 3D shape template of a moving and deforming object from an RGB-D image sequence2016

    • Author(s)
      H. Takehara
    • Organizer
      IS&T International Symposium on Electronic Imaging
    • Place of Presentation
      San Francisco(USA)
    • Year and Date
      2016-02-14
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 車載システムにより計測された三次元点群 および画像群を対象とした移動物体検出2015

    • Author(s)
      髙部篤志
    • Organizer
      映像情報メディア学会冬季大会2015
    • Place of Presentation
      早稲田大学(東京都新宿区)
    • Year and Date
      2015-12-15
    • Related Report
      2015 Annual Research Report
  • [Presentation] 単一のRGB-Dカメラを用いた非剛体物体の3次元形状復元2015

    • Author(s)
      武原光
    • Organizer
      第32回センシングフォーラム
    • Place of Presentation
      大阪電気通信大学(大阪府寝屋川市)
    • Year and Date
      2015-09-10
    • Related Report
      2015 Annual Research Report
  • [Presentation] 線分の直線性およびテクスチャの連続性を考慮した自由視点画像生成2015

    • Author(s)
      河合紀彦
    • Organizer
      画像の認識・理解シンポジウム(MIRU)
    • Place of Presentation
      ホテル阪急エキスポパーク(大阪府吹田市)
    • Year and Date
      2015-07-27
    • Related Report
      2015 Annual Research Report
  • [Presentation] View-dependent texture mapping-based novel view synthesis with geometry-aware color continuity2015

    • Author(s)
      Y. Nakashima
    • Organizer
      画像の認識・理解シンポジウム(MIRU)
    • Place of Presentation
      ホテル阪急エキスポパーク(大阪府吹田市)
    • Year and Date
      2015-07-27
    • Related Report
      2015 Annual Research Report
  • [Presentation] テクスチャの連続性を考慮した視点依存テクスチャマッピングによる自由視点画像生成2015

    • Author(s)
      片桐 敬太
    • Organizer
      電子情報通信学会 パターン認識・メディア理解研究会
    • Place of Presentation
      慶應義塾大学矢上キャンパス(神奈川県横浜市)
    • Year and Date
      2015-03-19 – 2015-03-20
    • Related Report
      2014 Research-status Report
  • [Presentation] 実時間自由視点画像生成を用いた実画像に基づくドライブシミュレータシステム2015

    • Author(s)
      松元 裕哉
    • Organizer
      電子情報通信学会 パターン認識・メディア理解研究会
    • Place of Presentation
      慶應義塾大学矢上キャンパス(神奈川県横浜市)
    • Year and Date
      2015-03-19 – 2015-03-20
    • Related Report
      2014 Research-status Report
  • [Presentation] 線分の直線性およびテクスチャの連続性を考慮した画像変形に基づく自由視点画像生成における歪みの抑制2015

    • Author(s)
      篠本 渉
    • Organizer
      電子情報通信学会 パターン認識・メディア理解研究会
    • Place of Presentation
      慶應義塾大学矢上キャンパス(神奈川県横浜市)
    • Year and Date
      2015-03-19 – 2015-03-20
    • Related Report
      2014 Research-status Report
  • [Presentation] 三次元形状を利用した自由視点画像生成に基づく画像の高解像度化2014

    • Author(s)
      林 佑亮
    • Organizer
      映像情報メディア学会2014年冬季大会
    • Place of Presentation
      東京理科大学森戸記念館(東京都新宿区)
    • Year and Date
      2014-12-17 – 2014-12-18
    • Related Report
      2014 Research-status Report
  • [Presentation] 自由視点画像生成に基づいた移動カメラ映像からのシネマグラフ生成2014

    • Author(s)
      中島 章敬
    • Organizer
      映像情報メディア学会2014年冬季大会
    • Place of Presentation
      東京理科大学森戸記念館(東京都新宿区)
    • Year and Date
      2014-12-17 – 2014-12-18
    • Related Report
      2014 Research-status Report
  • [Presentation] 透視投影歪みを自動補正した画像修復2014

    • Author(s)
      笹尾 海斗
    • Organizer
      電気関係学会関西連合大会
    • Place of Presentation
      奈良先端科学技術大学院大学(奈良県生駒市)
    • Year and Date
      2014-11-23 – 2014-11-24
    • Related Report
      2014 Research-status Report
  • [Presentation] 自由視点画像を用いた車載カメラ画像処理アルゴリズムの評価2014

    • Author(s)
      小甲 啓隆
    • Organizer
      電子情報通信学会 ITS研究会
    • Place of Presentation
      北海道大学(札幌市)
    • Related Report
      2013 Research-status Report
  • [Presentation] 自由視点画像生成に基づく移動撮影した全方位動画像からの動物体除去2014

    • Author(s)
      井上 直哉
    • Organizer
      2014年電子情報通信学会総合大会
    • Place of Presentation
      新潟大学(新潟市)
    • Related Report
      2013 Research-status Report
  • [Presentation] 透視投影歪みの自動補正に基づく画像修復2014

    • Author(s)
      笹尾 海斗
    • Organizer
      2014年電子情報通信学会総合大会
    • Place of Presentation
      新潟大学(新潟市)
    • Related Report
      2013 Research-status Report
  • [Presentation] Evaluation of Image Processing Algorithms on Vehicle Safety System Based on Free-viewpoint Image Rendering2014

    • Author(s)
      Akitaka Oko
    • Organizer
      IEEE Intelligent Vehicles Symposium
    • Place of Presentation
      Dearborn, Michigan, USA
    • Related Report
      2013 Research-status Report
  • [Remarks] 視覚情報メディア研究室(横矢研究室)ホームページ

    • URL

      http://yokoya.naist.jp/

    • Related Report
      2015 Annual Research Report

URL: 

Published: 2014-07-25   Modified: 2019-07-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi