• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

A Study on the Free-viewpoint Panoramic Video

Research Project

Project/Area Number 17H07324
Research Category

Grant-in-Aid for Research Activity Start-up

Allocation TypeSingle-year Grants
Research Field Perceptual information processing
Research InstitutionNational Institute of Informatics

Principal Investigator

Ikehata Satoshi  国立情報学研究所, コンテンツ科学研究系, 助教 (70804061)

Project Period (FY) 2017-08-25 – 2019-03-31
Project Status Completed (Fiscal Year 2019)
Budget Amount *help
¥2,990,000 (Direct Cost: ¥2,300,000、Indirect Cost: ¥690,000)
Fiscal Year 2018: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Fiscal Year 2017: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Keywordsフォトメトリックステレオ / 3次元センシング / 最適化アルゴリズム / 深層学習 / ディープラーニング / パノラマ画像処理 / コンピュータビジョン / 3次元復元 / パノラマ画像 / VR / 画像 / コンテンツ・アーカイブ / 機械学習
Outline of Final Research Achievements

In this project, we developed the techniques to enrich the immersive virtual reality contents. Especially, we aimed to recover the detailed 3-d geometry from images to generate the virtually synthetic scenes more physically plausible. We presented the world’s first convolutional-neural-network-based photometric stereo algorithm that can accurately recover the detailed scene geometry. We further published the first large-scale training dataset of the photometric stereo problem. In addition to those achievements, we supplementarily presented the robust deep-learning algorithm to remove outliers in the observation, efficient discrete optimization algorithms and geo-localization algorithm using geo-tag information.

Academic Significance and Societal Importance of the Research Achievements

研究成果において副次的に生成されたソースコードやデータを公開したことの学術的な意義は大きい.データベースは公開後、世界中の研究者によって利用されるに至っている.また,我々は1980年代から続くフォトメトリックステレオ法の研究に対して,新しい概念の提示による技術的進歩,データセットの共有と両方の観点から、大きな影響を与えた.現在でも我々の提案した観測地図と呼ばれる表彰に基づく手法を発展させた研究が発表され続けている.

Report

(3 results)
  • 2019 Final Research Report ( PDF )
  • 2018 Annual Research Report
  • 2017 Annual Research Report
  • Research Products

    (7 results)

All 2019 2018 2017

All Journal Article (3 results) (of which Int'l Joint Research: 2 results,  Peer Reviewed: 3 results,  Open Access: 1 results) Presentation (3 results) (of which Int'l Joint Research: 2 results) Book (1 results)

  • [Journal Article] Efficiency-enhanced cost-volume filtering featuring coarse-to-fine strategy2018

    • Author(s)
      Ryosuke Furuta, Satoshi Ikehata, Toshihiko Yamaskai, Kiyoharu Aizawa
    • Journal Title

      Multimedia Tools and Applications

      Volume: 77 Pages: 12469-12491

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed
  • [Journal Article] From Bayesian Sparsity to Gated Recurrent Nets2017

    • Author(s)
      Hao He,Bo Xin,Satoshi Ikehata,David P. Wipf
    • Journal Title

      Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017

      Volume: - Pages: 5560-5570

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Efficiency-Enhanced Cost-Volume Filtering Featuring Coarse-to-Fine Strategy2017

    • Author(s)
      R. Furuta, S. Ikehata, Toshihiko Yamasaki, and Kiyoharu Aizawa
    • Journal Title

      Multimedia Tools and Applications

      Volume: 0 Issue: 10 Pages: 1-23

    • DOI

      10.1007/s11042-017-4897-1

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Presentation] The Color Black is Most Important and Special for Making Professional Wrestlers Attractive and Fearful2019

    • Author(s)
      Tomohiko Akagi, Satoshi Ikehata, Takeharu Seno
    • Organizer
      The 5th asian color association conference (ACA2019 Nagoya)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Scale Drift Correction of Camera Geo-Localization using Geo-Tagged Images2018

    • Author(s)
      Kazuya Iwami, Satoshi Ikehata, Kiyoharu Aizawa
    • Organizer
      6th Workshop on Computer Vision for Road Scene Understanding and Autonomous Driving (ECCV2018 Workshop)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] CNN-PS: CNN-based Photometricc Stereo for General Non-Convex Surfaces2018

    • Author(s)
      Satoshi Ikehata
    • Organizer
      European Conference on Computer Vision (ECCV)
    • Related Report
      2018 Annual Research Report
  • [Book] コンピュータビジョン2018

    • Author(s)
      米谷 竜、斎藤 英雄、池畑 諭、牛久 祥孝、内山 英昭、内海 ゆづ子、小野 峻佑、片岡 裕雄、金崎 朝子、川西 康友、齋藤 真樹、櫻田 健、高橋 康輔、松井 勇佑
    • Total Pages
      272
    • Publisher
      共立出版
    • ISBN
      9784320123571
    • Related Report
      2018 Annual Research Report

URL: 

Published: 2017-08-25   Modified: 2021-02-19  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi