• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Automatic Generation of 3D Videos from 2D Videos without Using Correspondence between Frames

Research Project

Project/Area Number 15H06669
Research Category

Grant-in-Aid for Research Activity Start-up

Allocation TypeSingle-year Grants
Research Field Multimedia database
Research InstitutionWaseda University

Principal Investigator

Iizuka Satoshi  早稲田大学, 理工学術院, 次席研究員(研究院講師) (30755153)

Project Period (FY) 2015-08-28 – 2017-03-31
Project Status Completed (Fiscal Year 2016)
Budget Amount *help
¥2,990,000 (Direct Cost: ¥2,300,000、Indirect Cost: ¥690,000)
Fiscal Year 2016: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Fiscal Year 2015: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Keywordsコンピュータグラフィクス / 3次元映像 / 画像処理 / ディープラーニング / 3次元形状推定
Outline of Final Research Achievements

We have developed a fully convolutional neural network model that directly outputs a depth map from an image for automatically converting 2D videos to 3D videos. The technique can also be applied to videos by processing them frame-by-frame. Additionally, we have developed a method to easily generate complicated weathering effects in images and a technique to automatically colorize old black-and-white photographs with deep learning, which makes the generated 3D images and videos more photorealistic. These research results were accepted to the top conferences in the computer graphics field.

Report

(3 results)
  • 2016 Annual Research Report   Final Research Report ( PDF )
  • 2015 Annual Research Report
  • Research Products

    (11 results)

All 2016

All Journal Article (2 results) (of which Peer Reviewed: 2 results) Presentation (9 results) (of which Int'l Joint Research: 3 results,  Invited: 6 results)

  • [Journal Article] Single Image Weathering via Exemplar Propagation2016

    • Author(s)
      Satoshi Iizuka, Yuki Endo, Yoshihiro Kanamori, Jun Mitani
    • Journal Title

      Computer Graphics Forum

      Volume: 35 Issue: 2 Pages: 501-509

    • DOI

      10.1111/cgf.12850

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Let there be Color!: Joint End-to-end Learning of Global and Local Image Priors for Automatic Image Colorization with Simultaneous Classification2016

    • Author(s)
      Satoshi Iizuka, Edgar Simo-Serra, Hiroshi Ishikawa
    • Journal Title

      ACM Transaction on Graphics

      Volume: 35 Issue: 4 Pages: 1-11

    • DOI

      10.1145/2897824.2925974

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed
  • [Presentation] ディープラーニングによる画像生成の最前線(基礎)2016

    • Author(s)
      飯塚里志
    • Organizer
      画像関連学会連合会第3回秋季大会
    • Place of Presentation
      京都工芸繊維大学(京都府)
    • Year and Date
      2016-11-17
    • Related Report
      2016 Annual Research Report
    • Invited
  • [Presentation] AIによる白黒写真の自動色付けシステム2016

    • Author(s)
      飯塚里志
    • Organizer
      デジタルコンテンツEXPO
    • Place of Presentation
      日本科学未来館(東京都)
    • Year and Date
      2016-10-27
    • Related Report
      2016 Annual Research Report
    • Invited
  • [Presentation] 大規模学習を用いたCGの最先端研究の紹介2016

    • Author(s)
      飯塚里志
    • Organizer
      CEDEC
    • Place of Presentation
      パシフィコ横浜(神奈川県)
    • Year and Date
      2016-08-24
    • Related Report
      2016 Annual Research Report
    • Invited
  • [Presentation] Let there be Color!: Joint End-to-end Learning of Global and Local Image Priors for Automatic Image Colorization with Simultaneous Classification2016

    • Author(s)
      Satoshi Iizuka, Edgar Simo-Serra, Hiroshi Ishikawa
    • Organizer
      ACM SIGGRAPH
    • Place of Presentation
      Anaheim, California
    • Year and Date
      2016-07-24
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 大域特徴と局所特徴の学習による白黒写真の自動色付け2016

    • Author(s)
      飯塚里志
    • Organizer
      Visual Computing/グラフィクスとCAD合同シンポジウム
    • Place of Presentation
      早稲田大学国際会議場(東京都)
    • Year and Date
      2016-06-18
    • Related Report
      2016 Annual Research Report
    • Invited
  • [Presentation] Single Image Weathering via Exemplar Propagation2016

    • Author(s)
      Satoshi Iizuka, Yuki Endo, Yoshihiro Kanamori, Jun Mitani
    • Organizer
      Eurographics
    • Place of Presentation
      Lisbon, Portugal
    • Year and Date
      2016-05-09
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Single Image Weathering via Exemplar Propagation2016

    • Author(s)
      Satoshi Iizuka, Yuki Endo, Yoshihiro Kanamori, and Jun Mitani
    • Organizer
      Eurographics2016
    • Place of Presentation
      Lisbon, Portugal
    • Year and Date
      2016-05-09
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 畳込みニューラルネットワークによる画像生成2016

    • Author(s)
      飯塚里志
    • Organizer
      産業技術総合研究所 人工知能セミナー
    • Place of Presentation
      タイムズ24(東京都)
    • Related Report
      2016 Annual Research Report
    • Invited
  • [Presentation] ニューラルネットワークによる画像生成2016

    • Author(s)
      飯塚里志
    • Organizer
      NHK放送技術研究所 研究セミナー
    • Place of Presentation
      NHK放送技術研究所(東京都)
    • Related Report
      2016 Annual Research Report
    • Invited

URL: 

Published: 2015-08-26   Modified: 2018-03-22  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi