• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Development of a Deep Learning Framework for Image Weathering

Research Project

Project/Area Number 18K18077
Research Category

Grant-in-Aid for Early-Career Scientists

Allocation TypeMulti-year Fund
Review Section Basic Section 61010:Perceptual information processing-related
Research InstitutionUniversity of Tsukuba

Principal Investigator

Satoshi Iizuka  筑波大学, システム情報系, 助教 (30755153)

Project Period (FY) 2018-04-01 – 2022-03-31
Project Status Completed (Fiscal Year 2021)
Budget Amount *help
¥4,160,000 (Direct Cost: ¥3,200,000、Indirect Cost: ¥960,000)
Fiscal Year 2020: ¥520,000 (Direct Cost: ¥400,000、Indirect Cost: ¥120,000)
Fiscal Year 2019: ¥520,000 (Direct Cost: ¥400,000、Indirect Cost: ¥120,000)
Fiscal Year 2018: ¥3,120,000 (Direct Cost: ¥2,400,000、Indirect Cost: ¥720,000)
Keywords経年変化 / 深層学習 / 画像処理 / 経年劣化 / 画像編集
Outline of Final Research Achievements

In order to reproduce the decay of objects in natural images, we worked on developing an image weathering generation method using deep learning. To this end, we constructed a dataset of weathering texture images and trained a deep generative neural network on the texture dataset. This weathering texture generator network is able to generate arbitrary weathering textures such as rust and moss. The users can easily make various weathering images using the proposed method without special knowledge and skills in image processing.

Academic Significance and Societal Importance of the Research Achievements

画像の経年変化の再現技術は,実世界の景観や物体がどのように変化していくかを視覚的かつ直感的に伝えることができるため,都市計画における景観予測やエンターテインメント分野におけるコンテンツ制作など、幅広い応用が期待できる.学術的にも,深層学習を活用して画像の経年劣化を再現する技術はこれまでになく,本研究成果はこのタスクにおける新たなアプローチとして当該研究分野の発展に貢献できると考えられる。

Report

(5 results)
  • 2021 Annual Research Report   Final Research Report ( PDF )
  • 2020 Research-status Report
  • 2019 Research-status Report
  • 2018 Research-status Report
  • Research Products

    (17 results)

All 2021 2020 2019 2018

All Presentation (17 results) (of which Int'l Joint Research: 5 results,  Invited: 7 results)

  • [Presentation] Skeleton-aware Text Image Super-Resolution2021

    • Author(s)
      Shimon Nakaune, Satoshi Iizuka, Kazuhiro Fukui
    • Organizer
      The British Machine Vision Conference (BMVC) 2021
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] High-quality Multi-domain Artwork Generation from Semantic Layouts2021

    • Author(s)
      Yuantian Huang, Satoshi Iizuka, Edgar Simo-Serra, Kazuhiro Fukui
    • Organizer
      第24回 画像の認識・理解シンポジウム(MIRU2021)
    • Related Report
      2021 Annual Research Report
  • [Presentation] 文字構造を考慮した深層学習によるテキスト画像の超解像2021

    • Author(s)
      中畝志門,飯塚里志,福井和広
    • Organizer
      第24回 画像の認識・理解シンポジウム(MIRU2021)
    • Related Report
      2021 Annual Research Report
  • [Presentation] AIによる絵画や映像の修復とその課題2021

    • Author(s)
      飯塚里志
    • Organizer
      色材アドバンスドセミナー2021
    • Related Report
      2021 Annual Research Report
    • Invited
  • [Presentation] 深層学習による白黒写真の自動カラー化2021

    • Author(s)
      飯塚里志
    • Organizer
      令和3年度画像保存セミナー
    • Related Report
      2021 Annual Research Report
    • Invited
  • [Presentation] 深層学習による画像処理2021

    • Author(s)
      飯塚里志
    • Organizer
      VC + VCC 2021
    • Related Report
      2021 Annual Research Report
    • Invited
  • [Presentation] Image Harmonization with Attention-based Deep Feature Modulation2020

    • Author(s)
      Hao Guoqing, Satoshi Iizuka, Kazuhiro Fukui
    • Organizer
      The British Machine Vision Conference (BMVC)
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] DeepRemaster:Temporal Source-Reference Attentionを用いた動画のデジタルリマスター2020

    • Author(s)
      飯塚里志
    • Organizer
      Visual Computing 2020
    • Related Report
      2020 Research-status Report
    • Invited
  • [Presentation] Temporal Source-Reference Attentionを用いた動画のデジタルリマスター2020

    • Author(s)
      飯塚里志
    • Organizer
      FIT2020
    • Related Report
      2020 Research-status Report
    • Invited
  • [Presentation] Image Harmonization with Attention-based Foreground-background Feature Map Modulation2020

    • Author(s)
      Guoqing Hao, Satoshi Iizuka, Kazuhiro Fukui
    • Organizer
      MIRU2020
    • Related Report
      2020 Research-status Report
  • [Presentation] Controllable Artwork Synthesis via Two-stage Adversarial Networks2020

    • Author(s)
      Yuantian Huang, Satoshi Iizuka, Kazuhiro Fukui
    • Organizer
      MIRU2020
    • Related Report
      2020 Research-status Report
  • [Presentation] Spectral Normalization and Relativistic Adversarial Training for Conditional Pose Generation with Self-Attention2019

    • Author(s)
      Yusuke Horiuchi, Satoshi Iizuka, Edgar Simo-Serra, Hiroshi Isihikawa
    • Organizer
      International Conference on Machine Vision Applications (MVA)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] MLSNet: Resource-Efficient Adaptive Inference with Multi-Level Segmentation Networks2019

    • Author(s)
      Shuhei Yokoo, Satoshi Iizuka, Kazuhiro Fukui
    • Organizer
      IEEE International Conference on Image Processing (ICIP)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Optimization-Based Data Generation for Photo Enhancement2019

    • Author(s)
      Mayu Omiya, Yusuke Horiuchi, Edgar Simo-Serra, Satoshi Iizuka, Hiroshi Ishikawa
    • Organizer
      IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] MLSNet: Multi-Level Segmentation Networksによる リソース制約を考慮した適応的推定2019

    • Author(s)
      横尾修平, 飯塚里志, 福井和広
    • Organizer
      第22回 画像の認識・理解シンポジウム(MIRU2019)
    • Related Report
      2019 Research-status Report
  • [Presentation] ディープラーニングによる対話的な画像処理2018

    • Author(s)
      飯塚里志
    • Organizer
      パターン認識・メディア理解研究会(PRMU)
    • Related Report
      2018 Research-status Report
    • Invited
  • [Presentation] 深層学習と画像編集2018

    • Author(s)
      飯塚里志
    • Organizer
      可視化情報シンポジウム2018
    • Related Report
      2018 Research-status Report
    • Invited

URL: 

Published: 2018-04-23   Modified: 2023-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi