• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Development of intelligent earth observation system based on incomplete data reconstruction and automatic selection of training samples

Research Project

Project/Area Number 18K18067
Research Category

Grant-in-Aid for Early-Career Scientists

Allocation TypeMulti-year Fund
Review Section Basic Section 61010:Perceptual information processing-related
Research InstitutionThe University of Tokyo (2020)
Institute of Physical and Chemical Research (2018-2019)

Principal Investigator

Yokoya Naoto  東京大学, 大学院新領域創成科学研究科, 講師 (40710728)

Project Period (FY) 2018-04-01 – 2021-03-31
Project Status Completed (Fiscal Year 2020)
Budget Amount *help
¥4,160,000 (Direct Cost: ¥3,200,000、Indirect Cost: ¥960,000)
Fiscal Year 2020: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2019: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Fiscal Year 2018: ¥1,690,000 (Direct Cost: ¥1,300,000、Indirect Cost: ¥390,000)
Keywordsデータ融合 / 画像合成 / 3次元変化検出 / 災害状況把握 / 画像融合 / 建物被害分類 / 3次元変化検出 / 不完全データ復元 / 画像修復 / 低ランクテンソル解析 / 変化検出 / 物質・含有率分解 / 画像変換 / マルチモーダルデータ融合 / 地球観測 / 機械学習 / パターン認識 / 画像処理 / 人工知能
Outline of Final Research Achievements

We developed methods for image reconstruction and image recognition that overcomes data incompleteness by complementarily utilizing the strengths of heterogeneous sensors in Earth observation. We also studied how to efficiently collect and generate training data from auxiliary data such as ground-shot images and simulation data. We applied our methods to disaster damage assessment, where data incompleteness and lack of training data are serious problems, and realized all-weather change detection using heterogeneous images from two different time periods and rapid estimation of 3D change of the ground surface, which were difficult with conventional techniques.

Academic Significance and Societal Importance of the Research Achievements

本研究では,異なるセンサから得られる地球観測データを用いた変化検出を可能としたことと,教示データの収集が困難な3次元変化の高速推定を実現したことに大きな意義がある.これらの成果により,観測データの異種性や教示データの不足がボトルネットとなっていた災害状況把握において,浸水深や土石流による地形変化,建物の被害状況など,災害対応分野で必要とされる災害情報を迅速に提供することが可能となったことが最大の成果である.

Report

(4 results)
  • 2020 Annual Research Report   Final Research Report ( PDF )
  • 2019 Research-status Report
  • 2018 Research-status Report
  • Research Products

    (27 results)

All 2021 2020 2019 2018 Other

All Int'l Joint Research (4 results) Journal Article (16 results) (of which Int'l Joint Research: 13 results,  Peer Reviewed: 16 results,  Open Access: 7 results) Presentation (7 results) (of which Int'l Joint Research: 7 results)

  • [Int'l Joint Research] ドイツ航空宇宙センター/ミュンヘン工科大学(ドイツ)

    • Related Report
      2020 Annual Research Report
  • [Int'l Joint Research] ドイツ航空宇宙センター/ミュンヘン工科大学(ドイツ)

    • Related Report
      2019 Research-status Report
  • [Int'l Joint Research] 電子科技大学(中国)

    • Related Report
      2019 Research-status Report
  • [Int'l Joint Research] ドイツ航空宇宙センター/ミュンヘン工科大学(ドイツ)

    • Related Report
      2018 Research-status Report
  • [Journal Article] Synthesizing optical and SAR imagery from land cover maps and auxiliary raster data2021

    • Author(s)
      G. Baier, A. Deschemps, M. Schmitt, and N. Yokoya
    • Journal Title

      IEEE Transactions on Geoscience and Remote Sensing

      Volume: early access Pages: 1-12

    • DOI

      10.1109/tgrs.2021.3068532

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Global land cover mapping with weak supervision: Outcome of the 2020 IEEE GRSS Data Fusion Contest2021

    • Author(s)
      C. Robinson, K. Malkin, N. Jojic, H. Chen, R. Qin, C. Xiao, M. Schmitt, P. Ghamisi, R. Haensch, and N. Yokoya
    • Journal Title

      IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing

      Volume: 14 Pages: 3185-3199

    • DOI

      10.1109/jstars.2021.3063849

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Learning from multimodal and multitemporal earth observation data for building damage mapping2021

    • Author(s)
      Adriano Bruno、Yokoya Naoto、Xia Junshi、Miura Hiroyuki、Liu Wen、Matsuoka Masashi、Koshimura Shunichi
    • Journal Title

      ISPRS Journal of Photogrammetry and Remote Sensing

      Volume: 175 Pages: 132-143

    • DOI

      10.1016/j.isprsjprs.2021.02.016

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Breaking Limits of Remote Sensing by Deep Learning From Simulated Data for Flood and Debris-Flow Mapping2020

    • Author(s)
      Yokoya Naoto、Yamanoi Kazuki、He Wei、Baier Gerald、Adriano Bruno、Miura Hiroyuki、Oishi Satoru
    • Journal Title

      IEEE Transactions on Geoscience and Remote Sensing

      Volume: - Pages: 1-15

    • DOI

      10.1109/tgrs.2020.3035469

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Non-local Meets Global: An Integrated Paradigm for Hyperspectral Image Restoration2020

    • Author(s)
      He Wei、Yao Quanming、Li Chao、Yokoya Naoto、Zhao Qibin、Zhang Hongyan、Zhang Liangpei
    • Journal Title

      IEEE Transactions on Pattern Analysis and Machine Intelligence

      Volume: 1 Pages: 1-1

    • DOI

      10.1109/tpami.2020.3027563

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Illumination invariant hyperspectral image unmixing based on a digital surface model2020

    • Author(s)
      T. Uezato, N. Yokoya, and W. He
    • Journal Title

      IEEE Transactions on Image Processing

      Volume: 29 Pages: 3652-3664

    • DOI

      10.1109/tip.2020.2963961

    • Related Report
      2019 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Robust nonlocal low-rank SAR time series despeckling considering speckle correlation by total variation regularization2020

    • Author(s)
      G. Baier, W. He, and N. Yokoya
    • Journal Title

      IEEE Transactions on Geoscience and Remote Sensing

      Volume: Early Access Issue: 11 Pages: 1-13

    • DOI

      10.1109/tgrs.2020.2985400

    • Related Report
      2019 Research-status Report
    • Peer Reviewed
  • [Journal Article] Remote sensing image reconstruction using tensor ring completion and total-variation2019

    • Author(s)
      W. He, N. Yokoya, L. Yuan, and Q. Zhao
    • Journal Title

      IEEE Transactions on Geoscience and Remote Sensing

      Volume: 57 Issue: 11 Pages: 8998-9009

    • DOI

      10.1109/tgrs.2019.2924017

    • Related Report
      2019 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Hyperspectral image restoration using weighted group sparsity regularized low-rank tensor decomposition2019

    • Author(s)
      Y. Chen, W. He, N. Yokoya, and T.-Z. Huang
    • Journal Title

      IEEE Transactions on Cybernetics

      Volume: Early Access Issue: 8 Pages: 1-13

    • DOI

      10.1109/tcyb.2019.2936042

    • Related Report
      2019 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Blind cloud and cloud shadow removal of multitemporal images based on total variation regularized low-rank sparsity decomposition2019

    • Author(s)
      Y. Chen, W. He, N. Yokoya, and T.-Z. Huang
    • Journal Title

      ISPRS Journal of Photogrammetry and Remote Sensing

      Volume: 157 Pages: 93-107

    • DOI

      10.1016/j.isprsjprs.2019.09.003

    • Related Report
      2019 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Non-local tensor ring decomposition for hyperspectral image denoising2019

    • Author(s)
      Y. Chen, W. He, N. Yokoya, and T.-Z. Huang
    • Journal Title

      IEEE Transactions on Geoscience and Remote Sensing

      Volume: 58 Issue: 2 Pages: 1348-1362

    • DOI

      10.1109/tgrs.2019.2946050

    • Related Report
      2019 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Multi-Source Data Fusion Based on Ensemble Learning for Rapid Building Damage Mapping during the 2018 Sulawesi Earthquake and Tsunami in Palu, Indonesia2019

    • Author(s)
      Adriano Bruno、Xia Junshi、Baier Gerald、Yokoya Naoto、Koshimura Shunichi
    • Journal Title

      Remote Sensing

      Volume: 11 Issue: 7 Pages: 886-886

    • DOI

      10.3390/rs11070886

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Multisource and Multitemporal Data Fusion in Remote Sensing: A Comprehensive Review of the State of the Art2019

    • Author(s)
      Ghamisi Pedram、Rasti Behnood、Yokoya Naoto、Wang Qunming、Hofle Bernhard、Bruzzone Lorenzo、Bovolo Francesca、Chi Mingmin、Anders Katharina、Gloaguen Richard、Atkinson Peter M.、Benediktsson Jon Atli
    • Journal Title

      IEEE Geoscience and Remote Sensing Magazine

      Volume: 7 Issue: 1 Pages: 6-39

    • DOI

      10.1109/mgrs.2018.2890023

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] CoSpace: Common Subspace Learning From Hyperspectral-Multispectral Correspondences2019

    • Author(s)
      Hong Danfeng、Yokoya Naoto、Chanussot Jocelyn、Zhu Xiao Xiang
    • Journal Title

      IEEE Transactions on Geoscience and Remote Sensing

      Volume: Early Access Issue: 7 Pages: 1-11

    • DOI

      10.1109/tgrs.2018.2890705

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Learnable manifold alignment (LeMA): A semi-supervised cross-modality learning framework for land cover and land use classification2019

    • Author(s)
      Hong Danfeng、Yokoya Naoto、Ge Nan、Chanussot Jocelyn、Zhu Xiao Xiang
    • Journal Title

      ISPRS Journal of Photogrammetry and Remote Sensing

      Volume: 147 Pages: 193-205

    • DOI

      10.1016/j.isprsjprs.2018.10.006

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Multi-Temporal Sentinel-1 and -2 Data Fusion for Optical Image Simulation2018

    • Author(s)
      He Wei、Yokoya Naoto
    • Journal Title

      ISPRS International Journal of Geo-Information

      Volume: 7 Issue: 10 Pages: 389-389

    • DOI

      10.3390/ijgi7100389

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Open Access
  • [Presentation] Guided deep decoder: Unsupervised image pair fusion2020

    • Author(s)
      T. Uezato, D. Hong, N. Yokoya, and W. He
    • Organizer
      European Conference on Computer Vision
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Non-local meets global: An integrated paradigm for hyperspectral denoising2019

    • Author(s)
      W. He, Q. Yao, C. Li, N. Yokoya, and Q. Zhao
    • Organizer
      Conference on Computer Vision and Pattern Recognition (CVPR)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Cross-domain-classification of tsunami damage via data simulation and residual-network-derived features from multi-source images2019

    • Author(s)
      B. Adriano, N. Yokoya, J. Xia, G. Baier, and S. Koshimura
    • Organizer
      IEEE International Geoscience and Remote Sensing Symposium
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Non-local meets global: An integrated paradigm for hyperspectral denoising2019

    • Author(s)
      W. He, Q. Yao, C. Li, N. Yokoya, and Q. Zhao
    • Organizer
      CVPR 2019
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Total-variation-regularized tensor ring completion for remote sensing image reconstruction2019

    • Author(s)
      W. He, L. Yuan, and N. Yokoya
    • Organizer
      ICASSP 2019
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Land cover mapping without human annotation2019

    • Author(s)
      Tatsuya Yamada, Naoto Yokoya, Takeo Tadono, Akira Iwasaki
    • Organizer
      IGARSS 2019
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Total variation regularized low-rank sparsity decomposition for blind cloud and cloud shadow removal from multitemporal imagery2019

    • Author(s)
      Yong Chen, Wei He, Naoto Yokoya, Ting-Zhu Huang
    • Organizer
      IGARSS 2019
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research

URL: 

Published: 2018-04-23   Modified: 2022-01-27  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi