• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Deep Learning for Planetary Rover Localization

Research Project

Project/Area Number 20K14706
Research Category

Grant-in-Aid for Early-Career Scientists

Allocation TypeMulti-year Fund
Review Section Basic Section 20020:Robotics and intelligent system-related
Research InstitutionNational Astronomical Observatory of Japan

Principal Investigator

Wu Benjamin  国立天文台, アルマプロジェクト, 特別客員研究員 (50868718)

Project Period (FY) 2020-04-01 – 2025-03-31
Project Status Granted (Fiscal Year 2023)
Budget Amount *help
¥3,380,000 (Direct Cost: ¥2,600,000、Indirect Cost: ¥780,000)
Fiscal Year 2023: ¥520,000 (Direct Cost: ¥400,000、Indirect Cost: ¥120,000)
Fiscal Year 2022: ¥650,000 (Direct Cost: ¥500,000、Indirect Cost: ¥150,000)
Fiscal Year 2021: ¥520,000 (Direct Cost: ¥400,000、Indirect Cost: ¥120,000)
Fiscal Year 2020: ¥1,690,000 (Direct Cost: ¥1,300,000、Indirect Cost: ¥390,000)
Keywordsmachine learning / computer vision / deep learning / numerical simulation / orbital dynamics / astronomy / interferometry / space exploration / autonomous vehicles
Outline of Research at the Start

For planetary rovers, localization (determining the precise location) is a fundamental task for exploration and science. This project uses machine learning and computer vision to improve localization accuracy and autonomy over current methods.

Outline of Annual Research Achievements

We are continuing to apply machine learning to problems in space research and exploration and establish deep learning computational hardware capabilities at NAOJ.
In FY2023, scientists from NASA Ames initiated bi-weekly collaboration meetings regarding orbital debris remediation, largely based on techniques from our FY2022 paper "Low-thrust rendezvous trajectory generation for multi-target active space debris removal using the RQ-Law".
We also continued to develop the computer vision based methods for lunar rover absolute localization.

Current Status of Research Progress
Current Status of Research Progress

2: Research has progressed on the whole more than it was originally planned.

Reason

The original research topic of rover localization progressed slower than planned. However, this is due to several new research directions emerging, which have been very fruitful with multiple publications and collaborations.

Strategy for Future Research Activity

For rover localization, we are exploring the use of vision transformers compared to the previous ResNet baseline. Due high interest in our work on orbital dynamics, we have pursued research collaborations in this direction. We are extending this work by scaling up the number of debris objects that can be targeted for deorbit.

Report

(4 results)
  • 2023 Research-status Report
  • 2022 Research-status Report
  • 2021 Research-status Report
  • 2020 Research-status Report
  • Research Products

    (28 results)

All 2022 2021 2020 Other

All Int'l Joint Research (11 results) Journal Article (4 results) (of which Int'l Joint Research: 4 results,  Peer Reviewed: 4 results,  Open Access: 2 results) Presentation (4 results) (of which Int'l Joint Research: 1 results) Remarks (1 results) Patent(Industrial Property Rights) (8 results) (of which Overseas: 8 results)

  • [Int'l Joint Research] University of Toronto(カナダ)

    • Related Report
      2023 Research-status Report
  • [Int'l Joint Research] iSpace Europe/University of Luxembourg(ルクセンブルク)

    • Related Report
      2023 Research-status Report
  • [Int'l Joint Research] NASA Ames(米国)

    • Related Report
      2023 Research-status Report
  • [Int'l Joint Research] University of Toronto(カナダ)

    • Related Report
      2022 Research-status Report
  • [Int'l Joint Research] iSpace Europe/University of Luxembourg(ルクセンブルク)

    • Related Report
      2022 Research-status Report
  • [Int'l Joint Research] NVIDIA(米国)

    • Related Report
      2021 Research-status Report
  • [Int'l Joint Research] iSpace Europe/University of Luxembourg(ルクセンブルク)

    • Related Report
      2021 Research-status Report
  • [Int'l Joint Research] iSpace Europe/University of Luxembourg(ルクセンブルク)

    • Related Report
      2020 Research-status Report
  • [Int'l Joint Research] tensorlicious(ドイツ)

    • Related Report
      2020 Research-status Report
  • [Int'l Joint Research] Oxford University(英国)

    • Related Report
      2020 Research-status Report
  • [Int'l Joint Research] Brown University(米国)

    • Related Report
      2020 Research-status Report
  • [Journal Article] Physics Informed RNN-DCT Networks for Time-Dependent Partial Differential Equations2022

    • Author(s)
      Benjamin Wu, Oliver Hennigh, Jan Kautz, Sanjay Chaudhry, Wonmin Byeon
    • Journal Title

      International Conference on Computational Science Proceedings

      Volume: 1 Pages: 372-379

    • Related Report
      2022 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Low-thrust rendezvous trajectory generation for multi-target active space debris removal using the RQ-Law2022

    • Author(s)
      Sanjeev Narayanaswamy, Benjamin Wu, Philippe Ludivig, Frank Soboczenski, Karthik Venkataramani, & Christopher J. Damaren
    • Journal Title

      Advances in Space Research

      Volume: 12 Issue: 10 Pages: 49-49

    • DOI

      10.1016/j.asr.2022.12.049

    • Related Report
      2022 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Neural Interferometry: Image Reconstruction from Astronomical Interferometers using Transformer Conditioned Neural Fields2022

    • Author(s)
      Benjamin Wu, Chao Liu, Benjamin Eckart, Jan Kautz
    • Journal Title

      Association for the Advancement of Artificial Intelligence

      Volume: 1 Pages: 10158-10158

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Physics Informed RNN-DCT Networks for Time-Dependent Partial Differential Equations2021

    • Author(s)
      Benjamin Wu, Oliver Hennigh, Jan Kautz, Sanjay Chaudhry, Wonmin Byeon
    • Journal Title

      NeurIPS: Machine Learning and the Physical Sciences

      Volume: 1 Pages: 121-121

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Presentation] Physics Informed RNN-DCT Networks for Time-Dependent Partial Differential Equations2022

    • Author(s)
      Benjamin Wu, Oliver Hennigh, Jan Kautz, Sanjay Chaudhry, Wonmin Byeon
    • Organizer
      International Conference on Computational Science
    • Related Report
      2022 Research-status Report
  • [Presentation] Neural Interferometry: Image Reconstruction from Astronomical Interferometers using Transformer Conditioned Neural Fields2022

    • Author(s)
      Benjamin Wu, Chao Liu, Benjamin Eckart
    • Organizer
      AAAI-2022 (Association for the Advancement of Artificial Intelligence)
    • Related Report
      2021 Research-status Report
  • [Presentation] Physics Informed RNN-DCT Networks for Time-Dependent Partial Differential Equations2021

    • Author(s)
      Benjamin Wu
    • Organizer
      NeurIPS 2021 (Neural Information Processing Systems) Machine Learning and the Physical Sciences
    • Related Report
      2021 Research-status Report
  • [Presentation] Absolute Localization for Surface Robotics in GPS-denied Environments using a Neural Network2020

    • Author(s)
      Benjamin Wu, Philippe Ludivig, Ross W. K. Potter, Andrew S. Chung, Timothy Seabrook
    • Organizer
      International Symposium on Artificial Intelligence, Robotics and Automation in Space (i-SAIRAS) 2020
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Remarks] i-SAIRAS abstract

    • URL

      https://www.hou.usra.edu/meetings/isairas2020fullpapers/pdf/4032.pdf

    • Related Report
      2020 Research-status Report
  • [Patent(Industrial Property Rights)] Machine-learning techniques for constructing medical images2022

    • Inventor(s)
      Eckart, Kautz, Liu, Wu
    • Industrial Property Rights Holder
      NVIDIA Corp
    • Industrial Property Rights Type
      特許
    • Filing Date
      2022
    • Related Report
      2023 Research-status Report
    • Overseas
  • [Patent(Industrial Property Rights)] Machine-learning techniques for sparse-to-dense spectral reconstruction2022

    • Inventor(s)
      Eckart, Kautz, Liu, Wu
    • Industrial Property Rights Holder
      NVIDIA Corp
    • Industrial Property Rights Type
      特許
    • Filing Date
      2022
    • Related Report
      2023 Research-status Report
    • Overseas
  • [Patent(Industrial Property Rights)] Machine-learning techniques for representing items in a spectral domain2022

    • Inventor(s)
      Eckart, Kautz, Liu, Wu
    • Industrial Property Rights Holder
      NVIDIA Corp
    • Industrial Property Rights Type
      特許
    • Filing Date
      2022
    • Related Report
      2023 Research-status Report
    • Overseas
  • [Patent(Industrial Property Rights)] Performing simulations using machine learning2022

    • Inventor(s)
      Byeon, Wu, Hennigh
    • Industrial Property Rights Holder
      NVIDIA Corp
    • Industrial Property Rights Type
      特許
    • Filing Date
      2022
    • Related Report
      2023 Research-status Report
    • Overseas
  • [Patent(Industrial Property Rights)] MACHINE-LEARNING TECHNIQUES FOR CONSTRUCTING MEDICAL IMAGES2022

    • Inventor(s)
      B.Eckart, J.Kautz, C.Liu, B.Wu
    • Industrial Property Rights Holder
      B.Eckart, J.Kautz, C.Liu, B.Wu
    • Industrial Property Rights Type
      特許
    • Filing Date
      2022
    • Related Report
      2022 Research-status Report
    • Overseas
  • [Patent(Industrial Property Rights)] MACHINE-LEARNING TECHNIQUES FOR SPARSE-TO-DENSE SPECTRAL RECONSTRUCTION2022

    • Inventor(s)
      B.Eckart, J.Kautz, C.Liu, B.Wu
    • Industrial Property Rights Holder
      B.Eckart, J.Kautz, C.Liu, B.Wu
    • Industrial Property Rights Type
      特許
    • Filing Date
      2022
    • Related Report
      2022 Research-status Report
    • Overseas
  • [Patent(Industrial Property Rights)] MACHINE-LEARNING TECHNIQUES FOR REPRESENTING ITEMS IN A SPECTRAL DOMAIN2022

    • Inventor(s)
      B.Eckart, J.Kautz, C.Liu, B.Wu
    • Industrial Property Rights Holder
      B.Eckart, J.Kautz, C.Liu, B.Wu
    • Industrial Property Rights Type
      特許
    • Filing Date
      2022
    • Related Report
      2022 Research-status Report
    • Overseas
  • [Patent(Industrial Property Rights)] PERFORMING SIMULATIONS USING MACHINE LEARNING2022

    • Inventor(s)
      W.Byeon, B.Wu, O.Hennigh
    • Industrial Property Rights Holder
      W.Byeon, B.Wu, O.Hennigh
    • Industrial Property Rights Type
      特許
    • Filing Date
      2022
    • Related Report
      2022 Research-status Report
    • Overseas

URL: 

Published: 2020-04-28   Modified: 2024-12-25  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi