• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

3D Material Distribution Mapping by Acoustic Camera in Extreme Underwater Environment

Research Project

Project/Area Number 20K19898
Research Category

Grant-in-Aid for Early-Career Scientists

Allocation TypeMulti-year Fund
Review Section Basic Section 61050:Intelligent robotics-related
Research InstitutionJapan Advanced Institute of Science and Technology

Principal Investigator

JI YONGHOON  北陸先端科学技術大学院大学, 先端科学技術研究科, 准教授 (90823766)

Project Period (FY) 2020-04-01 – 2024-03-31
Project Status Completed (Fiscal Year 2023)
Budget Amount *help
¥4,160,000 (Direct Cost: ¥3,200,000、Indirect Cost: ¥960,000)
Fiscal Year 2022: ¥910,000 (Direct Cost: ¥700,000、Indirect Cost: ¥210,000)
Fiscal Year 2021: ¥780,000 (Direct Cost: ¥600,000、Indirect Cost: ¥180,000)
Fiscal Year 2020: ¥2,470,000 (Direct Cost: ¥1,900,000、Indirect Cost: ¥570,000)
Keywords音響カメラ / 水中ロボット / SLAM / 極限環境 / マテリアル分布
Outline of Research at the Start

本研究課題では,人間が直接入れない極限水中環境において無人水中ロボットに搭載した音響カメラを使用し,物質・材料に関する環境情報を反映したマップ生成システムを開発する.具体的には,環境中に存在するマテリアルの特性を音響カメラの計測情報より分析し,環境のマッピング処理における環境特徴量として活用することで,環境中に存在するマテリアルの情報を含む3次元形状情報(水中マテリアル分布マップ)を復元するシステムを提案する.生成された水中マテリアル分布マップは環境の状態を含む重要な資料となるため関連する意思決定機関へ提供されることを前提とし,後の減災,廃炉,復旧復興計画などに役立てられることを想定している.

Outline of Final Research Achievements

An acoustic camera which is mounted on an underwater robot can measure 3D space even in turbid water when exploring the underwater environment.
This study aims to establish a method to generate an underwater material distribution map that includes not only dense 3D shape information but also material information in the environment from the acoustic camera, in order to enable an intuitive understanding of the surrounding environment.
We implemented a system that generates an underwater material distribution map by establishing novel methodologies to recognize the materials of objects captured by an acoustic camera using semantic segmentation and generate a 3D map including the recognized material information.

Academic Significance and Societal Importance of the Research Achievements

新空港,港湾,海底トンネルの建設及び干拓事業などの水辺の開発はもちろん,福島第一原子力発電所の原子炉のような人間が入れない環境に対する調査活動での遠隔操作による水中ロボットの活用に注目が集まっている.本研究で実現した音響カメラの計測情報から周囲環境の密な3次元マテリアル分布マップを復元する技術は,周囲環境の直感的な認識が不可欠な無人水中ロボットの運用において極めて重要であり,提案技術の成果はさらに将来的にも水中探査や作業の自動化において大きな技術革新をもたらすと期待され,本研究の学術的な意義が大きい.

Report

(5 results)
  • 2023 Annual Research Report   Final Research Report ( PDF )
  • 2022 Research-status Report
  • 2021 Research-status Report
  • 2020 Research-status Report
  • Research Products

    (22 results)

All 2024 2023 2022 2021 2020 Other

All Journal Article (5 results) (of which Peer Reviewed: 5 results) Presentation (16 results) (of which Int'l Joint Research: 11 results) Remarks (1 results)

  • [Journal Article] Acoustic-N-Point for Solving 2D Forward Looking Sonar Pose Estimation2024

    • Author(s)
      Wang Yusheng、Ji Yonghoon、Tsuchiya Hiroshi、Ota Jun、Asama Hajime、Yamashita Atsushi
    • Journal Title

      IEEE Robotics and Automation Letters

      Volume: 9 Issue: 2 Pages: 1652-1659

    • DOI

      10.1109/lra.2024.3349968

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Acoustic Camera-Based Pose Graph SLAM for Dense 3-D Mapping in Underwater Environments2021

    • Author(s)
      Wang Yusheng、Ji Yonghoon、Woo Hanwool、Tamura Yusuke、Tsuchiya Hiroshi、Yamashita Atsushi、Asama Hajime
    • Journal Title

      IEEE Journal of Oceanic Engineering

      Volume: 46 Issue: 3 Pages: 829-847

    • DOI

      10.1109/joe.2020.3033036

    • Related Report
      2021 Research-status Report 2020 Research-status Report
    • Peer Reviewed
  • [Journal Article] CycleGAN-based realistic image dataset generation for forward-looking sonar2021

    • Author(s)
      Liu Dingyu、Wang Yusheng、Ji Yonghoon、Tsuchiya Hiroshi、Yamashita Atsushi、Asama Hajime
    • Journal Title

      Advanced Robotics

      Volume: 35 Issue: 3-4 Pages: 242-254

    • DOI

      10.1080/01691864.2021.1873845

    • Related Report
      2020 Research-status Report
    • Peer Reviewed
  • [Journal Article] Elevation Angle Estimation in 2D Acoustic Images Using Pseudo Front View2021

    • Author(s)
      Wang Yusheng、Ji Yonghoon、Liu Dingyu、Tsuchiya Hiroshi、Yamashita Atsushi、Asama Hajime
    • Journal Title

      IEEE Robotics and Automation Letters

      Volume: 6 Issue: 2 Pages: 1535-1542

    • DOI

      10.1109/lra.2021.3058911

    • Related Report
      2020 Research-status Report
    • Peer Reviewed
  • [Journal Article] ACMarker: Acoustic Camera-Based Fiducial Marker System in Underwater Environment2020

    • Author(s)
      Wang Yusheng、Ji Yonghoon、Liu Dingyu、Tamura Yusuke、Tsuchiya Hiroshi、Yamashita Atsushi、Asama Hajime
    • Journal Title

      IEEE Robotics and Automation Letters

      Volume: 5 Issue: 4 Pages: 5018-5025

    • DOI

      10.1109/lra.2020.3005375

    • Related Report
      2020 Research-status Report
    • Peer Reviewed
  • [Presentation] Motion Degeneracy in Self-supervised Learning of Elevation Angle Estimation for 2D Forward-Looking Sonar2023

    • Author(s)
      Yusheng Wang, Yonghoon Ji, Chujie Wu, Hiroshi Tsuchiya, Hajime Asama, Atsushi Yamashita
    • Organizer
      2023 IEEE/RSJ International Conference on Intelligent Robots and Systems
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 2D Forward Looking Sonar Simulation with Ground Echo Modeling2023

    • Author(s)
      Yusheng Wang, Chujie Wu, Yonghoon Ji, Hiroshi Tsuchiya, Hajime Asama, Atsushi Yamashita
    • Organizer
      20th International Conference on Ubiquitous Robots
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Acoustic Image Denoising Based on Generative Adversarial Network2023

    • Author(s)
      Shotaro Yamaguchi, Yonghoon Ji
    • Organizer
      20th International Conference on Ubiquitous Robots
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Underwater SLAM Based on Object Recognition Using YOLO in Acoustic Images2023

    • Author(s)
      Hiroki Nakamura, Takahiro Nonoda, Yonghoon Ji
    • Organizer
      16th International Conference on Quality Control by Artificial Vision
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Acoustic Camera Pose Refinement Using Differentiable Rendering2023

    • Author(s)
      Chujie Wu, Yusheng Wang, Yonghoon Ji, Hiroshi Tsuchiya, Hajime Asama, Atsushi Yamashita
    • Organizer
      2023 IEEE/SICE International Symposium on System Integration
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 水中音響カメラにおける入射角及び距離画像推定による材質認識2023

    • Author(s)
      野々田 崇大, 池 勇勳
    • Organizer
      第24回計測自動制御学会システムインテグレーション部門講演会
    • Related Report
      2023 Annual Research Report
  • [Presentation] 水中音響カメラにおける敵対的生成ネットワークに基づく画像ノイズの軽減2023

    • Author(s)
      山口 翔太郎, 野々田 崇大, 池 勇勳
    • Organizer
      ロボティクス・メカトロニクス講演会2023
    • Related Report
      2023 Annual Research Report
  • [Presentation] 水中環境における水中音響カメラを用いた船底の劣化検出2023

    • Author(s)
      野々田 崇大, 池 勇勳
    • Organizer
      ロボティクス・メカトロニクス講演会2023
    • Related Report
      2023 Annual Research Report
  • [Presentation] Learning Pseudo Front Depth for 2D Forward-Looking Sonar-based Multi-view Stereo2022

    • Author(s)
      Yusheng Wang, Yonghoon Ji, Hiroshi Tsuchiya, Hajime Asama, Atsushi Yamashita
    • Organizer
      2022 IEEE/RSJ International Conference on Intelligent Robots and Systems
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] 水中環境における音響カメラの録画映像処理による3次元環境復元2022

    • Author(s)
      中村 洋貴, 池 勇勳, 金田一 亮, 北村 嘉弘
    • Organizer
      第40回日本ロボット学会
    • Related Report
      2022 Research-status Report
  • [Presentation] Simulator-aided Edge-based Acoustic Camera Pose Estimation2022

    • Author(s)
      Wang Yusheng、Ji Yonghoon、Liu Dingyu、Tsuchiya Hiroshi、Yamashita Atsushi、Asama Hajime
    • Organizer
      OCEANS 2022 Chennai
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Elevation Angle Estimation in 2D Acoustic Images Using Pseudo Front View2021

    • Author(s)
      Wang Yusheng、Ji Yonghoon、Liu Dingyu、Tsuchiya Hiroshi、Yamashita Atsushi、Asama Hajime
    • Organizer
      2021 IEEE International Conference on Robotics and Automation
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Development of Image Simulator for Forward-looking Sonar Using 3D Rendering2021

    • Author(s)
      Liu Dingyu、Wang Yusheng、Ji Yonghoon、Tsuchiya Hiroshi、Yamashita Atsushi、Asama Hajime
    • Organizer
      15th International Conference on Quality Control by Artificial Vision
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] ACMarker: Acoustic Camera-Based Fiducial Marker System in Underwater Environment2020

    • Author(s)
      Wang Yusheng、Ji Yonghoon、Liu Dingyu、Tamura Yusuke、Tsuchiya Hiroshi、Yamashita Atsushi、Asama Hajime
    • Organizer
      2020 IEEE/RSJ International Conference on Intelligent Robots and Systems
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] Planar AnP: A Solution to Acoustic-n-Point Problem on Planar Target2020

    • Author(s)
      Wang Yusheng、Ji Yonghoon、Hanwool Woo、Tamura Yusuke、Tsuchiya Hiroshi、Yamashita Atsushi、Asama Hajime
    • Organizer
      Global OCEANS 2020
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] 音響カメラに基づいた水中環境における人工マーカシステムの開発2020

    • Author(s)
      Yusheng Wang、池 勇勳、劉 丁瑜、田村 雄介、土屋 洋、山下 淳、淺間 一
    • Organizer
      日本機械学会ロボティクス・メカトロニクス講演会2020
    • Related Report
      2020 Research-status Report
  • [Remarks] 北陸先端科学技術大学院大学 池研究室

    • URL

      http://robotics.jaist.ac.jp

    • Related Report
      2023 Annual Research Report 2022 Research-status Report 2021 Research-status Report 2020 Research-status Report

URL: 

Published: 2020-04-28   Modified: 2025-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi