• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Realization of robust SLAM in non-artificial environment based on feature extraction function of deep learning

Research Project

Project/Area Number 17K06485
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Research Field Control engineering/System engineering
Research InstitutionHokkaido University

Principal Investigator

EMARU TAKANORI  北海道大学, 工学研究院, 准教授 (30440952)

Project Period (FY) 2017-04-01 – 2020-03-31
Project Status Completed (Fiscal Year 2019)
Budget Amount *help
¥4,550,000 (Direct Cost: ¥3,500,000、Indirect Cost: ¥1,050,000)
Fiscal Year 2019: ¥780,000 (Direct Cost: ¥600,000、Indirect Cost: ¥180,000)
Fiscal Year 2018: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2017: ¥2,730,000 (Direct Cost: ¥2,100,000、Indirect Cost: ¥630,000)
KeywordsSLAM / 知能ロボティックス / 深層学習
Outline of Final Research Achievements

The purpose of this research project is to realize robust SLAM using feature points which are automatically extracted by deep learning in order to perform highly accurate self-localization in a non-artificial environment represented by agriculture and forestry fields. The main research results are as follows: 1) To identify weeds and crops, we proposed a multi-modal deep learning system that utilizes temperature information in addition to RGB and Depth. 2) We proposed image processing algorithm to efficiently acquire a large amount of data used for deep learning. 3) In order to realize a system that can autonomously drive at low cost in the agriculture field, we constructed a system that recognizes the environment using an inexpensive Depth sensor and verified the effectiveness by simulation and actual machine experiments.

Academic Significance and Societal Importance of the Research Achievements

これまでSLAMに関する研究は屋内・屋外人工環境で行われており,農林業環境に代表される非人工環境下でロバストに実現することは未だ行われていないため学術的・社会的にも非常に意義のある研究である。本研究を遂行する上で重要な要素技術となっている作物・樹木の3次元座標獲得および特徴点抽出は,ロバストなSLAMを実現すると同時に除草・収穫作業を効率的に行うための重要な情報となり,高機能農林業機械開発の中核的な技術となり得る。また個々の作物・樹木の情報を含むロバストな地図情報は,センサネットワークやビックデータ解析と組み合わせることにより飛躍的に情報の質を向上させ,同時に生産性の大幅な向上が期待できる。

Report

(4 results)
  • 2019 Annual Research Report   Final Research Report ( PDF )
  • 2018 Research-status Report
  • 2017 Research-status Report
  • Research Products

    (56 results)

All 2020 2019 2018 2017

All Journal Article (4 results) (of which Peer Reviewed: 3 results) Presentation (52 results) (of which Int'l Joint Research: 16 results)

  • [Journal Article] A Novel Approach for Lidar-Based Robot Localization in a Scale-Drifted Map Constructed Using Monocular SLAM2019

    • Author(s)
      Su Wang, Yukinori Kobayashi, Ankit A. Ravankar, Abhijeet Ravankar, Takanori Emaru
    • Journal Title

      Sensors

      Volume: 19(10) Issue: 10 Pages: 2230-2230

    • DOI

      10.3390/s19102230

    • Related Report
      2019 Annual Research Report
  • [Journal Article] Bio-Inspired Structure and Behavior of Self-Recovery Quadruped Robot with a Limited Number of Functional Legs2019

    • Author(s)
      Sarun Chattunyakit, Yukinori Kobayashi, Takanori Emaru, and Ankit A. Ravankar
    • Journal Title

      Applied Sciences

      Volume: 9(4) Issue: 4 Pages: 799-799

    • DOI

      10.3390/app9040799

    • NAID

      120006606593

    • Related Report
      2018 Research-status Report
    • Peer Reviewed
  • [Journal Article] Hitchhiking Robots: A Collaborative Approach for Efficient Multi-Robot Navigation in Indoor Environments2017

    • Author(s)
      Abhijeet Ravankar, Ankit A Ravankar, Yukinori Kobayashi, Takanori Emaru
    • Journal Title

      Sensors

      Volume: 17(8) Issue: 8 Pages: 1878-1878

    • DOI

      10.3390/s17081878

    • NAID

      120006352228

    • Related Report
      2017 Research-status Report
    • Peer Reviewed
  • [Journal Article] Symbiotic Navigation in Multi-Robot Systems with Remote Obstacle Knowledge Sharing2017

    • Author(s)
      Abhijeet Ravankar, Ankit A Ravankar, Yukinori Kobayashi, Takanori Emaru
    • Journal Title

      Sensors

      Volume: 17(7) Issue: 7 Pages: 1581-1581

    • DOI

      10.3390/s17071581

    • NAID

      120006352229

    • Related Report
      2017 Research-status Report
    • Peer Reviewed
  • [Presentation] ピンポイント除草作業を実現するロボットマニピュレータ制御2020

    • Author(s)
      木下拓,江丸貴紀, ラワンカルアンキット
    • Organizer
      第11回北海道ロボット技術研究専門委員会学術講演会
    • Related Report
      2019 Annual Research Report
  • [Presentation] RGB-D とLiDAR センサーを用いた動的環境のEKF-SLAM2020

    • Author(s)
      Beomsoo Han,ラワンカルアンキット,江丸貴紀,小林幸徳
    • Organizer
      第11回北海道ロボット技術研究専門委員会学術講演会
    • Related Report
      2019 Annual Research Report
  • [Presentation] 実環境における3DLIDAR を用いたUAV による防波堤点検システム2020

    • Author(s)
      岡野裕大,江丸貴紀,ラワンカルアンキット
    • Organizer
      第11回北海道ロボット技術研究専門委員会学術講演会
    • Related Report
      2019 Annual Research Report
  • [Presentation] 樹木胸高直径(DBH)推定のためのStereo カメラによるドローン観測およびモバイルステレオスキャンの提案2020

    • Author(s)
      トライラッタナパー ヴィサルット,江丸貴紀,ラワンカルアンキット
    • Organizer
      第11回北海道ロボット技術研究専門委員会学術講演会
    • Related Report
      2019 Annual Research Report
  • [Presentation] Multi-modal Vibration Control of a Double Shell Railway Car-Body Model using Passive Piezo-electric Shunt Circuit2019

    • Author(s)
      Silabhadra Das, Ashish Gupta, Yukinori Kobayashi, Takanori Emaru and Ankit Ravankar
    • Organizer
      12th Asian Control Conference (ASCC)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Cooperative Multi-robot Map Merging with Task Dstribution2019

    • Author(s)
      Ankit Ravankar, Abhijeet Ravankar, Yukinori Kobayashi, Takanori Emaru
    • Organizer
      ロボティクス・メカトロニクス 講演会 2019
    • Related Report
      2019 Annual Research Report
  • [Presentation] Autonomous Navigation of Ground Robot for Vineyard Monitoring2019

    • Author(s)
      Ankit Ravankar, Abhijeet Ravankar, Yukinori Kobayashi, Takanori Emaru
    • Organizer
      ロボティクス・メカトロニクス 講演会 2019
    • Related Report
      2019 Annual Research Report
  • [Presentation] Semi- active vibration control of a double shell railway car-bodymodel using bonded Piezo-electric Patch Configuration and anintegrated shunt circuit2019

    • Author(s)
      Das Silabhadra, Gupta Ashish, Kobayashi Yukinori, Yamamoto Katsuya, Takigami Tadao, Asahina Mineyuki, Emaru Takanori, Ravankar Ankit
    • Organizer
      第62回自動制御連合講演会
    • Related Report
      2019 Annual Research Report
  • [Presentation] 圃場における自律走行を目的としたRGB-Dセンサによる畝のロバストな認識法および制御系の提案2019

    • Author(s)
      藤田隼輔,小林幸徳,江丸貴紀,RAVANKAR Ankit
    • Organizer
      第62回自動制御連合講演会
    • Related Report
      2019 Annual Research Report
  • [Presentation] オムニホイール移動ロボットの斜面における追従性能向上手法の提案2019

    • Author(s)
      山田涼裕,小林幸徳,江丸貴紀,RAVANKAR Ankit
    • Organizer
      第62回自動制御連合講演会
    • Related Report
      2019 Annual Research Report
  • [Presentation] 原木材計測への深層学習の応用2019

    • Author(s)
      森井隆禎,江丸貴紀,小林幸徳,Ankit Ravankar
    • Organizer
      第20回計測自動制御学会システムインテグレーション部門講演会(SI2019)
    • Related Report
      2019 Annual Research Report
  • [Presentation] 独立型一体内装構造を有する鉄道車体モデルの振動音響解析2019

    • Author(s)
      小野俊太郎, 小林幸徳, 山本克也, 朝比奈峰之, 江丸貴紀, ラワンカルアンキット
    • Organizer
      第28回交通・物流部門大会(TRANSLOG2019)
    • Related Report
      2019 Annual Research Report
  • [Presentation] A Semi-Active Multi-Modal Vibration Damping Technique to Study the Impact of Vertical Flexural Vibration Damping of a Railway Carbody Floor on Ride Comfort2019

    • Author(s)
      Silabhadra Das, Yukinori Kobayashi, Takanori Emaru and Ankit Ravankar
    • Organizer
      12th World Conference on Railway Research (WCRR 2019)
    • Related Report
      2019 Annual Research Report
  • [Presentation] 林業フィールドにおける自己位置推定を目的としたシステムの構築2019

    • Author(s)
      長井一弘,江丸貴紀,Ankit Ravankar,小林幸徳
    • Organizer
      第31回自律分散システム・シンポジウム
    • Related Report
      2018 Research-status Report
  • [Presentation] Development of robust SLAM in forest environment Application of LiDAR SLAM in tree identification2019

    • Author(s)
      リホウショウ,江丸貴紀,Ankit Ravankar,小林幸徳
    • Organizer
      第31回自律分散システム・シンポジウム
    • Related Report
      2018 Research-status Report
  • [Presentation] UAVを用いた防波堤点検システムの構築2019

    • Author(s)
      上野貴希,江丸貴紀,ラワンカルアンキット,小林幸
    • Organizer
      第51回計測自動制御学会北海道支部学術講演会
    • Related Report
      2018 Research-status Report
  • [Presentation] 最近防探索によるLiDAR点群の降雪ノイズ除去2019

    • Author(s)
      佐々木祐太,ラワンカルアンキット,江丸貴紀,小林幸徳
    • Organizer
      第51回計測自動制御学会北海道支部学術講演会
    • Related Report
      2018 Research-status Report
  • [Presentation] 雪道環境における自動運転技術のための3次元LiDARを用いた点群処理に基づく雪山検出2019

    • Author(s)
      小渕雅弘,小林幸徳,江丸貴紀,ラワンカルアンキット
    • Organizer
      第51回計測自動制御学会北海道支部学術講演会
    • Related Report
      2018 Research-status Report
  • [Presentation] サーモカメラと3D LiDARのセンサフュージョンによる雪道における轍幅の推定2019

    • Author(s)
      長谷川智彦,小林幸徳,江丸貴紀,ラワンカルアンキット
    • Organizer
      第51回計測自動制御学会北海道支部学術講演会
    • Related Report
      2018 Research-status Report
  • [Presentation] Development of Port Facilities Inspection Robot Using Multi-copter2018

    • Author(s)
      Takaki Ueno, Masaru Sakuma, Seiko Piotr Yamaguchi, Yukinori Kobayashi, Takanori Emaru, Ankit Ravankar
    • Organizer
      第36回日本ロボット学会学術講演会(RSJ2018)
    • Related Report
      2018 Research-status Report
  • [Presentation] Road Detection in Snowy Forest Environment using RGB Camera2018

    • Author(s)
      Sirawich Vachmanus, Takanori Emaru, Ankit Ravankar, Yukinori Kobayashi
    • Organizer
      第36回日本ロボット学会学術講演会(RSJ2018)
    • Related Report
      2018 Research-status Report
  • [Presentation] Applying Semantic Segmentation to Autonomous Cars in the Snowy Environment2018

    • Author(s)
      Zhaoyu Pan, Takanori Emaru, Ankit Ravankar, Yukinori Kobayashi
    • Organizer
      第36回日本ロボット学会学術講演会(RSJ2018)
    • Related Report
      2018 Research-status Report
  • [Presentation] 構体と内装の二重シェル構造を有する鉄道車体モデルの音響解析2018

    • Author(s)
      小野 俊太郎,小林 幸徳,山本 克也,ゴータムアビシェク,江丸 貴紀,ラワンカルアンキット
    • Organizer
      Dynamics and Design Conference 2018
    • Related Report
      2018 Research-status Report
  • [Presentation] Aerial Robot Model based design and verification of the single and multi-agent inspection application development2018

    • Author(s)
      Seiko P. Yamaguchi, Masaru Sakuma, Takaki Ueno, Filip Karolonek, Tadeusz Uhl, Ankit A. Ravankar, Takanori Emaru, Yukinori Kobayashi
    • Organizer
      The 14th International Conference on Motion and Vibration (MOVIC2018)
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Bending Vibration Suppression of a Single Shell Structure for Railway Car body Using Piezoelectric Elements2018

    • Author(s)
      Ashish Gupta, Y. Kobayashi, T. Emaru, A. Ravankar
    • Organizer
      The 14th International Conference on Motion and Vibration (MOVIC2018)
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Semantic Navigation for Indoor Service Robots2018

    • Author(s)
      Ankit A. Ravankar Abhijeet Ravankar, Yukinori Kobayashi, Takanori Emaru
    • Organizer
      2018 JSME Conference on Robotics and Mechatronics (ROBOMECH 2018)
    • Related Report
      2018 Research-status Report
  • [Presentation] Real-time path smoothning for mobile robots in 2D and 3D environments2018

    • Author(s)
      Abhijeet Ravankar, Ankit A. Ravankar, Yukinori Kobayashi, Takanori Emaru
    • Organizer
      2018 JSME Conference on Robotics and Mechatronics (ROBOMECH 2018)
    • Related Report
      2018 Research-status Report
  • [Presentation] Task coordination for Multiple Mobile Robots considering Semantic and Topological Information2018

    • Author(s)
      Ankit A. Ravankar, Abhijeet Ravankar, Chao-Chung Peng, Yukinori Kobayashi, Takanori Emaru
    • Organizer
      2018 International Conference on Applied System Innovation (ICASI)
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Real-Time Multi-Robot Path Planning Revisited as a Caching Problem2018

    • Author(s)
      Abhijeet Ravankar, Ankit A. Ravankar, Chao-Chung Peng, Yukinori Kobayashi, Takanori Emaru
    • Organizer
      2018 International Conference on Applied System Innovation (ICASI)
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] 障害物とロボットの最小旋回半径を考慮したCoverage Pathの最適化2018

    • Author(s)
      小保内 弘毅,江丸貴紀,Ankit RAVANKAR,小林幸徳
    • Organizer
      第61回自動制御連合講演会
    • Related Report
      2018 Research-status Report
  • [Presentation] 深層学習を用いた農作物の自動検出における教師データ画像の加工2018

    • Author(s)
      影山藍,江丸貴紀,Ankit Ravankar,小林幸徳
    • Organizer
      第61回自動制御連合講演会
    • Related Report
      2018 Research-status Report
  • [Presentation] 特徴点が疎な積雪環境における地図作成およびナビゲーションシステムの開発2018

    • Author(s)
      朱承儒,江丸貴紀,Ravankar Ankit,小林幸徳
    • Organizer
      第19回計測自動制御学会システムインテグレーション部門講演会
    • Related Report
      2018 Research-status Report
  • [Presentation] 作物検出を目的とした深層学習のためのデータセット自動作成2018

    • Author(s)
      金智姫,江丸貴紀,Ravankar Ankit,小林幸徳
    • Organizer
      第19回計測自動制御学会システムインテグレーション部門講演会
    • Related Report
      2018 Research-status Report
  • [Presentation] Autonomous Mobile Robot Mapping and Navigation using Topological and Semantic Information2018

    • Author(s)
      Ankit A. Ravankar, Abhijeet Ravankar, Yukinori Kobayashi, Takanori Emaru
    • Organizer
      23rd International Symposium on Artificial Life and Robotics (ISAROB)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] 斜面におけるオムニホイールロボットの自己位置および斜面勾配の推定2018

    • Author(s)
      山田涼裕,小林幸徳,江丸貴紀,ラワンカルアンキット
    • Organizer
      第10回北海道ロボット技術研究専門委員会学術講演会
    • Related Report
      2017 Research-status Report
  • [Presentation] メタヒューリスティクスを用いたUAVの経路の最適化2018

    • Author(s)
      山内統広,小林幸徳,江丸貴紀,ラワンカルアンキット
    • Organizer
      第10回北海道ロボット技術研究専門委員会学術講演会
    • Related Report
      2017 Research-status Report
  • [Presentation] 深層学習とHough変換の応用による原木材計測システム2018

    • Author(s)
      森井隆禎,小林幸徳,江丸貴紀,ラワンカルアンキット
    • Organizer
      第10回北海道ロボット技術研究専門委員会学術講演会
    • Related Report
      2017 Research-status Report
  • [Presentation] 森林管理用4輪駆動ロボットの開発と運動解析2018

    • Author(s)
      藤田隼輔,小林幸徳,江丸貴紀,ラワンカルアンキット
    • Organizer
      第10回北海道ロボット技術研究専門委員会学術講演会
    • Related Report
      2017 Research-status Report
  • [Presentation] Optimal Robot Path Selection Using Fuzzy Analytical Hierarchical Process2017

    • Author(s)
      Abhijeet Ravankar, Ankit A. Ravankar, Yukinori Kobayashi, Takanori Emaru
    • Organizer
      4th International Electronic Conference on Sensors and Applications
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Can Robots Help Each Other To Plan Optimal Paths in Dynamic Maps?2017

    • Author(s)
      Abhijeet Ravankar, Ankit A. Ravankar, Yukinori Kobayashi, Takanori Emaru
    • Organizer
      56th Annual Conference of the Society of Instrument and Control Engineers of Japan (SICE)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] A Hybrid Topological Mapping and Navigation Method for Large Area Robot Mapping2017

    • Author(s)
      Ankit A. Ravankar, Abhijeet Ravankar, Yukinori Kobayashi, Takanori Emaru
    • Organizer
      56th Annual Conference of the Society of Instrument and Control Engineers of Japan (SICE)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Surveillance Mobile Robot System for Tracking and Inspection of Suspicious Entities in Indoor and Outdoor Spaces2017

    • Author(s)
      Abhijeet Ravankar, Ankit A. Ravankar, Yukinori Kobayashi and Takanori Emaru
    • Organizer
      The 7th East Asia Mechanical and Aerospace Engineering Workshop (EAMAE)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Large Scale Mapping using Semantic and Topological Information for Autonomous Mobile Robot Navigation2017

    • Author(s)
      Ankit A. Ravankar, Abhijeet Ravankar, Yukinori Kobayashi, Takanori Emaru
    • Organizer
      The 7th East Asia Mechanical and Aerospace Engineering Workshop (EAMAE)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Vision Based Autonomous Docking of VTOL UAV using a Mobile Robot Manipulator2017

    • Author(s)
      Eduardo Narvaez, Ankit A. Ravankar, Abhijeet Ravankar, Yukinori Kobayashi, Takanori Emaru
    • Organizer
      The 7th East Asia Mechanical and Aerospace Engineering Workshop (EAMAE)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] UAV Pose Estimation Using IR and RGB Cameras2017

    • Author(s)
      Su Wang, Abhijeet Ravankar, Ankit Ravankar, Yukinori Kobayashi, Takanori Emaru
    • Organizer
      The 7th East Asia Mechanical and Aerospace Engineering Workshop (EAMAE)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] UAV Pose Estimation Using IR and RGB Cameras2017

    • Author(s)
      Su Wang, Abhijeet Ravankar, Ankit Ravankar, Yukinori Kobayashi, Takanori Emaru
    • Organizer
      2017 IEEE/SICE International Symposium on System Integration (SII)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Autonomous Position Control of Multi-Unmanned Aerial Vehicle Network Designed for Long Range Wireless Data Transmission2017

    • Author(s)
      Seiko Piotr Yamaguchi, Filip Karolonek, Takanori Emaru, Yukinori Kobayashi, Tadeusz Uhl
    • Organizer
      2017 IEEE/SICE International Symposium on System Integration (SII)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Vision Based Autonomous Docking of VTOL UAV using a Mobile Robot Manipulator2017

    • Author(s)
      Eduardo Narvaez, Ankit A. Ravankar, Abhijeet Ravankar, Yukinori Kobayashi, Takanori Emaru
    • Organizer
      2017 IEEE/SICE International Symposium on System Integration (SII)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Low-cost Mobile Platform for ROS2017

    • Author(s)
      Ankit A. Ravankar, Abhijeet Ravankar, Takanori Emaru and Yukinori Kobayashi
    • Organizer
      2017 JSME Conference on Robotics and Mechatronics, ROBOMECH 2017
    • Related Report
      2017 Research-status Report
  • [Presentation] Inter-Robot Learning in Multi-Robot System2017

    • Author(s)
      Abhijeet Ravankar, Ankit A. Ravankar, Yukinori Kobayashi and Takanori Emaru
    • Organizer
      2017 JSME Conference on Robotics and Mechatronics, ROBOMECH 2017
    • Related Report
      2017 Research-status Report
  • [Presentation] Path Planning and Motion Generation in Frame Structure for a Limb-Type Robot using A* Algorithm2017

    • Author(s)
      Shuhei Yoshida, Yukinori Kobayashi, Takanori Emaru
    • Organizer
      2017 JSME Conference on Robotics and Mechatronics, ROBOMECH 2017
    • Related Report
      2017 Research-status Report
  • [Presentation] 車輪状に変形可能なLimb型ロボットの転がり移動2017

    • Author(s)
      鳥居聖生,吉田州平,小林幸徳,江丸貴紀,Ravankar Ankit
    • Organizer
      第18回計測自動制御学会システムインテグレーション部門講演会
    • Related Report
      2017 Research-status Report

URL: 

Published: 2017-04-28   Modified: 2021-02-19  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi