2023 Fiscal Year Research-status Report
Development of Smart Viticulture System Using Autonomous Robots
| Project/Area Number |
21K14117
|
|---|
| Research Institution | Kitami Institute of Technology |
|---|
Principal Investigator |
ラワンカル アビジート 北見工業大学, 工学部, 准教授 (70802594)
|
|---|
| Project Period (FY) |
2021-04-01 – 2025-03-31
|
| Keywords | Image classification / Deep Learning / Robot Navigation |
|---|
| Outline of Annual Research Achievements |
Experiments were done in vineyard using RGBD sensors, IMU, and Lidar sensors and data was collected in different phases of cultivation. The navigation part was finished considering the efficient tracking of people working in the vineyard using on-board and external cameras. High resolution RGB and point cloud data of grape data with and without occlusion has been collected. A small dataset has been labeled and tested using a deep network. The results show that more data is required for acceptable operation. Earlier systems used A-star path planner with obstacle avoidance. A new method with reinforcement learning based navigation is being tested on a small dataset. Labeling and processing of entire dataset will take more time and planned to complete in extension time. The following papers have been published in International conferences.
"Semantic Scene Understanding and Region Classification for Navigation of Service Robots in Care Scenarios", The Twenty-Ninth International Symposium on Artificial Life and Robotics 2024 (AROB 29th 2024), A. Ravankar et. al.
"Tracking People Across Multiple Cameras", International Conference on Communication, Computing and Data Security 2023, ICCCDS-2023, Multicon-W-2023, Thakur College of Engineering and Technology, Mumbai, India, Mumbai, India, Ryota Ishikawa, Abhijeet Ravankar.
|
| Current Status of Research Progress |
Current Status of Research Progress
3: Progress in research has been slightly delayed.
Reason
High resolution RGB and point cloud data of grape data with and without occlusion has been collected. A small dataset has been labeled and tested using a deep network. Data has also been collected for reinforcement learning of mobile robots in vineyard scenarios. This allows robots to work in very new and very dynamic scenarios with obstacles. The results show that more data is required for acceptable operation. Labeling and processing of entire dataset will take more time and planned to complete in extension time.
|
| Strategy for Future Research Activity |
The plan for this year is to process the high resolution RGB and point cloud data of grape data with and without occlusion. The first task is labeling of the data, and later processing of entire dataset will be done. With the new dataset, a new reinforcement model will be trained for robot navigation. The classification of grape data based on clusters will enable to find the best cutting location in real-time. Moreover PCD data will enable to filter occlusion. The system will be integrated will all the sub modules of navigation, actuators, SLAM, grape classification and operation. The system will be tested in this fiscal year.
|
| Causes of Carryover |
High resolution RGB and point cloud data of grape data with and without occlusion has been collected. A small dataset has been labeled and tested using a deep network. The results show that more data is required for acceptable operation. Labeling and processing of entire dataset requires hi-spec deep learning machines with powerful GPUs. Hence, budget is planned to complete the processing by developing and testing the model in extension time.
|
-
-
[Presentation] Tracking People Across Multiple Cameras2023
Author(s)
Ryota Ishikawa, Abhijeet Ravankar
Organizer
International Conference on Communication, Computing and Data Security 2023, ICCCDS-2023, Multicon-W-2023, Thakur College of Engineering and Technology, Mumbai, India, Mumbai, India
Int'l Joint Research
