• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to project page

2022 Fiscal Year Research-status Report

Learning in-hand manipulation for a compliant underactuated gripper with interactive human supervision

Research Project

Project/Area Number 22K14221
Research InstitutionNagoya University

Principal Investigator

Colan Jacinto  名古屋大学, 工学研究科, 研究員 (40936746)

Project Period (FY) 2022-04-01 – 2024-03-31
Keywordsin-hand manipulation / adaptive compliance / robotic gripper / cable-driven mechanism
Outline of Annual Research Achievements

This project aims to design and develop underactuated robotic grippers that can learn adaptive compliance for soft manipulation of deformable objects through human demonstrations and interactive feedback.

In the first year, we accomplished the first objective of developing a compact multi-dof robotic gripper with a decoupled wrist that enables independent position and force control of each joint. We carried out experimental validation for minimally invasive surgical applications using the developed gripper. We collected actuator signals when grasping materials with different stiffness and trained a Gaussian process regression model for sensorless grip force prediction. We also devised a multi-objective inverse kinematics control framework that can handle joint position control under multiple constraints simultaneously.

The next objective is to learn adaptive compliance from human demonstrations using reinforcement learning, sim-to-real techniques and interactive feedback. We plan to develop a simulation environment that can capture human demonstrations and train a model-free policy using state-of-the-art deep reinforcement learning algorithms.

Current Status of Research Progress
Current Status of Research Progress

2: Research has progressed on the whole more than it was originally planned.

Reason

The project is advancing well as the first objective was completed during the first year, with the design, prototyping, control and evaluation of a cable-driven gripper for compliant grip force. Progress on the next objectives has been started with a supervised regression model trained for sensorless grip force prediction.

The proposed design, control and evaluation of the developed gripper have been published in two journal papers and two international conferences.

Strategy for Future Research Activity

The project is expected to proceed according to the initially approved plan without any changes. In the next project year, we plan to develop a simulation environment that can capture human demonstrations for manipulation of soft objects. A model-free policy will then be trained using state-of-the-art deep reinforcement learning algorithms. Sim-to-real strategies will be applied for transferring the learned manipulation strategy to the real robotic gripper, and interactive human feedback will be used for adapting the learned policy and deploying it again in the physical system.

Causes of Carryover

For prototyping the proposed gripper, we used existing actuators and control circuits. Next steps involve the extension to multiple cable-driven fingers of larger size, so we postponed the scheduled purchase of motors, mechanical parts and electrical parts for the next year. Moreover, since the first year focused on the mechanical design of the gripper, we will also purchase the deep learning workstation for the manipulation learning aspects during the second year.

  • Research Products

    (4 results)

All 2023 2022

All Journal Article (2 results) (of which Int'l Joint Research: 2 results,  Peer Reviewed: 2 results,  Open Access: 2 results) Presentation (2 results) (of which Int'l Joint Research: 2 results)

  • [Journal Article] OpenRST: An Open Platform for Customizable 3D Printed Cable-Driven Robotic Surgical Tools2023

    • Author(s)
      Jacinto Colan, Ana Davila, Yaonan Zhu, Tadayoshi Aoyama, Yasuhisa Hasegawa
    • Journal Title

      IEEE Access

      Volume: 11 Pages: 6092-6105

    • DOI

      10.1109/ACCESS.2023.3236821

    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] A Concurrent Framework for Constrained Inverse Kinematics of Minimally Invasive Surgical Robots2023

    • Author(s)
      Jacinto Colan, Ana Davila, Khusniddin Fozilov, Yasuhisa Hasegawa
    • Journal Title

      Sensors

      Volume: 23 Pages: 3328

    • DOI

      10.3390/s23063328

    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Presentation] Constrained motion planning for a robotic endoscope holder based on Hierarchical Quadratic Programming2023

    • Author(s)
      Jacinto Colan, Ana Davila, Yasuhisa Hasegawa
    • Organizer
      8th International Conference on Control and Robotics Engineering
    • Int'l Joint Research
  • [Presentation] Sensorless grip force estimation of a cable-driven robotic surgical tool based on Gaussian Process Regression2022

    • Author(s)
      Jacinto Colan, Yasuhisa Hasegawa
    • Organizer
      33rd International Symposium on Micro-NanoMechatronics and Human Science
    • Int'l Joint Research

URL: 

Published: 2023-12-25  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi