• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Real-time adaptive control of robots for microsurgery: towards submillimeter accuracy without added sensors

Research Project

Project/Area Number 19K14935
Research Category

Grant-in-Aid for Early-Career Scientists

Allocation TypeMulti-year Fund
Review Section Basic Section 20020:Robotics and intelligent system-related
Research InstitutionThe University of Tokyo

Principal Investigator

Marques Marinho Murilo  東京大学, 大学院工学系研究科(工学部), 助教 (70837468)

Project Period (FY) 2019-04-01 – 2023-03-31
Project Status Completed (Fiscal Year 2022)
Budget Amount *help
¥4,290,000 (Direct Cost: ¥3,300,000、Indirect Cost: ¥990,000)
Fiscal Year 2021: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2020: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2019: ¥2,210,000 (Direct Cost: ¥1,700,000、Indirect Cost: ¥510,000)
Keywords手術ロボット / 適応制御 / 画像処理 / ロボティクス / センサ融合
Outline of Research at the Start

Surgeons can use surgical robots to increase their accuracy in adult surgery, but robots are unavailable for procedures in narrow workspaces. This research aims to improve the safety and accuracy of surgical robots using endoscopic images to enable the use of robots for surgeries in narrow regions.

Outline of Final Research Achievements

Surgeons can use surgical robots to increase their accuracy in adult surgery, but robots are unavailable for procedures in narrow workspaces. This research aims to improve the safety and accuracy of surgical robots using endoscopic images to enable the use of robots for surgeries in narrow regions.

In this project, the online calibration of surgical instruments with partial or complete task space measurements using external sensors was investigated. Using such online calibration makes it possible to have very high accuracy for the positioning of the tools, depending mostly on the accuracy of the sensors. In parallel to the calibration, the investigation of the recognition and tracking of instruments from endoscopic images was also investigated. AI-based methods for tool tracking have been done using advanced simulators that generate convincing computer-generated images. The results are available in high-ranked peer-reviewed publication (also green open-source) and free software.

Academic Significance and Societal Importance of the Research Achievements

The proposed adaptive control algorithm is the first of its kind and will guide the development in surgical robotics research. It can also be used in other fields of robotics, such as industrial applications. This development will help pave a future for surgeries in challenging scenarios.

Report

(5 results)
  • 2022 Annual Research Report   Final Research Report ( PDF )
  • 2021 Research-status Report
  • 2020 Research-status Report
  • 2019 Research-status Report
  • Research Products

    (17 results)

All 2022 2021 2020 2019 Other

All Int'l Joint Research (2 results) Journal Article (5 results) (of which Int'l Joint Research: 4 results,  Peer Reviewed: 5 results) Presentation (8 results) (of which Int'l Joint Research: 4 results) Remarks (2 results)

  • [Int'l Joint Research] The University of Manchester(英国)

    • Related Report
      2022 Annual Research Report
  • [Int'l Joint Research] The University of Manchester(英国)

    • Related Report
      2021 Research-status Report
  • [Journal Article] Adaptive Constrained Kinematic Control Using Partial or Complete Task-Space Measurements2022

    • Author(s)
      Marinho Murilo Marques、Adorno Bruno Vilhena
    • Journal Title

      IEEE Transactions on Robotics

      Volume: 38 Issue: 6 Pages: 3498-3513

    • DOI

      10.1109/tro.2022.3181047

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed
  • [Journal Article] DQ Robotics: A Library for Robot Modeling and Control2020

    • Author(s)
      Adorno Bruno Vilhena、Marques Marinho Murilo
    • Journal Title

      IEEE Robotics & Automation Magazine

      Volume: In press Issue: 3 Pages: 0-0

    • DOI

      10.1109/mra.2020.2997920

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] The effects of different levels of realism on the training of CNNs with only synthetic images for the semantic segmentation of robotic instruments in a head phantom2020

    • Author(s)
      Heredia Perez Saul Alexis、Marques Marinho Murilo、Harada Kanako、Mitsuishi Mamoru
    • Journal Title

      International Journal of Computer Assisted Radiology and Surgery

      Volume: 15 Issue: 8 Pages: 1257-1265

    • DOI

      10.1007/s11548-020-02185-0

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] SmartArm: Integration and validation of a versatile surgical robotic system for constrained workspaces2020

    • Author(s)
      Marinho Murilo Marques、Harada Kanako、Morita Akio、Mitsuishi Mamoru
    • Journal Title

      The International Journal of Medical Robotics and Computer Assisted Surgery

      Volume: 16 Issue: 2

    • DOI

      10.1002/rcs.2053

    • Related Report
      2019 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Dynamic Active Constraints for Surgical Robots Using Vector-Field Inequalities2019

    • Author(s)
      Marinho Murilo Marques、Adorno Bruno Vilhena、Harada Kanako、Mitsuishi Mamoru
    • Journal Title

      IEEE Transactions on Robotics

      Volume: 35 Issue: 5 Pages: 1166-1185

    • DOI

      10.1109/tro.2019.2920078

    • Related Report
      2019 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Presentation] MBAPose: Mask and Bounding-Box Aware Pose Estimation of Surgical Instruments with Photorealistic Domain Randomization2021

    • Author(s)
      Yoshimura, M.; Marinho, M. M.; Harada, K.; and Mitsuishi, M
    • Organizer
      2021 IEEE International Conference on Intelligent Robots and Systems (IROS)
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Preliminary Use of Multi-CycleGAN for Synthetic-to-Real Surgical Instrument Translation in Monocular Endoscope Images2021

    • Author(s)
      Oizumi, S.; Tanaka, M.; Marinho, M. M.; Harada, K.; and Mitsuishi, M
    • Organizer
      The 17th Asian Conference on Computer Aided Surgery (ACCAS)
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] 術具位置推定のための画像生成手法に関する研究2021

    • Author(s)
      田中 真帆, マルケス マリニョ ムリロ, 原田 香奈子, 光石 衛
    • Organizer
      ロボティクス・メカトロニクス講演会講演概要集 2021
    • Related Report
      2021 Research-status Report
  • [Presentation] Single Shot Pose Estimation of Surgical Robot Instruments' Shafts from Monocular Endoscopic Images2020

    • Author(s)
      Masakazu Yoshimura, Murilo M. Marinho, Kanako Harada, Mamoru Mitsuishi
    • Organizer
      2020 IEEE International Conference on Robotics and Automation (ICRA)
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] Towards the Pose Estimation of Surgical Instruments' Shafts from Synthetic Endonasal Images of a Head Phantom2020

    • Author(s)
      Shimon Takechi, Murilo M. Marinho, Saul A. H. Perez, Kanako Harada, Mamoru Mitsuishi
    • Organizer
      16th Asian Conference on Computer Aided Surgery (ACCAS)
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] Single-Shotベースの画像処理を用いた物体の3次元位置姿勢推定2020

    • Author(s)
      吉村仁和, マルケスマリニョ・ムリロ, 原田香奈子, 光石衛
    • Organizer
      第29回日本コンピュータ外科学会大会
    • Related Report
      2020 Research-status Report
  • [Presentation] Segmentation of Endonasal Robotic Instruments in a Head Phantom using Deep Learning and Virtual-Reality Simulation2020

    • Author(s)
      Saul Alexis Heredia Perez, Murilo Marques Marinho, Kanako Harada, Mamoru Mitsuishi
    • Organizer
      ロボティクス・メカトロニクス 講演会2020 (Robomec)
    • Related Report
      2020 Research-status Report
  • [Presentation] SmartArm: Dura Mater Suturing Experiments with a Versatile Surgical Robot2019

    • Author(s)
      Murilo Marques Marinho
    • Organizer
      ロボティクス・メカトロニクス 講演会 2019
    • Related Report
      2019 Research-status Report
  • [Remarks] The DQRobotics webpage.

    • URL

      https://dqrobotics.github.io

    • Related Report
      2021 Research-status Report
  • [Remarks] DQ Robotics Website

    • URL

      https://dqrobotics.github.io

    • Related Report
      2020 Research-status Report

URL: 

Published: 2019-04-18   Modified: 2024-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi