• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Teleoperation of surgical assist system integrating operator and autonomous robot

Research Project

Project/Area Number 17H03199
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Intelligent mechanics/Mechanical systems
Research InstitutionTokyo Medical and Dental University

Principal Investigator

KAWASHIMA KENJI  東京医科歯科大学, 生体材料工学研究所, 教授 (40300553)

Co-Investigator(Kenkyū-buntansha) 菅野 貴皓  東京医科歯科大学, 生体材料工学研究所, 准教授 (50714234)
只野 耕太郎  東京工業大学, 科学技術創成研究院, 准教授 (90523663)
Project Period (FY) 2017-04-01 – 2020-03-31
Project Status Completed (Fiscal Year 2019)
Budget Amount *help
¥16,900,000 (Direct Cost: ¥13,000,000、Indirect Cost: ¥3,900,000)
Fiscal Year 2019: ¥4,550,000 (Direct Cost: ¥3,500,000、Indirect Cost: ¥1,050,000)
Fiscal Year 2018: ¥5,850,000 (Direct Cost: ¥4,500,000、Indirect Cost: ¥1,350,000)
Fiscal Year 2017: ¥6,500,000 (Direct Cost: ¥5,000,000、Indirect Cost: ¥1,500,000)
Keywords手術ロボット / 遠隔制御 / 機械学習 / 自律制御 / 空気圧サーボ / マンマシンインターフェース マニピュレータ / ンマシンインターフェース / 手術支援ロボット / 知能ロボティクス / マンマシンインターフェース / マニピュレータ / 人間機械システム / 手術支援ロボットシステム / 遠隔操作 / 力覚提示
Outline of Final Research Achievements

To improve controllability and work efficiency of tele-surgery, we proposed semi-automatic control and developed a system. We evaluated the stability of a bilateral control of the robot system that can provide force feedback using pneumatic drive. Then, we developed a system wherein an operator manipulates a surgical instrument to insert a suture needle, and another surgical instrument automatically extracts the needle from the operated instrument. In the proposed method, YOLOv3 and standard convolutional neural network (CNN) were used to estimate the penetration and pull states of the needle. An image-based state estimator classifies the needle pull state regardless of the penetrability of the object into which the suture needle is inserted. Experiments on human cooperative control indicated the effectiveness of the needle pull state estimation using the proposed method, and confirmed that the method can reduce the suturing time about 10% compared to the master-slave tele-operation.

Academic Significance and Societal Importance of the Research Achievements

遠隔操作する空気圧駆動の手術支援ロボットにおいて,位置と力の情報を伝達するバイラテラル制御の安定性評価を行った.また,マスタスレーブで遠隔操作するロボット鉗子と自律動作するロボット鉗子で構成されるシステムを試作し,両鉗子が機能連携する半自律制御方法を提案した.内視鏡画像から機械学習を用いた状態判別と組み合わせ,外科手術で重要となる縫合操作の時間短縮の実現を実験によって明らかにした.低侵襲外科手術の作業時間の短縮,効率および安全性を高めることが期待される.また,提案した半自律制御は遠隔での触診ほか,外科手術以外にも広く遠隔操作システムに応用可能である.

Report

(4 results)
  • 2019 Annual Research Report   Final Research Report ( PDF )
  • 2018 Annual Research Report
  • 2017 Annual Research Report
  • Research Products

    (24 results)

All 2020 2019 2018 2017 Other

All Journal Article (4 results) (of which Int'l Joint Research: 1 results,  Peer Reviewed: 4 results,  Open Access: 3 results) Presentation (19 results) (of which Int'l Joint Research: 8 results,  Invited: 6 results) Remarks (1 results)

  • [Journal Article] 3D Posture Estimation of Robot Forceps using Endoscope with Convolutional Neural Network2020

    • Author(s)
      Mikada Takuto, Takahiro Kanno, Toshihiro Kawase, Tetsuro Miyazaki, Kenji Kawashima
    • Journal Title

      The International Journal of Medical Robotics and Computer Assisted Surgery

      Volume: 2020;16:e2062. Issue: 2 Pages: 1-9

    • DOI

      10.1002/rcs.2062

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Robots in laparoscopic surgery: Current and future status2019

    • Author(s)
      Kenji Kawashima, Takahiro Kanno, Kotaro Tadano
    • Journal Title

      BMC Biomedical Engineering

      Volume: 1:12 Issue: 1 Pages: 1-6

    • DOI

      10.1186/s42490-019-0012-1

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Evaluation of a pneumatic surgical robot with dynamic force feedback2018

    • Author(s)
      Dimitrios Karponis, Koya Yokota, Ryoken Miyazaki, Takahiro Kanno, Kenji Kawashima
    • Journal Title

      Journal of Robotic Surgery

      Volume: 13 Issue: 3 Pages: 1-9

    • DOI

      10.1007/s11701-018-0878-2

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Single Master Dual Slave Surgical Robot with Automated Relay of Suture Needle2018

    • Author(s)
      Kengo Watanabe, Takahiro Kanno, Kazuhisa Ito, Kenji Kawashima
    • Journal Title

      IEEE Transactions on Industrial Electronics

      Volume: 65 Issue: 8 Pages: 6343-6351

    • DOI

      10.1109/tie.2017.2786206

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed
  • [Presentation] Application to Pneumatic Servo System in Bilateral Control Based on Wave Variable2020

    • Author(s)
      Yuya Inoue, Takahiro Kanno, Tetsuro Miyazaki, Toshihiro Kawase, Kenji Kawashima
    • Organizer
      IEEE/SICE International Symposium on System Integration
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 手術支援ロボットにおけるAIの活用2020

    • Author(s)
      川嶋健嗣
    • Organizer
      日本メディカルAI学会
    • Related Report
      2019 Annual Research Report
    • Invited
  • [Presentation] Robotic Forceps without Position Sensors using Visual SLAM2019

    • Author(s)
      Takuya Iwai, Takahiro Kanno, Tetsuro Miyazaki, Toshihiro Kawase, Kenji Kawashima
    • Organizer
      , IEEE International Conference on Robotics and Automation (ICRA)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Pneumatically-driven Surgical Robot with Force Feedback2019

    • Author(s)
      Kenji Kawashima
    • Organizer
      IEEE IROS work shop Intelligent Robot Interactions with the Anatomy
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Pneumatically driven surgical robot capable of estimating grasping force2019

    • Author(s)
      川嶋健嗣,只野耕太郎
    • Organizer
      第 32 回日本内視鏡外科学会総会
    • Related Report
      2019 Annual Research Report
    • Invited
  • [Presentation] 波変数に基づくバイラテラル制御にお ける機械学習を用いた遅れ補償2019

    • Author(s)
      井上裕矢, 菅野貴皓, 宮嵜哲郎, 川瀬利弘, 川嶋健嗣
    • Organizer
      ロボティクス・メカトロニクス講演会
    • Related Report
      2019 Annual Research Report
  • [Presentation] マルチモーダル学習を用いたロボ ット鉗子の姿勢推定2019

    • Author(s)
      三ケ田拓人,菅野貴皓,川瀬利弘 ,宮嵜哲郎,川嶋健嗣
    • Organizer
      第 28 回日本コンピュータ外科学会大会
    • Related Report
      2019 Annual Research Report
  • [Presentation] Robotic Forceps Measuring Joint Pose with Visual SLAM2018

    • Author(s)
      Takuya Iwai, Takahiro Kanno, Kenji Kawashima
    • Organizer
      The 8th International Conference on Positioning Technology (ICPT 2018)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] External Force Estimation of Forceps Tip Using Machine Learning2018

    • Author(s)
      Hiroki Kaji, Takahiro Kanno, Tetsuro Miyazaki, Toshihiro Kawase, Kenji Kawashima
    • Organizer
      The 8th International Conference on Positioning Technology (ICPT 2018)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Immersive Operation Interface for Surgical Robot Using Motion Sensor and VR Headset2018

    • Author(s)
      Ryoken Miyazaki, Takahiro Kanno, Kenji Kawashima
    • Organizer
      The 8th International Conference on Positioning Technology (ICPT 2018)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Robotic Surgical System using Pneumatic Actuators2018

    • Author(s)
      Kenji Kawashima
    • Organizer
      16th Urological Association of Asia Congress,
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] 内視鏡画像を用いたCNNによるロボット鉗子の姿勢推定2018

    • Author(s)
      三ケ田拓人,梶創揮,岩井拓也,菅野貴皓,川瀬利弘,宮嵜哲郎,川嶋健嗣
    • Organizer
      計測自動制御学会産業応用部門大会
    • Related Report
      2018 Annual Research Report
  • [Presentation] 非接触回転伝達機構による着脱が可能な鉗子マニピュレータの制御性2018

    • Author(s)
      横田航也,藤田壽憲,宮崎良兼,菅野貴皓,川嶋健嗣
    • Organizer
      計測自動制御学会産業応用部門大会
    • Related Report
      2018 Annual Research Report
  • [Presentation] 非接触回転伝達機構による着脱が可能な空気圧駆動鉗子マニピュレータ2018

    • Author(s)
      横田航也,宮崎良兼,菅野貴皓,藤田壽憲,川嶋健嗣
    • Organizer
      第36 回日本ロボット学会学術講演会
    • Related Report
      2018 Annual Research Report
  • [Presentation] Master-Slave Integrated Surgical Robot for Laparoscopic Surgery with Semi-Automation Control using Hand Rotation2017

    • Author(s)
      Ryoken Miyazaki, Takahiro Kanno, Kenji Kawashima
    • Organizer
      The 10th JFPS International Symposium on Fluid Power
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 先端回転機構を有する空気圧稼働鉗子マニピュレ ータの開発2017

    • Author(s)
      庄司将記,宮崎良兼,菅野貴皓,川嶋健嗣
    • Organizer
      日本機械学会ロボティクス・メカトロニクス講演会
    • Related Report
      2017 Annual Research Report
  • [Presentation] 操作部に弾性体を用いたマスタスレ ーブ一体型手術支援システムの開発2017

    • Author(s)
      久富玲依,宮﨑良兼,田上俊宏,菅野貴晧,米田隆志,川嶋健嗣
    • Organizer
      日本機械学会ロボティクス・メカトロニクス講演会
    • Related Report
      2017 Annual Research Report
  • [Presentation] わが国発の手術支援ロボットの開発2017

    • Author(s)
      川嶋健嗣
    • Organizer
      第 30 回日本泌尿器内視鏡学会総会
    • Related Report
      2017 Annual Research Report
    • Invited
  • [Presentation] 低侵襲な外科手術を支援する空気圧駆動ロボットシステム2017

    • Author(s)
      川嶋健嗣
    • Organizer
      化学とマイクロ・ナノ システム学会第 35 回研究
    • Related Report
      2017 Annual Research Report
    • Invited
  • [Remarks] 東京医科歯科大学 生体材料工学研究所 バイオメカニクス分野

    • URL

      http://www.tmd.ac.jp/i-mde/www/bmc/publication/index.html

    • Related Report
      2017 Annual Research Report

URL: 

Published: 2017-04-28   Modified: 2021-02-19  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi