• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Development of computer vision and assessment system using deep learning for laparoscopic rectal surgery

Research Project

Project/Area Number 18K16378
Research Category

Grant-in-Aid for Early-Career Scientists

Allocation TypeMulti-year Fund
Review Section Basic Section 55020:Digestive surgery-related
Research InstitutionNational Cancer Center Japan

Principal Investigator

Takeshita Nobuyoshi  国立研究開発法人国立がん研究センター, 東病院, 室長 (40645610)

Project Period (FY) 2018-04-01 – 2022-03-31
Project Status Completed (Fiscal Year 2021)
Budget Amount *help
¥4,160,000 (Direct Cost: ¥3,200,000、Indirect Cost: ¥960,000)
Fiscal Year 2021: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2020: ¥910,000 (Direct Cost: ¥700,000、Indirect Cost: ¥210,000)
Fiscal Year 2019: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2018: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Keywords直腸癌 / 内視鏡外科 / 深層学習 / 機械学習 / 画像認識
Outline of Final Research Achievements

In recent years, new innovative surgical techniques have begun to be introduced in the field of rectal cancer surgery which enable further function preservation and recognition of detailed anatomical structures. On the other hand, there are many issues to be solved in standardizing increasingly difficult surgical techniques, such as the transfer of skills and knowledge, training, and evaluation. In this study, we digitized and extracted the procedures performed in a video image of a specular rectal cancer surgery, and constructed an image recognition and analysis system for surgical instruments, anatomical structures, and surgical processes using deep learning, especially a convolutional neural network. We constructed a system that recognizes and analyzes images of anatomical structures and surgical processes using convolutional neural networks. We were also able to develop an objective surgical evaluation system that incorporates tacit knowledge of skilled operators.

Academic Significance and Societal Importance of the Research Achievements

本研究を通じて、畳み込みニューラルネットワーク(CNN)を用いた鏡視下直腸切除術における手術工程の自動認識の深層学習モデル、術中解剖構造検出としての前立腺認識モデル、さらには動画を用いた手術技能評価用の深層学習モデルの構築を達成した。これらは外科医の手術中の判断や技術の巧拙という暗黙知を定量化・客観化することに繋がり、手術支援による安全性向上や、手術教育への活用、最終的には外科手術の自動化をもたらすための要素技術となりうる。

Report

(5 results)
  • 2021 Annual Research Report   Final Research Report ( PDF )
  • 2020 Research-status Report
  • 2019 Research-status Report
  • 2018 Research-status Report
  • Research Products

    (42 results)

All 2022 2021 2020 2019 2018

All Journal Article (14 results) (of which Int'l Joint Research: 4 results,  Peer Reviewed: 4 results,  Open Access: 1 results) Presentation (28 results) (of which Int'l Joint Research: 4 results,  Invited: 5 results)

  • [Journal Article] Artificial Intelligence-Based Total Mesorectal Excision Plane Navigation in Laparoscopic Colorectal Surgery.2022

    • Author(s)
      Igaki T, Kitaguchi D, Takeshita N, et al
    • Journal Title

      Dis Colon Rectum

      Volume: 5 Issue: 5 Pages: e329-e333

    • DOI

      10.1097/dcr.0000000000002393

    • Related Report
      2021 Annual Research Report
  • [Journal Article] Artificial intelligence-based computer vision in surgery: Recent advances and future perspectives.2021

    • Author(s)
      Kitaguchi D, Takeshita N, Hasegawa H, Ito M.
    • Journal Title

      Ann Gastroenterol Surg

      Volume: 1 Issue: 1 Pages: 29-36

    • DOI

      10.1002/ags3.12513

    • Related Report
      2021 Annual Research Report
  • [Journal Article] Development and Validation of a 3-Dimensional Convolutional Neural Network for Automatic Surgical Skill Assessment Based on Spatiotemporal Video Analysis.2021

    • Author(s)
      Kitaguchi D, Takeshita N, Matsuzaki H, et al
    • Journal Title

      JAMA Netw Open. 2021

      Volume: 8 Issue: 8 Pages: e2120786-e2120786

    • DOI

      10.1001/jamanetworkopen.2021.20786

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] 外科手術支援におけるAI研究開発とデータベース構築の動向2021

    • Author(s)
      竹下 修由、松崎 博貴、森 健策、伊藤 雅昭
    • Journal Title

      日本コンピュータ外科学会誌

      Volume: 3 Pages: 101-103

    • NAID

      130008079346

    • Related Report
      2021 Annual Research Report
  • [Journal Article] Deep learning-based automatic surgical step recognition in intraoperative videos for transanal total mesorectal excision2021

    • Author(s)
      Daichi Kitaguchi, Nobuyoshi Takeshita et al.
    • Journal Title

      Surgical Endoscopy

      Volume: - Issue: 2 Pages: 1143-1151

    • DOI

      10.1007/s00464-021-08381-6

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] 外科治療領域でのAIの活用2021

    • Author(s)
      長谷川 寛, 北口 大地, 竹下 修由, 伊藤 雅昭
    • Journal Title

      Clinical oncology

      Volume: 27 Pages: 189-192

    • NAID

      40022502110

    • Related Report
      2020 Research-status Report
  • [Journal Article] Automated laparoscopic colorectal surgery workflow recognition using artificial intelligence: Experimental research2020

    • Author(s)
      Daichi Kitaguchi, Nobuyoshi Takeshita et al.
    • Journal Title

      International Journal of Surgery

      Volume: 79 Pages: 88-94

    • DOI

      10.1016/j.ijsu.2020.05.015

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Constructing Database of Tacit Knowledge and Its Application for Surgical Device Innovation in Laparoscopic Surgery2020

    • Author(s)
      Takeshita N, Mori K, Ito M
    • Journal Title

      Journal of Japan Society of Computer Aided Surgery.

      Volume: 22 Pages: 40-43

    • NAID

      130007795298

    • Related Report
      2020 Research-status Report
  • [Journal Article] 術の均てん化・効率化をもたらすAI支援システムの開発2020

    • Author(s)
      北口 大地, 竹下 修由, 小田 竜也, 伊藤 雅昭
    • Journal Title

      日本臨床腎移植学会雑誌

      Volume: 8 Pages: 83-88

    • Related Report
      2020 Research-status Report
  • [Journal Article] これからの手術ナビゲーションが進むべき方向性2020

    • Author(s)
      伊藤 雅昭, 竹下 修由, 長谷川 寛, 北口 大地
    • Journal Title

      月刊新医療

      Volume: 47 Pages: 72-75

    • Related Report
      2020 Research-status Report
  • [Journal Article] Computer-assisted real-time automatic prostate segmentation during TaTME: a single-center feasibility study2020

    • Author(s)
      Kitaguchi Daichi、Takeshita Nobuyoshi、Matsuzaki Hiroki、Hasegawa Hiro、Honda Ryoya、Teramura Koichi、Oda Tatsuya、Ito Masaaki
    • Journal Title

      Surgical Endoscopy

      Volume: - Issue: 6 Pages: 2493-2499

    • DOI

      10.1007/s00464-020-07659-5

    • Related Report
      2019 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] 内視鏡外科手術における暗黙知のデータベース構築と次世代医療機器開発への応用(総説)2020

    • Author(s)
      竹下修由、森健策、伊藤雅昭
    • Journal Title

      日本コンピュータ外科学会誌

      Volume: 22 Pages: 40-43

    • Related Report
      2019 Research-status Report
  • [Journal Article] 外科領域におけるArtificial Intelligence(AI)の活用2020

    • Author(s)
      竹下修由, 長谷川 寛, 池田 公治, 塚田 祐一郎, 西澤 祐吏, 佐々木 剛志, 伊藤 雅昭
    • Journal Title

      日本内視鏡外科学会雑誌

      Volume: 121 Pages: 211-215

    • Related Report
      2019 Research-status Report
  • [Journal Article] FOCUS 外科領域におけるAI手術支援の現状と展望(解説)2019

    • Author(s)
      竹下修由
    • Journal Title

      臨床外科

      Volume: 74 Pages: 1253-1257

    • Related Report
      2019 Research-status Report
  • [Presentation] 内視鏡外科手術動画データベース構築と活用事例2022

    • Author(s)
      竹下修由
    • Organizer
      第10回日本婦人科ロボット手術学会
    • Related Report
      2021 Annual Research Report
    • Invited
  • [Presentation] 外科AI 開発基盤としての内視鏡外科手術動画データベース整備の現状と将来展望2021

    • Author(s)
      竹下修由
    • Organizer
      第121回日本外科学会定期学術集会
    • Related Report
      2021 Annual Research Report
  • [Presentation] 臨床現場で進める手術支援AI開発2021

    • Author(s)
      竹下修由
    • Organizer
      第3回日本メディカルAI学会学術集会
    • Related Report
      2021 Annual Research Report
  • [Presentation] 革新的手術支援機器・システム創出に向けた情報活用基盤とスタートアップ・エコシステム2021

    • Author(s)
      竹下修由
    • Organizer
      第76回日本消化器外科学会総会
    • Related Report
      2021 Annual Research Report
  • [Presentation] 情報支援内視鏡外科手術に向けた開発の現状と未来2021

    • Author(s)
      竹下修由
    • Organizer
      第59回日本癌治療学会学術集会
    • Related Report
      2021 Annual Research Report
  • [Presentation] 画像アプローチによる内視鏡外科手術のデジタル・トランスフォーメーション2021

    • Author(s)
      竹下修由
    • Organizer
      第83回日本臨床外科学会総会
    • Related Report
      2021 Annual Research Report
  • [Presentation] Microsoft Azureを用いた 手術支援AIの基盤構築の最前線 ~内視鏡手術データベースの活用事例と外科医療発展への可能性~ -活用する側の立場から-2021

    • Author(s)
      竹下修由
    • Organizer
      第34回日本内視鏡外科学会総会
    • Related Report
      2021 Annual Research Report
  • [Presentation] Platform construction and development of Aipowered surgical systems for endoscopic surgery2021

    • Author(s)
      Takeshita N, Sasaki K, Hasegawa H
    • Organizer
      日本肝胆膵外科学会学術集会
    • Related Report
      2020 Research-status Report
    • Invited
  • [Presentation] AI-powered surgeryに向けた情報支援内視鏡外科手術システムの開発と基盤整備2021

    • Author(s)
      竹下修由, 長谷川寛, 北口大地
    • Organizer
      日本内視鏡外科学会総会
    • Related Report
      2020 Research-status Report
    • Invited
  • [Presentation] Computer-assisted Transanal Total Mesorectal Excision (TaTME): Real-time Automatic Prostate Segmentation2020

    • Author(s)
      Daichi Kitaguchi, Nobuyoshi Takeshita
    • Organizer
      The International Conference on Computer Assisted Radiology and Surgery (CARS)
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] Deep Learning-based Automatic Surgical Step Recognition in Tatme2020

    • Author(s)
      北口大地,竹下修由
    • Organizer
      日本内視鏡外科学会総会
    • Related Report
      2020 Research-status Report
  • [Presentation] Computer-assisted Transanal Total Mesorectal Excision. Real-time Automatic Prostate Segmentation2020

    • Author(s)
      北口大地,竹下修由
    • Organizer
      日本消化器外科学会総会
    • Related Report
      2020 Research-status Report
  • [Presentation] AI支援内視鏡外科手術と開発基盤としての手術動画データベース構構築2020

    • Author(s)
      竹下修由, 長谷川寛, 松崎博貴, 伊藤雅昭
    • Organizer
      日本外科学会定期学術集会
    • Related Report
      2020 Research-status Report
  • [Presentation] Can "AI" Understand Workflow of Colorectal Surgery?2020

    • Author(s)
      Daichi Kitaguchi, Nobuyoshi Takeshita
    • Organizer
      SAGES2020 Annual Meeting
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] Information-powered Surgery に向けた開発プラットフォーム構築2020

    • Author(s)
      竹下修由, 長谷川寛, 北口大地
    • Organizer
      日本癌治療学会学術集会
    • Related Report
      2020 Research-status Report
    • Invited
  • [Presentation] 次世代AI手術支援システムの開発2019

    • Author(s)
      竹下修由
    • Organizer
      第44回日本大腸肛門病学会九州地方会・第35回九州ストーマリハビリテーション研究会
    • Related Report
      2019 Research-status Report
    • Invited
  • [Presentation] 内視鏡外科手術におけるAI手術支援システムの開発2019

    • Author(s)
      竹下修由
    • Organizer
      第27回日本消化器関連学会週間
    • Related Report
      2019 Research-status Report
  • [Presentation] 臨床現場で求められる次世代型術中ナビゲーション2019

    • Author(s)
      伊藤雅昭、竹下修由、長谷川寛
    • Organizer
      第32回内視鏡外科学会総会
    • Related Report
      2019 Research-status Report
  • [Presentation] AI-powered surgery の開発に資するオールジャパンによる基盤構築2019

    • Author(s)
      竹下修由、長谷川寛、伊藤雅昭
    • Organizer
      第32回内視鏡外科学会総会
    • Related Report
      2019 Research-status Report
  • [Presentation] 内視鏡外科手術における自動アノテーションによる術具のセマンティックセグメンテーション2019

    • Author(s)
      松崎博貴、竹下修由、伊藤雅昭
    • Organizer
      第2回メディカルAI学会
    • Related Report
      2019 Research-status Report
  • [Presentation] 手術の均てん化・効率化をもたらすAI支援システムの開発2019

    • Author(s)
      竹下修由
    • Organizer
      第53回日本臨床腎移植学会
    • Related Report
      2019 Research-status Report
  • [Presentation] AI支援手術に向けた内視鏡外科手術自動認識システムの開発2019

    • Author(s)
      竹下修由
    • Organizer
      第73回手術手技研究会
    • Related Report
      2019 Research-status Report
  • [Presentation] 次世代AI surgeryに向けた内視鏡外科手術画像自動認識システムの開発2019

    • Author(s)
      竹下修由、北口大地、森健策、伊藤雅昭
    • Organizer
      第119回日本外科学会定期学術集会
    • Related Report
      2019 Research-status Report
  • [Presentation] AI支援手術に向けた鏡視下手術画像の自動認識システムの開発2019

    • Author(s)
      竹下修由
    • Organizer
      第1回日本メディカルAI学会学術集会
    • Related Report
      2018 Research-status Report
  • [Presentation] AUTOMATIC DETECTION AND RECOGNITION OF SURGICAL TOOLS AND WORKFLOW IN LAPAROSCOPIC SIGMOID COLECTOMY2018

    • Author(s)
      Nobuyoshi Takeshita
    • Organizer
      the Society of American Gastrointestinal and Endoscopic Surgeons Annual Meating
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] AUTOMATIC PIXELWISE SEGMENTATION OF SURGICAL TOOLS IN LAPAROSCOPIC SIGMOIDECTOMY USING CONVOLUTIONAL2018

    • Author(s)
      Nobuyoshi Takeshita
    • Organizer
      The European Association for Endoscopic Surgery Annual Congress
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] 次世代AI-Surgeryに向けた内視鏡外科手術画像の自動認識システム開発2018

    • Author(s)
      竹下修由
    • Organizer
      Japan Digestive Disease Week 2018
    • Related Report
      2018 Research-status Report
  • [Presentation] 内視鏡外科手術動画データベースとAIを活用した手術室運営・ 術中偶発症マネジメントの提案2018

    • Author(s)
      竹下修由
    • Organizer
      日本内視鏡外科学会総会
    • Related Report
      2018 Research-status Report

URL: 

Published: 2018-04-23   Modified: 2023-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi