• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Development of artificial intelligence assisted surgery system by moving image recognition based on deep learning and augmented reality

Research Project

Project/Area Number 19K10258
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Review Section Basic Section 57060:Surgical dentistry-related
Research InstitutionThe University of Tokyo

Principal Investigator

SUENAGA Hideyuki  東京大学, 医学部附属病院, 講師 (10396731)

Project Period (FY) 2019-04-01 – 2022-03-31
Project Status Completed (Fiscal Year 2021)
Budget Amount *help
¥4,290,000 (Direct Cost: ¥3,300,000、Indirect Cost: ¥990,000)
Fiscal Year 2021: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2020: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2019: ¥1,950,000 (Direct Cost: ¥1,500,000、Indirect Cost: ¥450,000)
Keywordsコンピュータ外科学 / 人工知能 / 拡張現実
Outline of Research at the Start

外科手術には三次元的な空間認識が重要である。これまでに、術野カメラを用いたコンピュータビジョンにより歯を画像認識して、マーカーを用いずに画像情報により、CT画像と患者位置の空間的対応関係を求める処理を行う拡張現実技術の開発を行ってきた。現在の仕様では、CTや口腔内スキャナの三次元画像から、手動で歯の領域を分割(セグメンテーションというコンピュータ処理)する必要がある。そこで、近年、注目を集めている深層学習に基づいた人工知能技術の導入が有用と考えた。本課題では、人工知能が自動で取得したデータから認識・理解し、歯の領域を自動セグメンテーションして、CT画像と患者位置のレジストレーションを行う。

Outline of Final Research Achievements

In this study, artificial intelligence is adopted to automatically predict optimal postoperative skeletal changes indicated by specifically selected anatomical landmarks for assisting surgical planning in orthognathic surgery. This study is a machine learning method to extract the surgeons' knowledge and technique on surgical planning using real pre and postoperative CT images. The proposed approach can learn and subsequently imitate the decision‐making mechanism of surgeons during surgical planning. The methods introduced in this study could improve surgical planning efficiency. This study demonstrated the feasibility of predicting postoperative skeletal changes for orthognathic surgical planning by using machine learning, showing potential for reducing the workload of surgeons.

Academic Significance and Societal Importance of the Research Achievements

人工知能の優位性は、無限大の症例を学習できる可能性である。これは、あらゆる分野の最高のスペシャリストの臨床経験をはるかに超える。この技術は、人工知能によるビックデータに基づいた口腔外科手術計画の自動化と手術支援ロボットの動作制御に展開が可能である。

Report

(4 results)
  • 2021 Annual Research Report   Final Research Report ( PDF )
  • 2020 Research-status Report
  • 2019 Research-status Report
  • Research Products

    (12 results)

All 2022 2021 2020 2019

All Journal Article (5 results) (of which Int'l Joint Research: 2 results,  Peer Reviewed: 5 results,  Open Access: 3 results) Presentation (3 results) (of which Invited: 3 results) Patent(Industrial Property Rights) (4 results) (of which Overseas: 2 results)

  • [Journal Article] Machine-learning-based approach for predicting postoperative skeletal changes for orthognathic surgical planning.2022

    • Author(s)
      Ma Q, Kobayashi E, Fan B, Hara K, Nakagawa K, Masamune K, Sakuma I, Suenaga H.
    • Journal Title

      Int J Med Robot

      Volume: e Issue: 3 Pages: 2379-2379

    • DOI

      10.1002/rcs.2379

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Automatic 3D landmarking model using patch‐based deep neural networks for CT image of oral and maxillofacial surgery2020

    • Author(s)
      Ma Q, Kobayashi E, Fan B, Nakagawa K, Sakuma I, Masamune K, Suenaga H
    • Journal Title

      Int J Med Robot

      Volume: 16(3) Issue: 3

    • DOI

      10.1002/rcs.2093

    • Related Report
      2020 Research-status Report
    • Peer Reviewed
  • [Journal Article] Autonomous surgical robot with camera-based markerless navigation for oral and maxillofacial surgery2020

    • Author(s)
      Ma Qingchuan、Kobayashi Etsuko、Suenaga Hideyuki、Hara Kazuaki、Wang Junchen、Nakagawa Keiichi、Sakuma Ichiro、Masamune Ken
    • Journal Title

      IEEE/ASME Transactions on Mechatronics

      Volume: - Issue: 2 Pages: 1-1

    • DOI

      10.1109/tmech.2020.2971618

    • Related Report
      2020 Research-status Report 2019 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Orthognathic Surgical Robot With a Workspace Limitation Mechanism2019

    • Author(s)
      Hara Kazuaki、Ma Qingchuan、Suenaga Hideyuki、Kobayashi Etsuko、Sakuma Ichiro、Masamune Ken
    • Journal Title

      IEEE/ASME Transactions on Mechatronics

      Volume: 24 Issue: 6 Pages: 2652-2660

    • DOI

      10.1109/tmech.2019.2945605

    • Related Report
      2019 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Development and preliminary evaluation of an autonomous surgical system for oral and maxillofacial surgery2019

    • Author(s)
      Qingchuan Ma, Etsuko Kobayashi, Junchen Wang, Kazuaki Hara, Hideyuki Suenaga, Ichiro Sakuma, Ken Masamune
    • Journal Title

      The International Journal of Medical Robotics and Computer Assisted Surgery

      Volume: accepted Issue: 4

    • DOI

      10.1002/rcs.1997

    • Related Report
      2019 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Presentation] 人工知能、コンピュータビジョン、拡張現実を用いた手術支援2021

    • Author(s)
      末永英之
    • Organizer
      第45回日本頭頸部癌学会総会・学術講演会
    • Related Report
      2021 Annual Research Report
    • Invited
  • [Presentation] 人工知能とコンピュータビジョンを統合した拡張現実手術支援システムの開発2020

    • Author(s)
      末永英之
    • Organizer
      第65回日本口腔外科学会総会・学術大会
    • Related Report
      2020 Research-status Report
    • Invited
  • [Presentation] コンピュータビジョンと拡張現実ディスプレイを統合した手術支援システムの開発2019

    • Author(s)
      末永英之
    • Organizer
      第73回 日本口腔科学会学術集会 指名報告
    • Related Report
      2019 Research-status Report
    • Invited
  • [Patent(Industrial Property Rights)] 医用情報処理システム、プログラム及び情報処理方法2022

    • Inventor(s)
      末永英之、馬青川、 小林英津子、正宗賢
    • Industrial Property Rights Holder
      国立大学法人東京大学、学校法人東京女子医科大学
    • Industrial Property Rights Type
      特許
    • Industrial Property Number
      2022-009759
    • Filing Date
      2022
    • Related Report
      2021 Annual Research Report
  • [Patent(Industrial Property Rights)] 自動手術計画システムおよび手術計画方法並びにプログラム2021

    • Inventor(s)
      馬青川、末永英之、 小林英津子、正宗賢
    • Industrial Property Rights Holder
      国立大学法人東京大学、学校法人東京女子医科大学
    • Industrial Property Rights Type
      特許
    • Industrial Property Number
      2021-556188
    • Filing Date
      2021
    • Related Report
      2021 Annual Research Report
  • [Patent(Industrial Property Rights)] 自動手術計画システムおよび手術計画方法並びにプログラム2020

    • Inventor(s)
      馬青川、末永英之、小林英津子、正宗賢
    • Industrial Property Rights Holder
      国立大学法人 東京大学、学校法人 東京女子医科大学
    • Industrial Property Rights Type
      特許
    • Filing Date
      2020
    • Related Report
      2020 Research-status Report
    • Overseas
  • [Patent(Industrial Property Rights)] Automatic surgical planning system, surgical planning method, and program2019

    • Inventor(s)
      Ma Q, Suenaga H, et al.
    • Industrial Property Rights Holder
      国立大学法人 東京大学
    • Industrial Property Rights Type
      特許
    • Filing Date
      2019
    • Related Report
      2019 Research-status Report
    • Overseas

URL: 

Published: 2019-04-18   Modified: 2023-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi