• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

AI-based Computer-Aided-Orthpaedic-Surgery Navigation System

Research Project

Project/Area Number 18F18377
Research Category

Grant-in-Aid for JSPS Fellows

Allocation TypeSingle-year Grants
Section外国
Review Section Basic Section 61040:Soft computing-related
Research InstitutionUniversity of Hyogo

Principal Investigator

小橋 昌司  兵庫県立大学, 工学研究科, 教授 (00332966)

Co-Investigator(Kenkyū-buntansha) HOSSAIN MD BELAYAT  兵庫県立大学, 工学(系)研究科(研究院), 外国人特別研究員
Project Period (FY) 2018-11-09 – 2021-03-31
Project Status Completed (Fiscal Year 2020)
Budget Amount *help
¥2,200,000 (Direct Cost: ¥2,200,000)
Fiscal Year 2020: ¥700,000 (Direct Cost: ¥700,000)
Fiscal Year 2019: ¥1,100,000 (Direct Cost: ¥1,100,000)
Fiscal Year 2018: ¥400,000 (Direct Cost: ¥400,000)
Keywords整形外科手術支援 / 人工知能 / 手術支援 / 動画像解析 / 手術ナビゲーション / 手技認識 / 整形外科 / 深層学習
Outline of Annual Research Achievements

超高齢化社会の到来を背景に,関節置換術の手術症例数は増加傾向にある.手術予後の向上には,正しいアライメントでの骨切りや人工関節設置が有効であるとされており,同手術精度を向上するため,これまで様々なナビゲーションシステムやロボット手術が導入されてきた.一方,同手術は多くの工程で構成され,多くの手術器具が使用される.そのため器械出し看護師にとって,同手術の複雑な手順と手術器具を把握することは大きな負担であり,術中の器具の受け渡しのミス,手術時間延長による予後不良等の手術の質の低下につながる可能性がある.しかしながら,前述の通りこれまでのナビゲーションシステムは手術精度の向上が主眼であり,術者や看護師らの作業支援には注目されていなかった.
本研究では,術中に器械出し看護師を含む医療スタッフに対し,手術工程を通知する整形外科手術-人工知能ナビゲーションシステム(Orthopaedic Surgery AI Navigation System; OSAI System)を提案した.同システムでは,執刀医が行っている現時点の手術工程を自動認識し,周囲の助手や器械出し看護師に,次手術工程を通知し,必要な手術器具やその準備を提示する.本システムでは,執刀医がスマートグラスを装着するのみで実装可能であるため,非常に導入が容易で,安価である特徴を有する.
術者視点で取得した手術映像からの手術手技工程の自動認識法として,深層学習による画像解析技術に基づく2つの手法を提案した.Convolutional-LSTM networkに基づく手法の精度は59.9%であった.また,工程進行の時点検出に基づく手法では,TCCMの精度は83.1%,異常検知モデルの検出精度は平均二乗誤差が0.151であった.

Research Progress Status

令和2年度が最終年度であるため、記入しない。

Strategy for Future Research Activity

令和2年度が最終年度であるため、記入しない。

Report

(3 results)
  • 2020 Annual Research Report
  • 2019 Annual Research Report
  • 2018 Annual Research Report
  • Research Products

    (13 results)

All 2020 2019 2018 Other

All Int'l Joint Research (1 results) Journal Article (10 results) (of which Int'l Joint Research: 7 results,  Peer Reviewed: 9 results,  Open Access: 2 results) Presentation (2 results)

  • [Int'l Joint Research] 国際経営農業技術大学(バングラデシュ)

    • Related Report
      2020 Annual Research Report
  • [Journal Article] 特集 整形外科×人工知能 人工知能による整形外科手術ナビゲーション2020

    • Author(s)
      小橋 昌司、八木 直美、平中 崇文
    • Journal Title

      臨床整形外科

      Volume: 55 Issue: 8 Pages: 925-931

    • DOI

      10.11477/mf.1408201769

    • ISSN
      0557-0433, 1882-1286
    • Year and Date
      2020-08-25
    • Related Report
      2020 Annual Research Report
  • [Journal Article] Surgical Phase Recognition with Wearable Video Camera for Computer-aided Orthopaedic Surgery-AI Navigation System2020

    • Author(s)
      NISHIO Shoichi、HOSSAIN Belayat、NII Manabu、YAGI Naomi、HIRANAKA Takafumi、KOBASHI Syoji
    • Journal Title

      International Journal of Affective Engineering

      Volume: 19 Issue: 2 Pages: 137-143

    • DOI

      10.5057/ijae.IJAE-D-19-00018

    • NAID

      130007866877

    • ISSN
      2187-5413
    • Related Report
      2020 Annual Research Report 2019 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Hand Frame Extraction in Surgical Video Images Using Convolutional Neural Network2020

    • Author(s)
      Sakib Shadman、Hossain Belayat、Hiranaka Takafumi、Kobashi Syoji
    • Journal Title

      2020 Joint 11th International Conference on Soft Computing and Intelligent Systems and 21st International Symposium on Advanced Intelligent Systems (SCIS-ISIS)

      Volume: 1 Pages: 1-5

    • DOI

      10.1109/scisisis50064.2020.9322759

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] A deep learning approach for surgical instruments detection in Orthopaedic surgery videos using transfer learning2020

    • Author(s)
      Hossain Belayat、Nishio Shoichi、Takafumio Hiranaka、Kobashi Syoji
    • Journal Title

      Proc. SPIE 11315, Medical Imaging 2020: Image-Guided Procedures, Robotic Interventions, and Modeling, 113151M

      Volume: 1 Pages: 1-6

    • DOI

      10.1117/12.2550670

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Surgical Phase Recognition Method with a Sequential Consistency for CAOS-AI Navigation System2020

    • Author(s)
      Nishio Shoichi、Hossain Belayat、Yagi Naomi、Nii Manabu、Hiranaka Takafumi、Kobashi Syoji
    • Journal Title

      2020 IEEE 2nd Global Conference on Life Sciences and Technologies (LifeTech)

      Volume: 1 Pages: 1-3

    • DOI

      10.1109/lifetech48969.2020.1570619203

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Workflow Recognition from Knee Surgical Videos: Role of Deep Neural Networks2019

    • Author(s)
      NISHIO Shoichi、HOSSAIN Belayat、NII Manabu、HIRANAKA Takafumi、KOBASHI Syoji
    • Journal Title

      International Symposium on Affective Science and Engineering

      Volume: ISASE2019 Issue: 0 Pages: 1-5

    • DOI

      10.5057/isase.2019-C000028

    • NAID

      130007656964

    • ISSN
      2433-5428
    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Computer-aided system for operating room nurses during knee surgery2019

    • Author(s)
      B. Hossain, S. Nishio, H. Takafumi, and S. Kobashi
    • Journal Title

      6th International Workshop on Advanced Computational Intelligence and Intelligent Informatics

      Volume: 1 Pages: 1-6

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Orthopedic surgery video analysis using object detection towards surgical procedure recognition2019

    • Author(s)
      S. Nishio, B. Hossain, N. Yagi, M. Nii, H. Takafumi, and S. Kobashi
    • Journal Title

      6th International Workshop on Advanced Computational Intelligence and Intelligent Informatics

      Volume: 1 Pages: 1-6

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Real-time Surgical Tools Recognition in Total Knee Arthroplasty Using Deep Neural Networks2018

    • Author(s)
      Hossain Moazzem、Nishio Soichi、Hiranaka Takafumi、Kobashi Syoji
    • Journal Title

      2018 Joint 7th International Conference on Informatics, Electronics & Vision (ICIEV) and 2018 2nd International Conference on Imaging, Vision & Pattern Recognition (icIVPR)

      Volume: 1 Pages: 470-474

    • DOI

      10.1109/iciev.2018.8641074

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Real-Time Orthopedic Surgery Procedure Recognition Method with Video Images from Smart Glasses Using Convolutional Neural Network2018

    • Author(s)
      Nishio Shoichi、Hossain Moazzem、Hossain Belayat、Nii Manabu、Hiranaka Takafumi、Kobashi Syoji
    • Journal Title

      2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC)

      Volume: 1 Pages: 379-384

    • DOI

      10.1109/smc.2018.00074

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed
  • [Presentation] Knee replacement surgery phase recognition with wearable camera2020

    • Author(s)
      S. Kobashi, S. Nishio, and B. Hossain
    • Organizer
      International Workshop on Advanced Image Technology 2020
    • Related Report
      2019 Annual Research Report
  • [Presentation] スマートグラスを用いた整形外科手術ナビゲーションシステム" 日本医用画像工学会, 2019 久保有輝, "人工上腕骨頭設計のための統計的形状モデル構築2019

    • Author(s)
      西尾 祥一, Moazzem Hossain , 新居 学, 平中 崇文, 小橋 昌司
    • Organizer
      2019年度SOFT関西支部学生研究発表会
    • Related Report
      2019 Annual Research Report

URL: 

Published: 2018-11-12   Modified: 2024-03-26  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi