• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Development of endoscopic treatment assistance system based on relationship modeling between recognition and action

Research Project

Project/Area Number 21K12723
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Review Section Basic Section 90130:Medical systems-related
Research InstitutionNagoya University

Principal Investigator

Oda Masahiro  名古屋大学, 情報基盤センター, 准教授 (30554810)

Co-Investigator(Kenkyū-buntansha) 古川 和宏  名古屋大学, 医学部附属病院, 病院講師 (70624310)
Project Period (FY) 2021-04-01 – 2024-03-31
Project Status Completed (Fiscal Year 2023)
Budget Amount *help
¥4,160,000 (Direct Cost: ¥3,200,000、Indirect Cost: ¥960,000)
Fiscal Year 2023: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2022: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Fiscal Year 2021: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Keywords認知と行動の関係解析 / 内視鏡支援システム / 内視鏡操作支援システム / 内視鏡操作支援ロボット
Outline of Research at the Start

医師の内視鏡操作をコンピュータで支援し自動化することで、個人の経験に依存しない治療が可能となる。医師が内視鏡操作を行う上で、視覚等による状況把握と判断を連続的に行い、それに基づいて操作を実行する。つまり状況の「認知」と「行動」が密接に連携して行われる。そのため医師の認知と行動の連携をデータドリブンで解析し、行動選択の仕組みを解明することが有効である。本研究では、(1) 医師の認知と行動を計測する枠組みの実現、(2) 認知と行動の連携のモデル化、(3) モデルを用いた認知と行動支援情報の提示及び (4) ロボットによる行動介入を通した内視鏡操作支援システムの開発を行う。

Outline of Final Research Achievements

The purpose of this study is to realize an endoscopic operation support system based on the analysis of the relationship between cognition and behavior. To achieve this, we first developed a method to measure the cognition and behavior of physicians during endoscopic operations. Subsequently, we developed a cognition-behavior linkage model that can estimate behavior from cognitive information. This model was developed using a data-driven approach with deep learning. Additionally, we developed and evaluated a system to provide support information to physicians. With the cooperation of gastroenterologists, we conducted measurements and evaluations using the system, which demonstrated the ability to present useful treatment support information. On the other hand, it became clear that further adaptation to individual differences in endoscopic operation by physicians is necessary.

Academic Significance and Societal Importance of the Research Achievements

従来の治療支援システムは、画像情報などの「認知」情報のみを使って支援情報生成を行うものが主流であった。本研究はそれだけでなく、治療操作つまり「行動」情報までも扱い、認知と行動の関連性をモデル化し治療支援システムに利用する。本研究を行う中で、治療操作を計測しデータ化する方法、形状データを解析する深層学習モデル構築を行い、その成果が国際会議でのOutstanding Paper Award受賞という形で認められた。本研究を行う中で、医師が行う治療操作には医師の個人差が強く影響し、個人差を考慮した方法の開発が必要との知見が得られた。本研究の成果は、今後の治療支援システムの高性能化に大きく貢献する。

Report

(4 results)
  • 2023 Annual Research Report   Final Research Report ( PDF )
  • 2022 Research-status Report
  • 2021 Research-status Report
  • Research Products

    (10 results)

All 2024 2023 2022 2021

All Journal Article (2 results) (of which Int'l Joint Research: 1 results,  Peer Reviewed: 2 results) Presentation (8 results) (of which Int'l Joint Research: 5 results,  Invited: 3 results)

  • [Journal Article] KST-Mixer: kinematic spatio-temporal data mixer for colon shape estimation2023

    • Author(s)
      Masahiro Oda, Kazuhiro Furukawa, Nassir Navab, Kensaku Mori
    • Journal Title

      Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization

      Volume: - Issue: 4 Pages: 1050-1056

    • DOI

      10.1080/21681163.2022.2151938

    • Related Report
      2022 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Depth Estimation from Single-shot Monocular Endoscope Image Using Image Domain Adaptation And Edge-Aware Depth Estimation2021

    • Author(s)
      Masahiro Oda, Hayato Itoh, Kiyohito Tanaka, Hirotsugu Takabatake, Masaki Mori, Hiroshi Natori, Kensaku Mori
    • Journal Title

      Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization

      Volume: 10 Issue: 3 Pages: 266-273

    • DOI

      10.1080/21681163.2021.2012835

    • Related Report
      2021 Research-status Report
    • Peer Reviewed
  • [Presentation] 最新の研究動向2023 画像セグメンテーションとMICCAI総括2024

    • Author(s)
      小田昌宏, 音丸 格, 古川 亮, 森 健策
    • Organizer
      電子情報通信学会 医用画像研究会
    • Related Report
      2023 Annual Research Report
    • Invited
  • [Presentation] 内視鏡画像AIにおける実世界を考慮したデータ生成の必要性2023

    • Author(s)
      小田昌宏
    • Organizer
      次世代内視鏡・医工連携シンポジウム
    • Related Report
      2023 Annual Research Report
    • Invited
  • [Presentation] 医療支援における画像処理研究の動向と展望2023

    • Author(s)
      小田昌宏
    • Organizer
      第29回画像センシングシンポジウム
    • Related Report
      2023 Annual Research Report
    • Invited
  • [Presentation] What is Trustworthy AI and How It Contributes in Diagnosis2023

    • Author(s)
      Masahiro Oda, Zhou Zheng, Jie Qiu, Yuichiro Hayashi, Kensaku Mori, Hirotsugu Takabatake, Masaki Mori, Hiroshi Natori
    • Organizer
      RSNA 2023
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Towards Better Laparoscopic Video Segmentation: A Class-Wise Contrastive Learning Approach with Multi-Scale Feature Extraction2023

    • Author(s)
      Luyang Zhang, Yuichiro Hayashi, Masahiro Oda, Kensaku Mori
    • Organizer
      AE-CAI JOINT MICCAI WORKSHOP 2023
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Masked Frequency Consistency for Domain-Adaptive Semantic Segmentation of Laparoscopic Images2023

    • Author(s)
      Xinkai Zhao, Yuichiro Hayashi, Masahiro Oda, Takayuki Kitasaka, Kensaku Mori
    • Organizer
      MICCAI 2023
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Multi-view Guidance for Self-supervised Monocular Depth Estimation on Laparoscopic Images via Spatio-temporal Correspondence2023

    • Author(s)
      Wenda Li, Yuichiro Hayashi, Masahiro Oda, Takayuki Kitasaka, Kazunari Misawa, Kensaku Mori
    • Organizer
      MICCAI 2023
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] KST-Mixer: Kinematic Spatio-Temporal Data Mixer For Colon Shape Estimation2022

    • Author(s)
      Masahiro Oda, Kazuhiro Furukawa, Nassir Navab, Kensaku Mori
    • Organizer
      Joint MICCAI workshop 2022, AE-CAI/CARE/OR2.0, 25th International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI2022)
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research

URL: 

Published: 2021-04-28   Modified: 2025-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi