• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Brain-shift modeling with 3D feature point mapping in preoperative and postoperative DICOM

Research Project

Project/Area Number 20K12053
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Review Section Basic Section 62010:Life, health and medical informatics-related
Research InstitutionOsaka Electro-Communication University

Principal Investigator

Watanabe Kaoru  大阪電気通信大学, 総合情報学部, 教授 (50298832)

Co-Investigator(Kenkyū-buntansha) 沼田 哲史  大阪電気通信大学, 総合情報学部, 准教授 (20411481)
陳 延偉  立命館大学, 情報理工学部, 教授 (60236841)
上善 恒雄  大阪電気通信大学, 総合情報学部, 教授 (70388396)
埜中 正博  関西医科大学, 医学部, 教授 (90577462)
Project Period (FY) 2020-04-01 – 2024-03-31
Project Status Completed (Fiscal Year 2023)
Budget Amount *help
¥4,290,000 (Direct Cost: ¥3,300,000、Indirect Cost: ¥990,000)
Fiscal Year 2022: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Fiscal Year 2021: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Fiscal Year 2020: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Keywordsブレインシフト / 臓器変形 / OpenCV / 特徴点 / メタバース空間 / SLAM / 脳モデリング / 手術ナビゲータ / DICOM特徴点
Outline of Research at the Start

本研究の概要は以下の通りである。①同一患者のCTとMRIのDICOM(Digital Imaging and COmmunications in Medicine)を領域分割する。②CTやMRIの明瞭領域データを教師としてCTやMRIのDICOMを強化学習し、正確に領域分割(濃淡値の正規化・明瞭化)する。また、3D Slicerで手術前後の領域分割したDICOMの大きさ・位置姿勢を合わせる。③DICOMの大きさ・位置姿勢を合わせ、手術前後の膨大な3D特徴点対応を抽出する。④3D特徴点対応を利用してDICOMボクセルの物理パラメータを同定し、脳の変形モデリングを作成する。

Outline of Final Research Achievements

We constructed software to detect intraoperative brain shift with high accuracy by extracting 3D feature points and their corresponding points from preoperative and postoperative DICOM data. The software automatically detects intraoperative brain shift by extracting areas where CT and MRI are poor at using supervised machine learning and superimposing the corresponding 3D feature points from pre- and postoperative DICOM data. Also, a new type of coronavirus infection occurred at the beginning of the research, causing the university and hospital to be closed for an extended period of time. A new type of coronavirus infection occurred at the beginning of the study, causing the university and hospital to be closed for an extended period of time. In other words, what had previously been done in person could now only be done remotely. In this study, such medical DX was also incorporated into the research, creating a surgical metaverse space where doctors could also gather remotely.

Academic Significance and Societal Importance of the Research Achievements

病院では、多数のDICOMがCTやMRIで撮像・保存されている。そこで、CTやMRIが個々に得意な領域(悪性腫瘍・骨・動脈瘤・神経・血管など)を撮像したDICOMを重畳させる。次に、術前術後のDICOMペア間で3D特徴点マッピングを抽出する。これより、外科手術ナビゲーションにおいて医師に術中の臓器変形が提示できる可能性が開ける。医師は患者の手術が正確に実施でき、患者の術後の生活の質を高めることができる。また、新型コロナウイルス感染症よりDXの重要性が認識された。そこで、CTやMRI由来のDICOMを合し、それを遠隔カンファレンスで医師が利用できるような外科手術用のメタバース空間を構築した。

Report

(5 results)
  • 2023 Annual Research Report   Final Research Report ( PDF )
  • 2022 Research-status Report
  • 2021 Research-status Report
  • 2020 Research-status Report
  • Research Products

    (8 results)

All 2024 2023 2022 2021 2020

All Journal Article (8 results) (of which Peer Reviewed: 8 results,  Open Access: 8 results)

  • [Journal Article] Comparison of Four Automatic Detection Algorithm with Initial Parameters for DICOM Artificial Brain Shift2024

    • Author(s)
      Kaoru Watanabe, Takumi Mori, Hiroshi Noborio, Masanao Koeda
    • Journal Title

      International Journal of Pharma Medicine and Biological Sciences

      Volume: 13

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Parameter Tuning in Automatic Detection Algorithm for Detecting Artificial Brain Shift2024

    • Author(s)
      Kaoru Watanabe, Takumi Mori, Hiroshi Noborio, Masanao Koeda
    • Journal Title

      2024 6th International Conference on Intelligent Medicine and Image Processing

      Volume: 6

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] System to Check Organs, Malignant Tumors, Blood Vessel Groups, and Scalpel Paths in DICOM with a 3D Stereo Immersive Sensory HMD2023

    • Author(s)
      Takahiro Kunii, Kaoru Watanabe, Michiru Mizoguchi, Hiroshi Noborio
    • Journal Title

      In. Kurosu M. (eds) Human-Computer Interaction. Interaction Techniques and Novel Applications. HCII 2023, LNCS

      Volume: 印刷中

    • Related Report
      2022 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Algorithm for Automatic Brain-Shift Detection Using the Distance Between Feature Descriptors2022

    • Author(s)
      Mori Takumi、Nonaka Masahiro、Kunii Takahiro、Koeda Masanao、Watanabe Kaoru、Noborio Hiroshi
    • Journal Title

      In. Kurosu M. (eds) Human-Computer Interaction. Interaction Techniques and Novel Applications. HCII 2022, LNCS

      Volume: 13303 Pages: 376-387

    • DOI

      10.1007/978-3-031-05409-9_29

    • ISBN
      9783031054082, 9783031054099
    • Related Report
      2022 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Development of an Algorithm to Artificially Create Virtual Brain Deformations for Brain DICOM2022

    • Author(s)
      Mori Takumi、Nonaka Masahiro、Kunii Takahiro、Koeda Masanao、Noborio Hiroshi
    • Journal Title

      In. Kurosu M. (eds) Human-Computer Interaction. Interaction Techniques and Novel Applications. HCII 2022, LNCS

      Volume: 13303 Pages: 388-402

    • DOI

      10.1007/978-3-031-05409-9_30

    • ISBN
      9783031054082, 9783031054099
    • Related Report
      2022 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Investigation of the Hashing Algorithm Extension of Depth Image Matching for Liver Surgery2021

    • Author(s)
      Satoshi Numata, Masanao Koeda, Katsuhiko Onishi, Kaoru Watanabe, Hiroshi Noborio
    • Journal Title

      Human-Computer Interaction. Interaction Techniques and Novel Applications. HCII 2021. Lecture Notes in Computer Science, Springer International Publishing

      Volume: vol.12763 Pages: 615-624

    • DOI

      10.1007/978-3-030-78465-2_44

    • ISBN
      9783030784645, 9783030784652
    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] A Hashing Algorithm of Depth Image Matching for Liver Surgery2020

    • Author(s)
      Numata Satoshi、Koeda Masanao、Onishi Katsuhiko、Watanabe Kaoru、Noborio Hiroshi
    • Journal Title

      Lecture Notes in Computer Science, Springer

      Volume: 12181 Pages: 625-634

    • DOI

      10.1007/978-3-030-49059-1_46

    • ISBN
      9783030490584, 9783030490591
    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Deadlock-Free and Collision-Free Liver Surgical Navigation by Switching Potential-Based and Sensor-Based Functions2020

    • Author(s)
      Noborio Hiroshi、Kawai Kiyomi、Watanabe Kaoru、Tachibana Katsunori、Kunii Takahiro、Mizushino Kiminori
    • Journal Title

      Lecture Notes in Computer Science, Springer

      Volume: 12183 Pages: 604-622

    • DOI

      10.1007/978-3-030-49065-2_42

    • ISBN
      9783030490645, 9783030490652
    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access

URL: 

Published: 2020-04-28   Modified: 2025-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi