• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Decision support for total hip arthroplasty surgery by integration of deep learning, simulations, and statistical models

Research Project

Project/Area Number 19H01176
Research Category

Grant-in-Aid for Scientific Research (A)

Allocation TypeSingle-year Grants
Section一般
Review Section Medium-sized Section 90:Biomedical engineering and related fields
Research InstitutionNara Institute of Science and Technology

Principal Investigator

SATO Yoshinobu  奈良先端科学技術大学院大学, 先端科学技術研究科, 教授 (70243219)

Co-Investigator(Kenkyū-buntansha) 大竹 義人  奈良先端科学技術大学院大学, 先端科学技術研究科, 准教授 (80349563)
SOUFI MAZEN  奈良先端科学技術大学院大学, 先端科学技術研究科, 助教 (80823525)
菅野 伸彦  大阪大学, 大学院医学系研究科, 寄附講座教授 (70273620)
高尾 正樹  大阪大学, 大学院医学系研究科, 講師 (30528253)
上村 圭亮  大阪大学, 大学院医学系研究科, 助教 (70871367)
三木 秀宣  独立行政法人国立病院機構大阪医療センター(臨床研究センター), その他部局等, 機関長・部門長クラス (10335391)
鍵山 善之  山梨大学, 大学院総合研究部, 准教授 (30506506)
高木 周  東京大学, 大学院工学系研究科(工学部), 教授 (30272371)
田中 正夫  香川高等専門学校, 校長, 校長 (40163571)
日朝 祐太  奈良先端科学技術大学院大学, 先端科学技術研究科, 助教 (00848997)
Project Period (FY) 2019-04-01 – 2023-03-31
Project Status Completed (Fiscal Year 2022)
Budget Amount *help
¥45,240,000 (Direct Cost: ¥34,800,000、Indirect Cost: ¥10,440,000)
Fiscal Year 2022: ¥9,620,000 (Direct Cost: ¥7,400,000、Indirect Cost: ¥2,220,000)
Fiscal Year 2021: ¥10,530,000 (Direct Cost: ¥8,100,000、Indirect Cost: ¥2,430,000)
Fiscal Year 2020: ¥10,530,000 (Direct Cost: ¥8,100,000、Indirect Cost: ¥2,430,000)
Fiscal Year 2019: ¥14,560,000 (Direct Cost: ¥11,200,000、Indirect Cost: ¥3,360,000)
Keywords変形性股関節症 / 人工関節 / 筋骨格 / 手術DX / 手術AI / CT / 筋肉セグメンテーション / 筋骨格セグメンテーション / 人工股関節 / 筋骨格統計形状モデル / 疾患進行モデル / 筋肉量 / 骨密度 / 人工知能 / 自動手術計画 / 手術シミュレーション / 深層学習 / 筋萎縮 / 筋変性 / 関節可動域 / 金属アーチファクト削減
Outline of Research at the Start

人工股関節手術を熟知した人工知能システムを開発する。術前術後の患者画像、手術データ、術前診断・術後長期経過観察等の診療情報を含む過去症例(2000例以上)の大規模データベース(DB)から、深層学習を用いて手術前後の患者筋骨格解剖DBを自動構築する。解剖の個体差、年齢や術前病態の違いを考慮した疾患・手術の統計数理モデルを用いて、術前の患者データから、解剖復元、疾患進行に伴う筋萎縮や骨変形の予測、各進行段階での網羅的手術シミュレーションによる術後関節機能評価・経過予測等を行い、手術時期決定、手術計画最適化等の意思決定を支援する。

Outline of Final Research Achievements

We have developed a highly accurate automatic recognition AI system for musculoskeletal structures (especially, individual muscles) from pre- and postoperative medical images. We developed methods to construct statistical models of patients (diseases) and surgeries using detailed musculoskeletal data including individual muscles of each patient from a large database including pre- and postoperative images, surgical information, and motor function tests of hip joint surgery patients. We examined methods for optimal surgical planning and prediction of patient motor function using patient musculoskeletal data, statistical models based on such data, and biomechanical simulations for each patient. These developments have opened up the possibility of optimizing diagnosis/treatment not only for patients with hip joint disease, but also for a wide range of patients by fully utilizing information on each patient's individual muscles.

Academic Significance and Societal Importance of the Research Achievements

CT画像とX線画像から、解剖学書水準の詳細さで個別筋肉と骨格の詳細情報(形状/筋肉量/筋肉密度分布/骨密度分布等)を、高精度に自動認識するAIを開発した点は、人工股関節患者/手術の解析のみならず、広く人体に関する学術研究、および、社会(医療、スポーツ)に対しての新たな可能性を開拓する成果である。個人の詳細な筋肉データを高精度かつ簡便に取得できるシステムを世界で初めて開発できたと考えている。人工股関節患者の大規模データベースと合わせて、これら患者の筋骨格のデジタル化は、今後の人工関節の開発、手術AI、手術ロボット、リハビリロボット開発等にも活用できると考える。

Report

(6 results)
  • 2022 Annual Research Report   Final Research Report ( PDF )
  • 2021 Annual Research Report
  • 2020 Annual Research Report
  • 2019 Comments on the Screening Results   Annual Research Report
  • Research Products

    (38 results)

All 2023 2022 2021 2020 2019

All Journal Article (15 results) (of which Int'l Joint Research: 3 results,  Peer Reviewed: 14 results,  Open Access: 6 results) Presentation (22 results) (of which Int'l Joint Research: 9 results,  Invited: 7 results) Patent(Industrial Property Rights) (1 results)

  • [Journal Article] Development of a system to assess the two- and three-dimensional bone mineral density of the lumbar vertebrae from clinical quantitative CT images2023

    • Author(s)
      Uemura K, Fujimori T, Otake Y, Shimomoto Y, Kono S, Takashima K, Hamada H, Takenaka S, Kaito T, Sato Y, Sugano N, Okada S.
    • Journal Title

      Arch Osteoporos.

      Volume: 18 Issue: 1 Pages: 22-22

    • DOI

      10.1007/s11657-023-01216-y

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed
  • [Journal Article] The effect of patient positioning on measurements of bone mineral density of the proximal femur: a simulation study using computed tomographic images2023

    • Author(s)
      Uemura K, Takao M, Otake Y, Takashima K, Hamada H, Ando W, Sato Y, Sugano N.
    • Journal Title

      Arch Osteoporos.

      Volume: 18 Issue: 1 Pages: 35-35

    • DOI

      10.1007/s11657-023-01225-x

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 4D-foot analysis on effect of arch support on ankle, subtalar, and talonavicular joint kinematics2023

    • Author(s)
      Miyamoto Takuma、Otake Yoshito、Nakao Satoko、Kurokawa Hiroaki、Kosugi Shinichi、Taniguchi Akira、Soufi Mazen、Sato Yoshinobu、Tanaka Yasuhito
    • Journal Title

      Journal of Orthopaedic Science

      Volume: in press Issue: 6 Pages: 1337-1344

    • DOI

      10.1016/j.jos.2022.10.009

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Rotational-motion measurement of the sacroiliac joint using upright MRI scanning and intensity-based registration: is there a sex difference?.2023

    • Author(s)
      Tani T, Takao M, Soufi M, Otake Y, Fukuda N, Hamada H, Uemura K, Sato Y, Sugano N.
    • Journal Title

      International Journal of Computer Assisted Radiology and Surgery.

      Volume: 18(1) Issue: 1 Pages: 79-84

    • DOI

      10.1007/s11548-022-02806-w

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Decomposition of Musculoskeletal Structures from Radiography using an Improved CycleGAN Framework2022

    • Author(s)
      Nakanishi Naoki、Otake Yoshito、Hiasa Yuta、Gu Yi、Uemura Keisuke、Takao Masaki、Sugano Nobuhiko、Sato Yoshinobu
    • Journal Title

      Scientific reports. (accepted for publication)

      Volume: -

    • DOI

      10.21203/rs.3.rs-2011568/v1

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Artificial intelligence-based volumetric analysis of muscle atrophy and fatty degeneration in patients with hip osteoarthritis and its correlation with health-related quality of life2022

    • Author(s)
      Iwasa Makoto、Takao Masaki、Soufi Mazen、Uemura Keisuke、Otake Yoshito、Hamada Hidetoshi、Sato Yoshinobu、Sugano Nobuhiko、Okada Seiji
    • Journal Title

      International Journal of Computer Assisted Radiology and Surgery

      Volume: 18 Issue: 1 Pages: 71-78

    • DOI

      10.1007/s11548-022-02797-8

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Development of an open-source measurement system to assess the areal bone mineral density of the proximal femur from clinical CT images2022

    • Author(s)
      Uemura, K., Otake, Y., Takao, M., Makino, H., Soufi, M., Iwasa, M., Sugano, N. and Sato, Y.
    • Journal Title

      Archives of Osteoporosis

      Volume: 17(1) Issue: 1 Pages: 17-17

    • DOI

      10.1007/s11657-022-01063-3

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Automated segmentation of an intensity calibration phantom in clinical CT images using a convolutional neural network.2021

    • Author(s)
      Uemura, K., Otake, Y., Takao, M., Soufi, M., Kawasaki, A., Sugano, N., & Sato, Y.
    • Journal Title

      International journal of computer assisted radiology and surgery

      Volume: - Issue: 11 Pages: 1855-1864

    • DOI

      10.1007/s11548-021-02345-w

    • Related Report
      2021 Annual Research Report 2020 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 2D-3D reconstruction of distal forearm bone from actual X-ray images of the wrist using convolutional neural networks2021

    • Author(s)
      Shiode Ryoya、Kabashima Mototaka、Hiasa Yuta、Oka Kunihiro、Murase Tsuyoshi、Sato Yoshinobu、Otake Yoshito
    • Journal Title

      Scientific Reports

      Volume: 11 Issue: 1 Pages: 15249-15249

    • DOI

      10.1038/s41598-021-94634-2

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Automated Muscle Segmentation from Clinical CT Using Bayesian U-Net for Personalized Musculoskeletal Modeling2020

    • Author(s)
      Hiasa Yuta、Otake Yoshito、Takao Masaki、Ogawa Takeshi、Sugano Nobuhiko、Sato Yoshinobu
    • Journal Title

      IEEE Transactions on Medical Imaging

      Volume: 39 Issue: 4 Pages: 1030-1040

    • DOI

      10.1109/tmi.2019.2940555

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Bayesian segmentation of hip and thigh muscles in metal artifact-contaminated CT using convolutional neural network-enhanced normalized metal artifact reductio2020

    • Author(s)
      Sakamoto M, Hiasa Y, Otake Y, Takao M, Suzuki Y, Sugano N, Sato Y.
    • Journal Title

      Journal of Signal Processing Systems

      Volume: 92 Issue: 3 Pages: 335-344

    • DOI

      10.1007/s11265-019-01507-z

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Posterior Pelvic Tilt From Supine to Standing in Patients With Symptomatic Developmental Dysplasia of the Hip2020

    • Author(s)
      Tani T, Takao M, Uemura K, Otake Y, Hamada H, Ando W, Sato Y, Sugano N.
    • Journal Title

      Journal of Orthopaedic Research

      Volume: 38(3) Issue: 3 Pages: 578-587

    • DOI

      10.1002/jor.24484

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Fully automatic estimation of pelvic sagittal inclination from anterior-posterior radiography image using deep learning framework2020

    • Author(s)
      Jodeiri A, Zoroofi RA, Hiasa Y, Takao M, Sugano N, Yoshinobu S, Otake Y.
    • Journal Title

      Computer Methods and Programs in Biomedicine

      Volume: 184 Pages: 105282-105282

    • DOI

      10.1016/j.cmpb.2019.105282

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Translating Simulated Images to Real Radiograph using Generative Adversarial Networks: Estimation of Pelvic Tilt from Real Images2019

    • Author(s)
      日朝 祐太、大竹 義人、松岡 拓未、高尾 正樹、菅野 伸彦、佐藤 嘉伸
    • Journal Title

      Medical Imaging Technology

      Volume: 37 Issue: 3 Pages: 125-129

    • DOI

      10.11409/mit.37.125

    • NAID

      130007662439

    • ISSN
      0288-450X, 2185-3193
    • Year and Date
      2019-05-25
    • Related Report
      2019 Annual Research Report
  • [Journal Article] Validation study of the CT-based cross-sectional evaluation of muscular atrophy and fatty degeneration around the pelvis and the femur2019

    • Author(s)
      Ogawa Takeshi、Takao Masaki、Otake Yoshito、Yokota Futoshi、Hamada Hidetoshi、Sakai Takashi、Sato Yoshinobu、Sugano Nobuhiko
    • Journal Title

      Journal of Orthopaedic Science

      Volume: - Issue: 1 Pages: 139-144

    • DOI

      10.1016/j.jos.2019.02.004

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Presentation] Musculoskeletal Medical Image AI,2022

    • Author(s)
      Sato Yoshinobu
    • Organizer
      Asian Conference of Computer Aided Surgery (ACCAS) 2022,
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Musculoskeletal Medical Image Analysis and its Applications,2022

    • Author(s)
      Sato Yoshinobu
    • Organizer
      Medical Imaging and Augmented Reality (MIAR) 2022,
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Musculoskeletal AI for CAD,2022

    • Author(s)
      Sato Yoshinobu
    • Organizer
      24th International Conference on Computer-Aided Diagnosis and Artificial Intelligence (CAD-AI) - CARS 2022,
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] BMD-GAN: Bone mineral density estimation using x-ray image decomposition into projections of bone-segmented quantitative computed tomography using hierarchical learning.2022

    • Author(s)
      Gu Y, Otake Y, Uemura K, Soufi M, Takao M, Sugano N, Sato Y.
    • Organizer
      InMedical Image Computing and Computer Assisted Intervention MICCAI 2022:
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Automatic Multi-Measure Classification of Hip Osteoarthritis Based on Digitally-Reconstructed Radiographs using Deep Learning.2022

    • Author(s)
      Masuda M, Soufi M, Otake Y, Uemura K, Takao M, Sugano N, Sato Y.
    • Organizer
      IEICE Technical Report; IEICE Tech. Rep..
    • Related Report
      2022 Annual Research Report
  • [Presentation] Virtual Standing Position Transformation from Supine CT using Whole-body Upright CT Scanner. IEICE Technical Report;2022

    • Author(s)
      Hakotani T, Otake Y, Soufi M, Hashimoto M, Yamada Y, Yamada M, Yokoyama Y, Uemura K, Takao M, Sugano N, Jinzaki M
    • Organizer
      IEICE Technical Report; IEICE Tech. Rep..
    • Related Report
      2022 Annual Research Report
  • [Presentation] Patient-specific musculoskeletal simulation using an elastic volume simulator VIPER and medical image-based modeling.2022

    • Author(s)
      Ino J, Otake Y, Soufi M, Uemura K, Takao M, Sugano N, Sato Y.
    • Organizer
      IEICE Technical Report; IEICE Tech. Rep..
    • Related Report
      2022 Annual Research Report
  • [Presentation] Segmentation of musculoskeletal structures in supine and upright CTs towards quantitative analysis of musculoskeletal deformation in standing position.2022

    • Author(s)
      Hakotani T, Otake Y, Soufi M, Hashimoto M, Yamada Y, Yamada M, Yokoyama Y, Uemura K, Takao M, Sugano N, Jinzaki M.
    • Organizer
      IEICE Technical Report; IEICE Tech. Rep..
    • Related Report
      2022 Annual Research Report
  • [Presentation] Development of Automated Pre-operative Planning System for Cup in Total Hip Arthroplasty Using Deep Learning Technique2022

    • Author(s)
      Keto SHIBUYA, Yoshiyuki KAGIYAMA, Fuga YAJIMA, Shun INOUE, Yoshito OTAKE, Masaki TAKAO, Nobuhiko SUGANO and Yoshinobu SATO
    • Organizer
      18th Asian Conference on Computer Aided Surgery 2022 (ACCAS2022)
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] CT画像における筋骨格の自動認識2022

    • Author(s)
      佐藤嘉伸、大竹義人、Mazen Soufi、上村圭亮、高尾正樹、菅野伸彦
    • Organizer
      第29回日本CT検診学会学術集会
    • Related Report
      2021 Annual Research Report
    • Invited
  • [Presentation] Musculoskeletal Medical Image Analysis and its Applications, Foresight Advanced Materials for Biotechnology and Precision Health and Medicine with AI2021

    • Author(s)
      Yoshinobu Sato, Yoshito Otake, Yuta Hiasa, Masaki Takao, Nobuhiko Sugano
    • Organizer
      Japan-Taiwan Symposium
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] 4D-Foot: A Fully Automated Pipeline of Four-Dimensional Analysis of the Foot Bones Using Bi-plane X-Ray Video and CT.2021

    • Author(s)
      Mizoe S, Otake Y, Miyamoto T, Soufi M, Nakao S, Tanaka Y, Sato Y.
    • Organizer
      InMedical Image Computing and Computer Assisted Intervention-MICCAI 2021
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Deep learning in musculoskeletal image analysis: Big data analysis and cross-modality adaptation2020

    • Author(s)
      Yoshinobu Sato
    • Organizer
      2020 Annual CITI Symposium Institute of Medical Robotics
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] AIを活用した計算解剖学と手術データサイエンス2020

    • Author(s)
      佐藤 嘉伸, 大竹 義人, 日朝 祐太, 上村 圭亮, 高尾 正樹, 菅野 伸彦
    • Organizer
      第35回日本整形外科学会基礎学術集会、基礎研究に裏づけられた臨床応用「外科手術支援ロボットの開発と整形外科臨床への導入」
    • Related Report
      2020 Annual Research Report
    • Invited
  • [Presentation] Statistical Analysis of Sacral Bone Density using a CNN-based Atlas Creation on a Large-scale CT database2020

    • Author(s)
      Akihiro Kawasaki, Yoshito Otake, Keisuke Uemura, Masaki Takao, Nobuhiko Sugano, Yoshinobu Sato
    • Organizer
      International Society for Computer Assisted Orthopaedic Surgery
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] THA術前の股関節周囲筋萎縮及び変性と術後早期身体機能との関連2020

    • Author(s)
      岩佐 諦、高尾 正樹、大竹 義人、濱田 英敏、安藤 渉、高木 啓至、佐藤 嘉伸、菅野 伸彦
    • Organizer
      第47回日本股関節学会学術集会
    • Related Report
      2020 Annual Research Report
  • [Presentation] 運動器の多元計算解剖学2020

    • Author(s)
      佐藤嘉伸
    • Organizer
      第59回日本生体医工学会大会
    • Related Report
      2020 Annual Research Report
  • [Presentation] Bayesian U-netを用いた股関節疾患症例CT画像からの三次元骨形状の抽出2020

    • Author(s)
      槇野大樹、大竹義人、上村圭亮、高尾正樹、菅野伸彦、佐藤嘉伸
    • Organizer
      医用画像研究会
    • Related Report
      2020 Annual Research Report
  • [Presentation] Bayesian U-netを用いた股関節形成不全症例の筋萎縮の評価2020

    • Author(s)
      上村圭亮、大竹義人、岡本昌士、徳永邦彦、高尾正樹、菅野伸彦、佐藤嘉伸
    • Organizer
      第29回コンピュータ外科学会大会
    • Related Report
      2020 Annual Research Report
  • [Presentation] Artifical intelligenceを用いた変形性股関節症患者の股関節周囲筋評価2020

    • Author(s)
      岩佐諦、高尾正樹、大竹義人、高木啓至、濱田英敏、安藤渉、佐藤嘉伸、菅野伸彦
    • Organizer
      第29回コンピュータ外科学会大会
    • Related Report
      2020 Annual Research Report
  • [Presentation] 立位MRI装置を用いた臥位から立位の男女別仙腸関節動態の検討2020

    • Author(s)
      谷哲郎、高尾正樹、Soufi Mazen、濱田英敏、安藤渉、大竹義人、佐藤嘉伸、菅野英彦
    • Organizer
      第29回コンピュータ外科学会大会
    • Related Report
      2020 Annual Research Report
  • [Presentation] CycleGAN を用いた単純 X 線画像からの下肢筋骨格領域抽出の初期検討2019

    • Author(s)
      中西直樹, 日朝祐太, 大竹義人, 高尾正樹, 菅野伸彦, 佐藤嘉伸
    • Organizer
      研究報告コンピュータビジョンとイメージメディア
    • Related Report
      2019 Annual Research Report
  • [Patent(Industrial Property Rights)] プログラム、情報処理方法、及び情報処理装置2022

    • Inventor(s)
      佐藤嘉伸、大竹義人、谷 懿、スーフィー マーゼン 他
    • Industrial Property Rights Holder
      佐藤嘉伸、大竹義人、谷 懿、スーフィー マーゼン 他
    • Industrial Property Rights Type
      特許
    • Industrial Property Number
      2022-083271
    • Filing Date
      2022
    • Related Report
      2022 Annual Research Report

URL: 

Published: 2019-04-18   Modified: 2024-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi