• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

2D-3D Reconstruction for internal organs using Deep Learning Techniques

Research Project

Project/Area Number 20K20167
Research Category

Grant-in-Aid for Early-Career Scientists

Allocation TypeMulti-year Fund
Review Section Basic Section 90110:Biomedical engineering-related
Research InstitutionOsaka University

Principal Investigator

Wu Shuqiong  大阪大学, 産業科学研究所, 助教 (30775763)

Project Period (FY) 2020-04-01 – 2024-03-31
Project Status Completed (Fiscal Year 2023)
Budget Amount *help
¥4,290,000 (Direct Cost: ¥3,300,000、Indirect Cost: ¥990,000)
Fiscal Year 2022: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2021: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2020: ¥1,950,000 (Direct Cost: ¥1,500,000、Indirect Cost: ¥450,000)
Keywords3D reconstruction / machine learning / X-ray / CT / deformation estimation / 2D-3D reconstruction / Deep learning / GAN / CT reconstrcution / X2CTGAN / Deformation estimation / 2D-3D registration / 3D organ reconstruction / deep Learning / CT images / radiotherapy
Outline of Research at the Start

In this study, we will ① create a statistical model from real data, and augment 2D-3D data from the model ② train neural networks using both real and
augmented data ③ evaluate the trained networks. Using this approach, precise intraoperative 3D model can be reconstructed from single 2D image.

Outline of Final Research Achievements

In this study, we aim to develop a high-precision technique for reconstructing three-dimensional structures from two-dimensional images. To improve the accuracy of three-dimensional reconstruction, we conducted researches in two directions: deep-learning-based methods and methods based on Sparse-View. We analyzed the weaknesses of an existing learning model X2CTGAN and improved the reconstruction performance by adding new projection constraints and a rotational transformation, resulting in an increase in the SSIM score from approximately 0.6 to 0.8. We will summary these results and submit them to an international conference.
Meanwhile, we also researched methods to reconstruct three-dimensional structures from Sparse to Dense views, and successfully reconstructed in the Z-direction of CT images. The results have already been published as a journal paper.

Academic Significance and Societal Importance of the Research Achievements

本研究では、二次元から三次元を再構築する手法を提案した。この手法は、さまざまな場面で活用できると考えられる。例えば、X線画像からCTの再構築、シングルビューからマルチビューの再構築、RGB画像から三次元動作の再構築などに役立つ。さらに、提案したデータ拡張手法により、学習データが不足していても、効果的に学習ができ、汎化性能も向上するようになった。こうしたデータ拡張の手法は、他の研究テーマでも適用可能である。本研究では、基礎技術の研究開発が進み、さまざまなアプリケーションにも適用できると考えられ、それによって大きな社会的な意義があると考えられる。

Report

(5 results)
  • 2023 Annual Research Report   Final Research Report ( PDF )
  • 2022 Research-status Report
  • 2021 Research-status Report
  • 2020 Research-status Report
  • Research Products

    (3 results)

All 2022 2021

All Journal Article (1 results) (of which Int'l Joint Research: 1 results,  Peer Reviewed: 1 results,  Open Access: 1 results) Presentation (2 results) (of which Invited: 1 results)

  • [Journal Article] Computed Tomography slice interpolation in the longitudinal direction based on deep learning techniques: To reduce slice thickness or slice increment without dose increase2022

    • Author(s)
      Wu Shuqiong、Nakao Megumi、Imanishi Keiho、Nakamura Mitsuhiro、Mizowaki Takashi、Matsuda Tetsuya
    • Journal Title

      PLOS ONE

      Volume: 17 Issue: 12 Pages: 1-18

    • DOI

      10.1371/journal.pone.0279005

    • Related Report
      2022 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Presentation] Facilitating computed-tomography-based diagnosis using deep learning techniques2022

    • Author(s)
      Shuqiong Wu
    • Organizer
      The 25th SANKEN International Symposium
    • Related Report
      2021 Research-status Report
  • [Presentation] Super-resolution and from-2D-to-3D CT image reconstruction based on machine learning techniques2021

    • Author(s)
      Shuqiong Wu
    • Organizer
      第60回日本生体医工学会大会
    • Related Report
      2020 Research-status Report
    • Invited

URL: 

Published: 2020-04-28   Modified: 2025-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi