Real-time volumetric image generation based on CT deformation driven by simultaneous monitoring of internal landmarks and object surface

• Project/Area Number: 18K19887
• Research Category: Grant-in-Aid for Challenging Research (Exploratory)
• Allocation Type: Multi-year Fund
• Review Section: Medium-sized Section 90:Biomedical engineering and related fields
• Research Institution: Hokkaido University
• Principal Investigator: Miyamoto Naoki 北海道大学, 工学研究院, 准教授 (00552879)
• Co-Investigator(Kenkyū-buntansha): 高尾 聖心 北海道大学, 工学研究院, 准教授 (10614216) ; 富岡 智 北海道大学, 工学研究院, 教授 (40237110) ; 梅垣 菊男 北海道大学, 工学研究院, 特任教授 (40643193) ; 清水 伸一 北海道大学, 医学研究院, 教授 (50463724)
• Project Period (FY): 2018-06-29 – 2021-03-31
• Project Status: Completed (Fiscal Year 2020)
• Budget Amount: ¥6,370,000 (Direct Cost: ¥4,900,000、Indirect Cost: ¥1,470,000); Fiscal Year 2020: ¥2,080,000 (Direct Cost: ¥1,600,000、Indirect Cost: ¥480,000); Fiscal Year 2019: ¥2,210,000 (Direct Cost: ¥1,700,000、Indirect Cost: ¥510,000); Fiscal Year 2018: ¥2,080,000 (Direct Cost: ¥1,600,000、Indirect Cost: ¥480,000)
• Keywords: ボリュームイメージング / リアルタイム / 体内ランドマーク / 変形レジストレーション / 医学物理 / 画像誘導放射線治療 / 3次元イメージング / リアルタイムイメージング / ボリュームデータ / CT / 再構成

Outline of Final Research Achievements

We developed a method to reconstruct 3D in vivo information in real time by using the positional information of biological surfaces and in vivo markers through modeling of in vivo deformations using pre-learning data. Using a patient's 4DCT acquired for radiotherapy, we evaluated the image synthesis accuracy of the in vivo reconstruction method developed in this project as the normalized root mean square error (NRMSE) between the ground truth image and the synthesized image. The image synthesis accuracies for the training data and the validation with motion beyond the training data were about 7% and 11%, respectively. In addition, the accuracy of tumor location evaluation was less than 1 mm. These results suggest that the accuracy is sufficient for application in radiotherapy.

Academic Significance and Societal Importance of the Research Achievements

本研究の成果は、生体内部の3次元情報をリアルタイムで得ることの可能性を示唆しており、医療、生命科学研究において大きなインパクトをもたらすと期待できる。例えば放射線治療において精度低下の要因となっていたがんの呼吸性移動および変形に柔軟に対応することが可能となり、従来は放射線治療を避けていた部位においても治療が可能となるなど、がん治療における大きなブレークスルーとなると考えられる。また、本手法は理論上マウスレベルのサイズまで応用可能であり、例えば運動と治療薬の効果（腫瘍縮小など）の関係を解析するなど、in vivo イメージングの新しいモダリティの創出につながる可能性がある。

Research Products

• [Journal Article] Clinical practice vs. state-of-the-art research and future visions: Report on the 4D treatment planning workshop for particle therapy - Edition 2018 and 2019 (2021)
  • Author(s): Katarzyna Czerska，Frank Emert，Renata Kopec，Katja Langen，Jamie R McClelland，Arturs Meijers，Naoki Miyamoto，Marco Riboldi，Shinichi Shimizu，Toshiyuki Terunuma，Wei Zou，Antje Knopf，Antoni Rucinski
  • Journal Title: Physica Medical Volume: 82 Pages: 54-63
  • DOI: 10.1016/j.ejmp.2020.12.013
  • Peer Reviewed / Int'l Joint Research
• [Journal Article] The impact of dose delivery time on biological effectiveness in proton irradiation with various biological parameters (2020)
  • Author(s): Kasamatsu Koki、Matsuura Taeko、Tanaka Sodai、Takao Seishin、Miyamoto Naoki、Nam Jin‐Min、Shirato Hiroki、Shimizu Shinichi、Umegaki Kikuo
  • Journal Title: Medical Physics Volume: 47 Issue: 9 Pages: 4644-4655
  • DOI: 10.1002/mp.14381
  • Peer Reviewed / Open Access
• [Journal Article] Dynamic gating window technique for the reduction of dosimetric error in respiratory-gated spot-scanning particle therapy: An initial phantom study using patient tumor trajectory data (2020)
  • Author(s): Naoki Miyamoto, Kouhei Yokokawa, Seishin Takao, Taeko Matsuura, Sodai Tanaka, Shinichi Shimizu, Hiroki Shirato, Kikuo Umegaki
  • Journal Title: Journal of Applied Clinical Medical Physics Volume: 1 Issue: 4 Pages: 1-9
  • DOI: 10.1002/acm2.12832
  • Peer Reviewed / Open Access
• [Journal Article] Quantitative evaluation of image recognition performance of fiducial markers in real-time tumor-tracking radiation therapy (2019)
  • Author(s): Naoki Miyamoto, Kenichiro Maeda, Daisuke Abo, Ryo Morita, Seishin Takao, Taeko Matsuura, Norio Katoh, Kikuo Umegaki, Shinichi Shimizu, Hiroki Shirato
  • Journal Title: Physica Medica Volume: 65 Pages: 33-39
  • DOI: 10.1016/j.ejmp.2019.08.004
  • NAID: 120006890334
  • Peer Reviewed / Open Access
• [Presentation] Real-time volumetric image generation based on CT image deformation driven by displacement of internal fiducial markers (2020)
  • Author(s): Risa Hayashi，Naoki Miyamoto，Kouhei Yokokawa，Seishin Takao，Koichi Miyazaki，Kikuo Umegaki
  • Organizer: 第119回日本医学物理学会学術大会
• [Presentation] Image registration with spatially weighted mutual information for patient setup in proton therapy (2020)
  • Author(s): Yuhei Kikkawa，Hideaki Ueda，Kikuo Umegaki，Naoki Miyamoto，Seishin Takao
  • Organizer: 第119回日本医学物理学会学術大会
• [Presentation] 動体追跡放射線治療におけるDeep Learningを用いたX線透視画像上の非球形マーカ位置の認識 (2020)
  • Author(s): 阿部和貴、宮崎康一、横川航平、高尾聖心、平田雄一、梅垣菊男、宮本直樹
  • Organizer: 第39回日本医用画像工学会退会
• [Presentation] Neural reconstruction of volumetric computed tomography from a body surface depth motion surrogate (2020)
  • Author(s): Wan Jeff，Yusuke Nomura，Naoki Miyamoto，Lei Xing，Hiroki Shirato
  • Organizer: 日本放射線腫瘍学会第33回学術大会
• [Presentation] スポットスキャニング陽子線治療における可変ゲーティング法を用いた線量誤差の低減 (2020)
  • Author(s): 横川航平，宮本直樹，高尾聖心，松浦妙子，田中創大，清水伸一，白土博樹，梅垣菊男
  • Organizer: 日本放射線腫瘍学会第33回学術大会
• [Presentation] simulative IMRTを用いた早期声門部癌に対する放射線治療における甲状腺線量の検討 (2020)
  • Author(s): 出倉康裕，安田耕一，湊川英樹，大塚愛美，鈴木隆介，宮本直樹，鈴木崇祥，対馬那由多，加納里志，本間明宏，清水伸一，青山英史
  • Organizer: 日本放射線腫瘍学会第33回学術大会
• [Presentation] The changes of expiration position in Real-time image-Guided Proton Therapy for liver cancer (2020)
  • Author(s): Yuto Matsuo，Naoki Miyamoto，Taeko Matsuura，Masaya Tamura，Norio Katoh，Daisuke Abo，Shinichi Shimizu，Hidefumi Aoyama，Hiroki Shirato，Seishin Takao
  • Organizer: 日本放射線腫瘍学会第33回学術大会
• [Presentation] 陽子線治療の適応的治療を支援する実績線量分布評価システムの開発 (2020)
  • Author(s): 井田頼子，小橋啓司，宮本直樹，宮崎康一，西岡健太郎，安田耕一，加藤徳雄，松浦妙子，高尾聖心，青山英史，橋本孝之，清水伸一
  • Organizer: 日本放射線腫瘍学会第33回学術大会
• [Presentation] Dosimetric comparison of proton beam therapy and photon VMAT in patients with multiple small sized liver tumors: A preliminary study (2020)
  • Author(s): Yusuke Uchinami，Norio Katoh，Ryusuke Suzuki，Hiroshi Taguchi，Koichi Yasuda，Seishin Takao，Naoki Miyamoto，Taeko Matsuura，Shinichi Shimizu，Hidefumi Aoyama
  • Organizer: 日本放射線腫瘍学会第33回学術大会
• [Presentation] Real-time adaptive radiotherapy with internal fiducial markers and real-time-imaging technique (2020)
  • Author(s): Naoki Miyamoto
  • Organizer: 日本放射線腫瘍学会第33回学術大会
  • Invited
• [Presentation] Synthetic fluoroscopic image generation for tracking accuracy validation of marker-less tumor tracking in radiotherapy (2020)
  • Author(s): Koichi Miyazaki，Takaaki Fujii，Toru Umekawa，Naoki Miyamoto，Kikuo Umegaki
  • Organizer: 2020 AAPM Annual Meeting
  • Int'l Joint Research
• [Presentation] Gated Proton Imaging using Fiducial Marker and X-ray Fluoroscopy (2020)
  • Author(s): Sodai Tanaka，Naoki Miyamoto，Yojiro Shimada，Teiji Nishio，Takaaki Yoshimura，Seishin Takao，Yuto Matsuo，Shinichi Shimizu，Taeko Matsuura
  • Organizer: 2020 AAPM Annual Meeting
  • Int'l Joint Research
• [Presentation] A method for generating real-time X-ray images by utilizing 4D digital phantom (2019)
  • Author(s): Kousei Hamamuki, Naoki Miyamoto, Sodai Tanaka, Masaya Tamura, Ryusuke Suzuki
  • Organizer: 第118回医学物理学会
• [Presentation] Dependence of the Sub-Lethal Damage Repair Rate on LET in Proton Irradiation: An Initial Study (2019)
  • Author(s): Koki Kasamatsu, Memu Hosoda, Jin-Min Nam, Hironobu Yasui, Sodai Tanaka, Shusuke Hirayama, Naoki Miyamoto, Kikuo Umegaki, Hiroki Shirato
  • Organizer: 第118回医学物理学会
• [Presentation] Development of Gated Proton Imaging System for Moving Target (2019)
  • Author(s): Sodai Tanaka, Naoki Miyamoto, Teiji Nishio, Takaaki Yoshimura, Seishin Takao, Yuto Matsuo, Shinichi Shimizu, Hiroki Shirato, Taeko Matsuura
  • Organizer: ESTRO meets Asia
  • Int'l Joint Research
• [Presentation] 動体追跡陽子線治療システムの開発・臨床応用・今後の展望 (2019)
  • Author(s): 宮本直樹、高尾聖心、松浦妙子、田中創大、梅垣菊男、清水伸一、白土博樹
  • Organizer: 80回応用物理学会秋季学術講演会
  • Invited
• [Presentation] Real-time volumetric image generation with CT image deformation driven by displacement of internal fiducial markers (2018)
  • Author(s): 宮本 直樹，松本 直樹，鈴木 隆介，高尾 聖心，松浦 妙子，藤井 孝明，平山 嵩祐，富岡 智，清水 伸一，梅垣 菊男，白土 博樹
  • Organizer: 第116回医学物理学会
• [Presentation] Real-time volumetric image generation with CT image deformation driven by displacement of internal fiducial markers (2018)
  • Author(s): Naoki Miyamoto, Naoki Matsumoto, Ryusuke Suzuki, Seishin Takao, Taeko Matsuura, Takaaki Fujii, Shusuke Hirayama, Satoshi Tomioka, Shinichi Shimizu, Kikuo Umegaki, Hiroki Shirato
  • Organizer: 2018 AAPM Annual Meeting
  • Int'l Joint Research
• [Presentation] A robust tracking algorithm for implanted markers of fluoroscopic images in a real-time tumor-tracking system (2018)
  • Author(s): Koichi Miyazaki, Yusuke Fujii, Toru Umekawa, Takahiro Yamada, Takaaki Fujii, Naoki Miyamoto
  • Organizer: 2018 AAPM Annual Meeting
  • Int'l Joint Research
• [Presentation] A study on the influence of changing the motion recognition rate on the dose accuracy of spot-scanning proton therapy (2018)
  • Author(s): Tetsuhiro Sodeta, Taeko Matsuura, Seishin Takao, Shusuke Hirayama, Takahiro Kanehira, Naoki Miyamoto, Kentaro Nishioka, Norio Kato, Kikuo Umegaki, Hiroki Shirato
  • Organizer: 2018 AAPM Annual Meeting
  • Int'l Joint Research
• [Presentation] Surface imaging and internal imaging, what are they worth (2018)
  • Author(s): Naoki Miyamoto
  • Organizer: 4D Treatment Workshop for Particle Therapy
  • Int'l Joint Research / Invited