• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Augmented endoscopic imaging - Mixed reality enhanced by three dimensional images reflecting structure and physical properties

Research Project

Project/Area Number 24680059
Research Category

Grant-in-Aid for Young Scientists (A)

Allocation TypePartial Multi-year Fund
Research Field Medical systems
Research InstitutionKyoto University

Principal Investigator

NAKAO Megumi  京都大学, 情報学研究科, 准教授 (10362526)

Project Period (FY) 2012-04-01 – 2015-03-31
Project Status Completed (Fiscal Year 2014)
Budget Amount *help
¥15,730,000 (Direct Cost: ¥12,100,000、Indirect Cost: ¥3,630,000)
Fiscal Year 2014: ¥2,600,000 (Direct Cost: ¥2,000,000、Indirect Cost: ¥600,000)
Fiscal Year 2013: ¥3,380,000 (Direct Cost: ¥2,600,000、Indirect Cost: ¥780,000)
Fiscal Year 2012: ¥9,750,000 (Direct Cost: ¥7,500,000、Indirect Cost: ¥2,250,000)
Keywords医用画像処理 / コンピュータ外科学 / 手術ナビゲーション / 臓器変形 / 拡張現実感 / 外科手術支援 / 可視化 / 生体医工学 / 医用グラフィクス
Outline of Final Research Achievements

This study developed a set of methods for generating augmented endoscopic images that visualize surgical procedures and internal structures of organs using image overlay techniques. The methods simulate or estimate intraoperative deformation of organs and cutting operation to bone structures, and perform information overlay through real-time processing of endoscopic images. We have developed a prototype surgical support system for liver resection surgery and for microendoscopic bone cutting procedures, and confirmed that time-varying local appearance of vascular structures and remains to be cut can be visualized as augmented images in real time.

Report

(4 results)
  • 2014 Annual Research Report   Final Research Report ( PDF )
  • 2013 Annual Research Report
  • 2012 Annual Research Report
  • Research Products

    (35 results)

All 2015 2014 2013 2012 Other

All Journal Article (9 results) (of which Peer Reviewed: 7 results,  Open Access: 4 results,  Acknowledgement Compliant: 4 results) Presentation (21 results) (of which Invited: 2 results) Remarks (4 results) Patent(Industrial Property Rights) (1 results)

  • [Journal Article] Volumetric Fibular Transfer Planning with Shape-Based Indicators in Mandibular Reconstruction2015

    • Author(s)
      M. Nakao, M. Hosokawa, Y. Imai, N. Ueda, T. Hatanaka, T. Kirita and T. Matsuda
    • Journal Title

      IEEE Journal of Biomedical and Health Informatics

      Volume: 19 Issue: 2 Pages: 581-589

    • DOI

      10.1109/jbhi.2014.2320720

    • NAID

      120005867109

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] Interactive Visual Exploration of Overlapping Similar Structures for Three-dimensional Microscope Images2014

    • Author(s)
      M. Nakao, S. Takemoto, T. Sugiura, K. Sawada, R. Kawakami, T. Nemoto and T. Matsuda
    • Journal Title

      BMC Bioinformatics

      Volume: 15 Issue: 1 Pages: 415-415

    • DOI

      10.1186/s12859-014-0415-x

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] Visualizing in vivo Brain Neural Structures Using Volume Rendered Feature Spaces2014

    • Author(s)
      Megumi Nakao, Kosuke Kurebayashi, Tadao Sugiura, Tetsuo Sato, Kazuaki Sawada, Ryosuke Kawakami, Tomomi Nemoto, Kotaro Minato, Tetsuya Matsuda
    • Journal Title

      Computers in Biology and Medicine

      Volume: 53 Pages: 85-93

    • DOI

      10.1016/j.compbiomed.2014.07.007

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] Heart Modeling of Congenital Heart Disease Based on Neonatal Echocardiographic Images2014

    • Author(s)
      R. Haraguchi, M. Nakao, K. Kurosaki, M. Iwata, K. Nakazawa, K. Kagisaki and I. Shiraishi
    • Journal Title

      Advanced Biomedical Engineering

      Volume: 3 Issue: 0 Pages: 86-93

    • DOI

      10.14326/abe.3.86

    • NAID

      130004568031

    • ISSN
      2187-5219
    • Related Report
      2014 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] Volumetric Fibular Transfer Planning with Shape-Based Indicators in Mandibular Reconstruction2014

    • Author(s)
      M. Nakao, M. Hosokawa, Y. Imai, N. Ueda, T. Hatanaka, T. Kirita, T. Matsuda
    • Journal Title

      IEEE Journal of Biomedical and Health Informatics

      Volume: 未定

    • NAID

      120005867109

    • Related Report
      2013 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Direct volume manipulation for visualizing intraoperative liver resection process2014

    • Author(s)
      Nakao M, Oda Y, Taura K, Minato K
    • Journal Title

      Comput Methods Programs Biomed

      Volume: 113(3) Issue: 3 Pages: 725-735

    • DOI

      10.1016/j.cmpb.2013.12.004

    • NAID

      120005399110

    • Related Report
      2013 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 新生児心エコー画像に基づく先天性心疾患の3次元モデル構築支援システム2013

    • Author(s)
      益田 祐次, 原口 亮, 中尾 恵, 岩田 倫明, 黒嵜 健一, 鍵崎 康治, 白石 公, 中沢 一雄, 湊 小太郎
    • Journal Title

      生体医工学

      Volume: 51 Pages: 95-102

    • Related Report
      2013 Annual Research Report
  • [Journal Article] 人体・臓器形態のバーチャル化 ~三次元画像に基づく手術工程のモデリング~2013

    • Author(s)
      中尾 恵
    • Journal Title

      日本バーチャルリアリティ学会 学会誌

      Volume: 18 Pages: 11-15

    • Related Report
      2013 Annual Research Report
  • [Journal Article] 新生児心エコー画像に基づく先天性心疾患の3次元モデル構築支援システム2013

    • Author(s)
      益田祐次
    • Journal Title

      生体医工学

      Volume: 51(印刷中)

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Presentation] Resection Process Modeling Based on 3D Images2015

    • Author(s)
      M. Nakao, K. Taura and T. Matsuda
    • Organizer
      Proc. Medical and Biological Imaging
    • Place of Presentation
      Osaka University (Osaka)
    • Year and Date
      2015-03-14
    • Related Report
      2014 Annual Research Report
  • [Presentation] A Study on Semi-automatic Fibular Transfer Planning in Mandibular Reconstruction2015

    • Author(s)
      S. Aso, M. Nakao, K. Imanishi, Y. Imai, N. Ueda, T. Hatanaka, T. Kirita and T. Matsuda
    • Organizer
      Proc. Medical and Biological Imaging
    • Place of Presentation
      Osaka University (Osaka)
    • Year and Date
      2015-03-14
    • Related Report
      2014 Annual Research Report
  • [Presentation] Estimation of External Forces Using Local Displacement of Elastic Body2015

    • Author(s)
      R. Sakata, M. Nakao and T. Matsuda
    • Organizer
      Proc. Medical and Biological Imaging
    • Place of Presentation
      Osaka University (Osaka)
    • Year and Date
      2015-03-14
    • Related Report
      2014 Annual Research Report
  • [Presentation] 外科手術プロセスの対話型可視化ソフトウェア2015

    • Author(s)
      中尾 恵
    • Organizer
      メディカルジャパン
    • Place of Presentation
      インテックス大阪 (大阪府大阪市)
    • Year and Date
      2015-02-04
    • Related Report
      2014 Annual Research Report
    • Invited
  • [Presentation] 三次元画像に基づく手術プロセスの可視化と時系列分析2014

    • Author(s)
      中尾 恵
    • Organizer
      第9回肝癌治療シミュレーション研究会
    • Place of Presentation
      大阪国際会議場(大阪府大阪市)
    • Year and Date
      2014-09-27
    • Related Report
      2014 Annual Research Report
    • Invited
  • [Presentation] 手術時の切削による形状変化を反映した重畳可視化法の提案2014

    • Author(s)
      遠藤 翔大, 中尾 恵, 今西 勁峰, 木岡 雅彦, 吉田 宗人, 松田 哲也
    • Organizer
      第19回日本バーチャルリアリティ学会大会
    • Place of Presentation
      名古屋大学(愛知県名古屋市)
    • Year and Date
      2014-09-17 – 2014-09-20
    • Related Report
      2014 Annual Research Report
  • [Presentation] 手指による実物体の押し込み操作を入力とする力学シミュレーションシステム2014

    • Author(s)
      妹尾 昌幸, 中尾 恵, 松田 哲也
    • Organizer
      第19回日本バーチャルリアリティ学会大会
    • Place of Presentation
      名古屋大学(愛知県名古屋市)
    • Year and Date
      2014-09-17 – 2014-09-20
    • Related Report
      2014 Annual Research Report
  • [Presentation] Volumetric Surgical Planning System for Fibular Transfer in Mandibular Reconstruction2013

    • Author(s)
      M. Nakao, M. Hosokawa, Y. Imai, N. Ueda, T. Hatanaka, K. Minato, T. Kirita
    • Organizer
      Proc IEEE Eng Med Biol Soc.
    • Place of Presentation
      Osaka
    • Related Report
      2013 Annual Research Report
  • [Presentation] Finger Force and Position Measurement without Obstructing Touch Interaction2013

    • Author(s)
      F. Ohno, M. Nakao, T. Matsuda
    • Organizer
      Proc IEEE Eng Med Biol Soc.
    • Place of Presentation
      Osaka
    • Related Report
      2013 Annual Research Report
  • [Presentation] Interactive Volume Visualization of Microscopic Images Using Feature Space Reduction2013

    • Author(s)
      S. Takemoto, M. Nakao, T. Sato, T. Sugiura, K. Minato, T. Matsuda
    • Organizer
      Proc IEEE Eng Med Biol Soc.
    • Place of Presentation
      Osaka
    • Related Report
      2013 Annual Research Report
  • [Presentation] Intraoperative Image Generation Methods Reflecting Shape Changes in Bone Cutting Procedures2013

    • Author(s)
      S. Endo, M. Nakao, K. Imanishi, M. Yoshida, M. Kioka, K. Minato, T. Matsuda
    • Organizer
      Proc IEEE Eng Med Biol Soc.
    • Place of Presentation
      Osaka
    • Related Report
      2013 Annual Research Report
  • [Presentation] 視覚・触覚情報の倍率が弾性体操作に与える影響に関する基礎的検討2013

    • Author(s)
      大野 史敬, 中尾 恵, 松田 哲也
    • Organizer
      第18回日本バーチャルリアリティ学会大会
    • Place of Presentation
      大阪
    • Related Report
      2013 Annual Research Report
  • [Presentation] Synchronized Visualization of Bone Cutting to Support Microendoscopic Discec tomy2012

    • Author(s)
      Megumi Nakao
    • Organizer
      19th International Display Workshop
    • Place of Presentation
      京都国際会館(京都府)(招待講演)
    • Year and Date
      2012-12-06
    • Related Report
      2012 Annual Research Report
  • [Presentation] 当科における粉末固着積層造形法による3D造形モデルを用いた下顎再建の術前シミュレーションについての検討2012

    • Author(s)
      上田順宏
    • Organizer
      日本シミュレーション外科学会会誌
    • Place of Presentation
      コンファレンススクエア(東京都)
    • Year and Date
      2012-11-17
    • Related Report
      2012 Annual Research Report
  • [Presentation] 下顎骨再建術計画支援システムにおける形態的特徴に基づく評価指標の提案2012

    • Author(s)
      細川守
    • Organizer
      生体医工学シンポジウム
    • Place of Presentation
      大阪大学(大阪府)
    • Year and Date
      2012-09-07
    • Related Report
      2012 Annual Research Report
  • [Presentation] 特徴量空間を用いた二光子顕微鏡画像のボリューム可視化2012

    • Author(s)
      紅林広亮
    • Organizer
      生体医工学シンポジウム
    • Place of Presentation
      大阪大学(大阪府)
    • Year and Date
      2012-09-07
    • Related Report
      2012 Annual Research Report
  • [Presentation] 新生児心エコー画像に基づく先天性心疾患の3次元モデル構築支援システム2012

    • Author(s)
      益田祐次
    • Organizer
      生体医工学シンポジウム
    • Place of Presentation
      大阪大学(大阪府)
    • Year and Date
      2012-09-07
    • Related Report
      2012 Annual Research Report
  • [Presentation] 卞顎骨再建術計画支援システムにおける形態的特徴に基づく評価指標2012

    • Author(s)
      細川守
    • Organizer
      第12回日本VR医学会学術大会
    • Place of Presentation
      千葉大学医学部附属病院(千葉県)
    • Year and Date
      2012-08-25
    • Related Report
      2012 Annual Research Report
  • [Presentation] Plissimo Eraを用いた肝切除術のVirtual Reality2012

    • Author(s)
      田浦康二朗
    • Organizer
      第67回日本消化器外科学会総会
    • Place of Presentation
      富山国際会議場(富山県)
    • Year and Date
      2012-07-18
    • Related Report
      2012 Annual Research Report
  • [Presentation] 新生児エコー画像に基づく先天性心疾患の形状モデル構築支援システム2012

    • Author(s)
      益田祐次
    • Organizer
      生体医工学シンポジウム
    • Place of Presentation
      福岡国際会議場(福岡県)
    • Year and Date
      2012-05-10
    • Related Report
      2012 Annual Research Report
  • [Presentation] 高次元特徴量空間を用いた対話的ボリューム可視化手法

    • Author(s)
      竹本 真太朗, 中尾 恵, 佐藤 哲大, 杉浦 忠男, 松田 哲也
    • Organizer
      電子情報通信学会研究報告(MI)
    • Place of Presentation
      広島
    • Related Report
      2013 Annual Research Report
  • [Remarks] Official Home Page

    • URL

      http://www.bme.sys.i.kyoto-u.ac.jp/~meg/index.html

    • Related Report
      2014 Annual Research Report
  • [Remarks] LiveVolume: Volume rendering software

    • URL

      http://www.livevolume.com/

    • Related Report
      2014 Annual Research Report
  • [Remarks] Official Research Page

    • URL

      http://www.bme.sys.i.kyoto-u.ac.jp/~meg/

    • Related Report
      2013 Annual Research Report
  • [Remarks] LiveVolume - Volume rendering software

    • URL

      http://www.livevolume.com/

    • Related Report
      2013 Annual Research Report
  • [Patent(Industrial Property Rights)] 医用画像表示装置、医用画像表示方法、及びプログラム2015

    • Inventor(s)
      中尾 恵, 竹村 知晃
    • Industrial Property Rights Holder
      中尾 恵, 竹村 知晃
    • Industrial Property Rights Type
      特許
    • Industrial Property Number
      2015-049873
    • Filing Date
      2015-03-12
    • Related Report
      2014 Annual Research Report

URL: 

Published: 2012-04-24   Modified: 2019-07-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi