• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Patient-specific 3D-Visualization of the Liver and Vascular Structures for surgical assistance and its a touch-less Visualization of medical image

Research Project

Project/Area Number 15K16031
Research Category

Grant-in-Aid for Young Scientists (B)

Allocation TypeMulti-year Fund
Research Field Perceptual information processing
Research InstitutionHiroshima Institute of Technology (2016-2017)
Ritsumeikan University (2015)

Principal Investigator

Tateyama Tomoko  広島工業大学, 情報学部, 助教 (90550153)

Project Period (FY) 2015-04-01 – 2018-03-31
Project Status Completed (Fiscal Year 2017)
Budget Amount *help
¥3,900,000 (Direct Cost: ¥3,000,000、Indirect Cost: ¥900,000)
Fiscal Year 2017: ¥780,000 (Direct Cost: ¥600,000、Indirect Cost: ¥180,000)
Fiscal Year 2016: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Fiscal Year 2015: ¥1,820,000 (Direct Cost: ¥1,400,000、Indirect Cost: ¥420,000)
Keywordsハンズフリー医用画像可視化操作 / ジェスチャ解析・認識 / 手術支援 / Kinect / L字型スクリーン / 血管構造解析 / 機械学習 / タッチレス医用画像可視化操作 / ジェスチャモデル / ジェスチャ認識 / タッチレスジェスチャ / kinect Depth Sensor / 医用画像可視化操作 / 高精度な臓器情報の抽出 / 血管情報可視化 / 人体臓器の対話可視化操作 / 非接触デバイス / タッチレスシステムのための手指形状解析
Outline of Final Research Achievements

During surgery, surgeons requests to use some contacting devices to display or visualize medical images and check the anatomic information of the patient. However, after operating the visualization device, re-sterilization is necessary in order to maintain hygiene. In this study, we develop a novel computer assistant surgery system using touch-less device system, which can manipulate by surgeon themselves and keep hygiene condition. The depth and skeleton information from Kinect are effectively utilized to produce marker-less hand extraction. The development system can manipulate the anatomical model of the patient presented on the L-shaped screen based on the gesture information obtained from KINECT.
Our development system can visualize 3D medical image with L-shape type screen and 9 kinds of simple touch-less single handed interactions. Experiments show that the proposed system is able to achieve high accuracy.

Report

(4 results)
  • 2017 Annual Research Report   Final Research Report ( PDF )
  • 2016 Research-status Report
  • 2015 Research-status Report
  • Research Products

    (44 results)

All 2017 2016 2015 Other

All Journal Article (6 results) (of which Int'l Joint Research: 2 results,  Peer Reviewed: 6 results,  Open Access: 3 results,  Acknowledgement Compliant: 3 results) Presentation (31 results) (of which Int'l Joint Research: 8 results,  Invited: 4 results) Remarks (7 results)

  • [Journal Article] Kinect-Based Gesture Recognition for Touchless Visualization of Medical Images2017

    • Author(s)
      Liu Jiaqing、Graduate School of Information Science and Engineering, Ritsumeikan University, Shiga, Japan.、Fujii Ryoma、Tateyama Tomoko、Iwamoto Yutaro、Chen Yenwei
    • Journal Title

      International J ournal on Computer Electrical Engineering

      Volume: 9 Issue: 2 Pages: 421-429

    • DOI

      10.17706/ijcee.2017.9.2.421-429

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Computerized Assessment of Small Bowel Motility Function Using Cine-MR Imaging : Preliminary Results in Super-Pixel Segmental Method2017

    • Author(s)
      Nguyen Dai Hung Linh, Akira Furukawa, Ayako Taniguchi, Yen Wei Chen, Tomoko Tateyama, Akitoshi Inoue, Shuzo Kanasaki, Makoto Wakamiya, Syerikjan Tulyeubai, Kiyosumi Maeda, Hiroshi Yamamoto, Akiyoshi Mizumoto, Akira Andoh
    • Journal Title

      The Journal of Transportation Medicine

      Volume: 71(3/4) Pages: 88-96

    • NAID

      40021461163

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 肝臓の統計形状モデル構築と肝硬変症支援診断への応用2016

    • Author(s)
      陳延偉,上谷芽衣,健山智子,韓先花,金崎周造,古川顕
    • Journal Title

      インナービジョン

      Volume: Vol.31, Pages: 33-36

    • Related Report
      2016 Research-status Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] A Touchless Visualization System for Medical Volumes Based on Kinect Gesture Recognition2016

    • Author(s)
      Ryoma Fujii, Tomoko Tateyama, Titinunt Kitrungrotsakul, Satoshi Tanaka, Yen-Wei Chen
    • Journal Title

      Innovation in Medicine and Healthcare 2016

      Volume: -- Pages: 209-215

    • DOI

      10.1007/978-3-319-39687-3_20

    • ISBN
      9783319396866, 9783319396873
    • Related Report
      2016 Research-status Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Interactive segmentation and visualization system for medical images on mobile devices2015

    • Author(s)
      Titinunt Kitrungrotsakul, Chunhua Dong, Tomoko Tateyama, Xian-Hua Han, Yen-Wei Chen
    • Journal Title

      Journal of Advanced Simulation in Science and Engineering

      Volume: 2 Issue: 1 Pages: 96-107

    • DOI

      10.15748/jasse.2.96

    • NAID

      130005073858

    • ISSN
      2188-5303
    • Related Report
      2015 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research / Acknowledgement Compliant
  • [Journal Article] Segmentation of liver and spleen based on computational anatomy models2015

    • Author(s)
      Chunhua Dong, Yen-Wei Chen, Amir Hossein Foruzan, Lanfen Lin, Xian-Hua Han, Tomoko Tateyama, Xing Wu, Gang Xu, Huiyan Jiang
    • Journal Title

      Computers in Biology and Medicine

      Volume: 67 Pages: 146-160

    • DOI

      10.1016/j.compbiomed.2015.10.007

    • Related Report
      2015 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Presentation] Development of Computer Aided Diagnosis Based on Computer Anatomy and Its Application to Virtual Experience System2017

    • Author(s)
      Tomoko Tateyama
    • Organizer
      7th Hiroshima Conference on Education and Science in Dentistry
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] タッチレス医用画像可視化操作確立のためのジェスチャ解析2017

    • Author(s)
      加納翔太,健山智子,陳延偉
    • Organizer
      29年度日本知能情報ファジイ学会中国・四国支部大会
    • Related Report
      2017 Annual Research Report
  • [Presentation] 広告画像からの高精度なキーワード自動付与を目的とした機械学習による文字領域認識2017

    • Author(s)
      折本研,健山智子,藤井一輝,田中貴士, 松本慎平
    • Organizer
      29年度日本知能情報ファジイ学会中国・四国支部大会
    • Related Report
      2017 Annual Research Report
  • [Presentation] オープンソースを活用した医用画像読影支援の開発と今後の応用展開について ~知的で信頼の高い「いつでも・どこでも」高度医療実現を目指して~2017

    • Author(s)
      健山智子
    • Organizer
      OSC2017Hiroshima
    • Related Report
      2017 Annual Research Report
    • Invited
  • [Presentation] L字スクリーンとKinectを用いた体感型VRキャンパス案内システム2017

    • Author(s)
      辻永成樹,山口展生,劉家慶,岩本祐太郎,健山智子,陳延偉
    • Organizer
      平成29年度電気関係学会関西支部連合大会
    • Related Report
      2017 Annual Research Report
  • [Presentation] Kinect-Based Real-Time Gesture Recognition Using Deep Convolutional Neural Networks for Touchless Visualization of Hepatic Anatomical Models in Surgery2017

    • Author(s)
      Liu Jiaqing, Fujii Ryoma, Tateyama Tomoko, Iwamoto Yutaro, Chen Yen-wei
    • Organizer
      Innovation in Medicine and Healthcare 2017. InMed 2017.
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Kinect-Based Gesture Recognition for Touchless Visualization of Medical Images2017

    • Author(s)
      Liu Jiaqing, Fujii Ryoma, Tateyama Tomoko, Iwamoto Yutaro, Chen Yen-wei
    • Organizer
      2017 4th International conference on Mechanical, Electronics and computer Engineering (CMECE 2017), Phnom Penh, Cambodia, ( Best Student Presentation Award.)
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Quantitative Assessment of Small Bowel Motility Using Cine MR Sequence Images and Superpixels2017

    • Author(s)
      Tateyama Tomoko、Taniguchi Ayako、Furukawa Akira、Wakamiya Makoto、Kanasaki Shuzo、Otsuki Kazuki、Chen Yen-Wei
    • Organizer
      Innovation in Medicine and Healthcare 2017. InMed 2017.
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] バーチャルリアリティによる体験型キャンパスガイドシステムの開発2017

    • Author(s)
      木上飛鳥,西川俊,健山智子
    • Organizer
      2017年度電気学会電子・情報・システム部門大会
    • Related Report
      2017 Annual Research Report
  • [Presentation] Kinect-Based Gesture Recognition for Touchless Visualization of Medical Images2017

    • Author(s)
      J.Liu, R.Fujii, T.Tateyama, Y.Iwamoto, and Y.W.Chen
    • Organizer
      第36回日本医用画像工学会大会
    • Related Report
      2017 Annual Research Report
  • [Presentation] Development of a Collaborative and Mobile Platform for 3D Medical Image Analysis2017

    • Author(s)
      Wang Yi, Liu Jiaqing, Deng Zhuofu, Zhu Zhiliang, Tateyama Tomoko, Chen Yen-Wei
    • Organizer
      第36回日本医用画像工学会大会
    • Related Report
      2017 Annual Research Report
  • [Presentation] 計算解剖モデルによる医用画像可視化支援システムの開発2017

    • Author(s)
      宮原勇太,健山智子,陳延偉
    • Organizer
      2017 IEEE SMC Hiroshima Chapter 若手研究会
    • Related Report
      2017 Annual Research Report
  • [Presentation] 計算解剖学を用いた疾患診断支援システムの開発と 体験型VRシステムへの応用2017

    • Author(s)
      健山智子,陳延偉
    • Organizer
      電子情報通信学会MICT研究会
    • Related Report
      2017 Annual Research Report
    • Invited
  • [Presentation] 二面スクリーンを用いた大学上空での空中ブランコVR体験システムの構築2016

    • Author(s)
      山口展生,藤井亮馬,岩本祐太郎(立命館大),健山智子(広島工大),陳延偉(立命館大)
    • Organizer
      平成28年度電気関係学会関西支部連合大会
    • Place of Presentation
      大阪府立大学(大阪府堺市)
    • Year and Date
      2016-11-23
    • Related Report
      2016 Research-status Report
  • [Presentation] PLS回帰を用いたステージ予測を含む肝硬変症支援診断2016

    • Author(s)
      健山智子,上谷芽衣,小原伸哉,藤井亮馬,金崎周造,古川顕,井上明星,若宮誠,陳延偉
    • Organizer
      第35回日本医用画像工学会大会(JAMIT 2016)
    • Place of Presentation
      千葉大学(千葉県千葉市)
    • Year and Date
      2016-07-21
    • Related Report
      2016 Research-status Report
  • [Presentation] A Touchless Visualization System for Medical Volumes Based on Kinect Gesture Recognition2016

    • Author(s)
      Ryoma Fujii, Tomoko Tateyama, Titinunt Kitrungrotsakul, Satoshi Tanaka, Yen-Wei Chen,
    • Organizer
      Innovation in Medicine and Healthcare 2016
    • Place of Presentation
      Hotel Botanico & The Oriental Spa Garden(Tenerife, Spain)
    • Year and Date
      2016-06-15
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] マルチモダリティ特徴を用いたラクナ梗塞候補検出精度の向上2016

    • Author(s)
      小野真理子, 田中英俊, 椎野顯彦, 健山智子, 陳 延偉
    • Organizer
      電子情報通信学会総合大会
    • Place of Presentation
      九州大学伊都キャンパス,福岡県福岡市
    • Year and Date
      2016-03-17
    • Related Report
      2015 Research-status Report
  • [Presentation] 空間位置情報と確率アトラスにもとづく医用画像からの臓器自動抽出と肝硬変症支援診断システム開発2016

    • Author(s)
      健山智子,Chuhua Dong,上谷芽衣,李 迎博,古川 顕,金崎周造,陳 延偉
    • Organizer
      MICT研究会 3月研究会
    • Place of Presentation
      名古屋工業大学,愛知県名古屋市
    • Year and Date
      2016-03-09
    • Related Report
      2015 Research-status Report
  • [Presentation] A framework for probabilistic atlas-based organ segmentation2016

    • Author(s)
      Chunhua Dong, Yen-Wei Chen, Amir Hossein Foruzan, Xian-hua Han, Tomoko Tateyama, Xing Wu
    • Organizer
      SPIE 9784, Medical Imaging 2016: Image Processing
    • Place of Presentation
      San Jose, California, USA
    • Year and Date
      2016-02-21
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] 複数人による非接触型 PC 操作方法の研究2016

    • Author(s)
      加藤絢子,山岸秀一,健山智子
    • Organizer
      平成28年度 日本知能情報ファジィ学会中国・四国支部大会
    • Place of Presentation
      広島市立大学サテライトキャンパス(広島県広島市)
    • Related Report
      2016 Research-status Report
  • [Presentation] 球面調和関数による計算解剖モデル構築と知的対話可視化操作による臨床支援の開発2016

    • Author(s)
      健山智子
    • Organizer
      IEEE SMC Hiroshima Chapter 主催 Special Lecture & Award 表彰式
    • Place of Presentation
      広島市立大学サテライトキャンパス(広島県広島市)
    • Related Report
      2016 Research-status Report
    • Invited
  • [Presentation] Kinectを用いたハンズフリー対話による三次元医用画像の可視化操作2015

    • Author(s)
      藤井亮馬,健山智子,田中英俊,上谷芽衣,徐睿,田中覚,陳延偉
    • Organizer
      平成27年度電気関係学会関西支部連合大会
    • Place of Presentation
      摂南大学寝屋川キャンパス,大阪府寝屋川市
    • Year and Date
      2015-11-14
    • Related Report
      2015 Research-status Report
  • [Presentation] ブロックマッチング法を用いた小腸収縮運動の自動解析2015

    • Author(s)
      大槻和輝,健山智子,谷口絢子,古川顕,金崎周造,若宮誠,陳延偉
    • Organizer
      平成27年度電気関係学会関西支部連合大会
    • Place of Presentation
      摂南大学寝屋川キャンパス,大阪府寝屋川市
    • Year and Date
      2015-11-14
    • Related Report
      2015 Research-status Report
  • [Presentation] バイラテラルフィルタを用いたラクナ梗塞初期候補検出精度の向上2015

    • Author(s)
      小野真理子,田中英俊,椎野顯彦, 健山智子,陳延偉
    • Organizer
      平成27年度電気関係学会関西支部連合大会
    • Place of Presentation
      摂南大学寝屋川キャンパス,大阪府寝屋川市
    • Year and Date
      2015-11-14
    • Related Report
      2015 Research-status Report
  • [Presentation] Transparent Visualization of Large-Scale and Complex Polygon Meshes Using a Stochastic Point-Based Rendering Method2015

    • Author(s)
      Rui Xu, Satoshi Tanaka, Kyoko Hasegawa, Wang Sheng, Tomoko Tateyama, Yen-Wei Chen, Shoji Kido
    • Organizer
      SIGGRAPHASIA 2015 KOBE
    • Place of Presentation
      神戸国際会議場,兵庫県神戸市
    • Year and Date
      2015-11-02
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] PLS 回帰を用いた肝硬変症の統計形状モデル構築とその支援診断2015

    • Author(s)
      健山智子,上谷芽衣, 小原伸哉,藤井亮馬,古川顕, 金崎周造,井上明星,若宮誠, 陳延偉
    • Organizer
      第3回看護理工学学術大会
    • Place of Presentation
      立命館大学朱雀キャンパス,京都府京都市
    • Year and Date
      2015-10-09
    • Related Report
      2015 Research-status Report
  • [Presentation] SLIC superpixel法を用いた腸管領域抽出による小腸収縮運動の自動計測と解析2015

    • Author(s)
      健山智子,谷口絢子,古川顕, 金崎周造,若宮誠,陳延偉
    • Organizer
      第34回医用画像工学大会JAMIT2015
    • Place of Presentation
      金沢歌劇座,石川県金沢市
    • Year and Date
      2015-07-31
    • Related Report
      2015 Research-status Report
  • [Presentation] Kinectを用いたハンズフリー対話による三次元医用画像可視化システムの開発2015

    • Author(s)
      井亮馬, 健山智子,田中英俊, 上谷芽衣, 徐 睿, 田中 覚, 陳 延偉
    • Organizer
      MI研究会 7月研究会
    • Place of Presentation
      函館市勤労者総合福祉センター(サン・リフレ函館) 北海道函館市
    • Year and Date
      2015-07-15
    • Related Report
      2015 Research-status Report
  • [Presentation] Development of Interactive and Collaborative 3D Medical Image Visualization and Analysis System2015

    • Author(s)
      Shuaizhen Zhu,Zhuofu Deng,Ye Yuan,Zhiliang Zhu, Tomoko Tateyama, Yen-Wei Chen
    • Organizer
      MI研究会 7月研究会
    • Place of Presentation
      函館市勤労者総合福祉センター(サン・リフレ函館) 北海道函館市
    • Year and Date
      2015-07-15
    • Related Report
      2015 Research-status Report
  • [Presentation] Iterative確率アトラスとテンプレートマッチングを用いた肝臓セグメンテーション2015

    • Author(s)
      李迎博, 董春華, 健山智子, 陳延偉
    • Organizer
      MI研究会 7月研究会
    • Place of Presentation
      函館市勤労者総合福祉センター(サン・リフレ函館) 北海道函館市
    • Year and Date
      2015-07-14
    • Related Report
      2015 Research-status Report
  • [Presentation] Efficient Shape Representation of Abdominal Organs Based on Spherical Harmonic Functions (SPHARM)2015

    • Author(s)
      Tomoko Tateyama, Mei Uetani, Titinunt Kitrungrotsakul, Rui Xu, Shinya Kohara, Chen-Lun Lin, Akira Furukawa, Shuzo Kanasaki, Satoshi Tanaka, YenWei Chen
    • Organizer
      Computer Assisted Radiology and Surgery(CARS2015)
    • Place of Presentation
      Balserona, Spain
    • Year and Date
      2015-06-29
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Remarks] iVal Website

    • URL

      https://sites.google.com/site/ivalithiroshima/

    • Related Report
      2017 Annual Research Report
  • [Remarks] Tomoko Tateyama's Website

    • URL

      https://carp.cc.it-hiroshima.ac.jp/~tateyama/

    • Related Report
      2017 Annual Research Report
  • [Remarks] 知的情報可視化戦略研究室

    • URL

      https://sites.google.com/site/ivalithiroshima/

    • Related Report
      2016 Research-status Report
  • [Remarks] 健山智子のWebサイト

    • URL

      http://carp.cc.it-hiroshima.ac.jp/~tateyama/

    • Related Report
      2016 Research-status Report
  • [Remarks] 知的画像処理研究室

    • URL

      http://www.iipl.is.ritsumei.ac.jp/

    • Related Report
      2016 Research-status Report
  • [Remarks] 健山智子のWebサイト

    • URL

      http://www.iipl.is.ritsumei.ac.jp

    • Related Report
      2015 Research-status Report
  • [Remarks] 立命館大学|私立大学戦略的拠点形成事業 「どこでも高度医療」実現のためのICT研究拠点形成

    • URL

      http://www.ictmh-ritsumei.org/

    • Related Report
      2015 Research-status Report

URL: 

Published: 2015-04-16   Modified: 2019-03-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi