2017 Fiscal Year Annual Research Report
仮想壁、術中ＭＲと超音波映像に基づいた手術ナビゲーションシステムの開発
| Project/Area Number |
16F16108
|
|---|
| Research Institution | Kyushu University |
|---|
Principal Investigator |
橋爪 誠 九州大学, 医学研究院, 教授 (90198664)
|
|---|
| Co-Investigator(Kenkyū-buntansha) |
JANG JONGSEONG 九州大学, 医学(系)研究科(研究院), 外国人特別研究員
|
|---|
| Project Period (FY) |
2016-07-27 – 2019-03-31
|
| Keywords | Surgical navigation / Medical image analysis / Object tracking / Artificial Intelligence |
|---|
| Outline of Annual Research Achievements |
In this year, I archived in implementation of the components of the navigation for robot assisted radical prostectomy. I implemented an artificial intelligence based forceps tracking software. This software can track and show the forceps’ end points in the surgical movie by using the region proposal network (RPN). As a result, RPN showed its possibility to detect the forceps in the very complex laparoscopic surgical scenes. It was not yet enough to apply to the navigation system due to frame rate. Resizing the input image smaller can be a solution, because many algorithms for object detection have used input image smaller than 600 × 600 at least. However, there is trade-off between accuracy and frame rate when using smaller image, it has to be investigated through experiments.
|
| Current Status of Research Progress |
Current Status of Research Progress
3: Progress in research has been slightly delayed.
Reason
There was no big problem in implementation of AI software. But, there were some difficulties in getting image data to train and test. Also, it took much time to train itself and check the its evaluation. The result was very promise, but it needs more data and time to get robust performance.
|
| Strategy for Future Research Activity |
I’ll continue to study in tracking forceps using AI. So far, obtained forceps’ position was the result of the image from the single camera, so that it is 2 D. It should be transformed to 3 D through the stereo vision technology using multi-cameras. Afterwards, it can be applied to the navigation system of robot surgical system as a principal component.
|
