The development of the new system for the automatic documentization of surgical operations

• Project/Area Number: 16K12911
• Research Category: Grant-in-Aid for Challenging Exploratory Research
• Allocation Type: Multi-year Fund
• Research Field: Medical systems
• Research Institution: Kobe University
• Principal Investigator: Harada Hitoshi 神戸大学, 医学研究科, 医学研究員 (70771517)
• Co-Investigator(Kenkyū-buntansha): 宮尾 祐介 国立情報学研究所, コンテンツ科学研究系, 教授 (00343096) ; 金治 新悟 神戸大学, 医学部附属病院, 助教 (10637052) ; 掛地 吉弘 神戸大学, 医学研究科, 教授 (80284488)
• Research Collaborator: SATO Yoshinobu ; Otake Yoshito ; Reiter Austin
• Project Period (FY): 2016-04-01 – 2019-03-31
• Project Status: Completed (Fiscal Year 2018)
• Budget Amount: ¥3,380,000 (Direct Cost: ¥2,600,000、Indirect Cost: ¥780,000); Fiscal Year 2018: ¥650,000 (Direct Cost: ¥500,000、Indirect Cost: ¥150,000); Fiscal Year 2017: ¥650,000 (Direct Cost: ¥500,000、Indirect Cost: ¥150,000); Fiscal Year 2016: ¥2,080,000 (Direct Cost: ¥1,600,000、Indirect Cost: ¥480,000)
• Keywords: 画像 / 機械学習 / アルゴリズム / グラウンディング / 生体医用画像 / コンピュータ外科学 / 腹腔鏡手術 / 画像認識 / 手術記録自動作成

Outline of Final Research Achievements

For the automatic documentization of surgical operations, we worked on developing the algorithm for recognition the various elements from the video of surgical operation, such as anatomical structure, surgical instruments, operative motion, and events during surgery. As a result, this algorithm has not reached the accuracy as we expected to the documentation of surgical operation. The difficulty in improving accuracy due to differences in anatomical structure and plasticity of organs among cases is cited as a factor of incomplete algorithm. However, it achieved relatively high accuracy for automatic recognition of less plastic objects such as surgical instruments.

Academic Significance and Societal Importance of the Research Achievements

手術動画の自動認識アルゴリズムの開発において，動画より認識が容易な対象物と認識の困難な対象物の特徴を把握できたことはきわめて有用と考えられる．グラウンディング技術は現在多方面で発展が期待されている分野であり，外科領域を含む医療分野におけるグラウンディング技術の応用にとって重要な試金石となった．今後，精度の高い手術器具の自動認識を基に，手術動画の文章化のアプローチ法を検討することで，さらなる発展が期待できると考える．

Research Products

• [Journal Article] The effect on surgical skills of expert surgeons using 3D/HD and 2D/4K resolution monitors in laparoscopic phantom tasks (2018)
  • Author(s): Hitoshi Harada. et al.
  • Journal Title: Surgical Endoscopy Volume: 印刷中 Issue: 10 Pages: 4228-4234
  • DOI: 10.1007/s00464-018-6169-1
  • Peer Reviewed
• [Journal Article] Quantitative comparison of operative skill using 2-and 3-dimensional monitors during laparoscopic phantom tasks. (2017)
  • Author(s): Nishi M, Kanaji S, Otake Y, Harada H, Yamamoto M, Oshikiri T, Nakamura T, Suzuki S, Suzuki Y, Hiasa Y, Sato Y
  • Journal Title: Surgery Volume: 31 Issue: 5 Pages: 1334-1340
  • DOI: 10.1016/j.surg.2016.08.060
  • Peer Reviewed / Open Access / Acknowledgement Compliant
• [Journal Article] Comparison of two- and three-dimensional display for performance of laparoscopic total gastrectomy for gastric cancer. (2017)
  • Author(s): Kanaji S, Suzuki S, Harada H, Nishi M, Yamamoto M, Matsuda T, Oshikiri T, Nakamura T, Fujino Y, Tominaga M, Kakeji Y.
  • Journal Title: Langenbecks Arch Surg Volume: - Issue: 3 Pages: 493-500
  • DOI: 10.1007/s00423-017-1574-9
  • Peer Reviewed / Open Access
• [Journal Article] Totally laparoscopic total gastrectomy in a patient with situs inversus totalis. (2016)
  • Author(s): Harada H, Kanaji S, Suzuki S, Yamamoto M, Yamashita K, Imanishi T, Sumi Y, Nakamura T, Tanaka K, Kakeji Y
  • Journal Title: International Surgery Volume: 印刷中
  • Peer Reviewed / Open Access
• [Presentation] 3D/HDおよび2D/4Kモニターが内視鏡外科医の手術手技にもたらす効果 (2018)
  • Author(s): 原田仁
  • Organizer: 第43回日本外科系連合学会学術集会
• [Presentation] THE EFFECT OF STEREOSCOPIC IMAGES FROM USING A THREE-DIMENSIONAL MONITORTO LAPAROSCOPIC SURGICAL TRAINING FOR NOVICES (2017)
  • Author(s): Harada H, Kanaji S, Suzuki S, Hasegawa H, Yamamoto M, Matsuda Y, Yamashita K, Matsuda T, Oshikiri T, Sumi Y, Nakamura T, Kakeji Y
  • Organizer: SAGES 2017 Annual Meeting
  • Place of Presentation: HOUSTON
  • Year and Date: 2017-03-22
  • Int'l Joint Research
• [Presentation] 3D映像が内視鏡外科手術トレーニングに及ぼす影響の検討 (2016)
  • Author(s): 金治 新悟、原田 仁、西 将康、長谷川 寛、山本 将士、松田 佳子、山下 公大、松田 武、押切 太郎、中村 哲、角 泰雄、鈴木 知志、掛地 吉弘
  • Organizer: 第78回日本臨床外科学会総会
  • Place of Presentation: 東京
  • Year and Date: 2016-11-24
• [Presentation] 3Dモニターが初心者の内視鏡外科トレーニングにもたらす影響 (2016)
  • Author(s): 原田 仁、金治 新悟、西 将康、長谷川 寛、山本 将士、松田 佳子、山下 公大、松田 武、押切 太郎、中村 哲、角 泰雄、鈴木 知志、掛地 吉弘
  • Organizer: 第29回近畿内視鏡外科研究会
  • Place of Presentation: 京都