• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Lightweight 3D Deep Learning Network for Computer-Aided Diagnosis of Liver Lesions

Research Project

Project/Area Number 20K21821
Research Category

Grant-in-Aid for Challenging Research (Exploratory)

Allocation TypeMulti-year Fund
Review Section Medium-sized Section 61:Human informatics and related fields
Research InstitutionRitsumeikan University

Principal Investigator

陳 延偉  立命館大学, 情報理工学部, 教授 (60236841)

Co-Investigator(Kenkyū-buntansha) 岩本 祐太郎  大阪電気通信大学, 情報通信工学部, 講師 (30779054)
Project Period (FY) 2020-07-30 – 2025-03-31
Project Status Granted (Fiscal Year 2023)
Budget Amount *help
¥6,240,000 (Direct Cost: ¥4,800,000、Indirect Cost: ¥1,440,000)
Fiscal Year 2022: ¥2,470,000 (Direct Cost: ¥1,900,000、Indirect Cost: ¥570,000)
Fiscal Year 2021: ¥1,820,000 (Direct Cost: ¥1,400,000、Indirect Cost: ¥420,000)
Fiscal Year 2020: ¥1,950,000 (Direct Cost: ¥1,500,000、Indirect Cost: ¥450,000)
Keywords医用画像セグメンテーション / 三次元深層学習ネットワーク / 軽量化 / Adaptive Decomposition / Foundation Model / Adaptor / ボリューム画像 / 肝臓疾患 / セグメンテーション / 高解像度 / 深層学習 / 三次元畳み込みニュートラルネットワーク / 肝臓セグメンテーション / 肝臓腫瘍検出 / 三次元ネットワーク / 計算機支援診断
Outline of Research at the Start

近年CT画像のようなボリューム画像をそのまま解析できる三次元畳込ネットワークが注目されるようになっている。三次元ネットワークを用いることによって、医師と同じように医用画像の三次元情報が利用できるので、高精度な診断支援ができるが、多次元入力画像に対してKernelの次元数も増えるので、推定パラメータ数が指数的に増加する。計算の複雑さに加えて膨大なトレーニングデータが必要であり、それを用意することは非常に困難である。本研究では、精度を保ちながら三次元深層学習ネットワークの新たな軽量化モデルを提案する。開発した軽量化三次元ネットワークを用いてCT画像における肝臓疾患の計算機支援診断システムを開発する。

Outline of Annual Research Achievements

医用画像に特化した軽量で効率的な深層学習ネットワークを開発すると同時に、現在注目されているFoundation Modelの医用画像への効率的な適用方法に関する研究を進めてきた。今年度は以下の研究成果が得られた。
(1) Adaptive DecompositionとShared Weight ボリュームトランスフォーマーを開発し、軽量化された、高効率なPatch-Free三次元医用画像セグメンテーションネットワークを開発した。その成果に関する論文は医工学分野のトップ国際学術誌IEEE Journal of Biomedical and Health Informatics(Impact Factor: 7.021)に掲載された。
(2)2023年3月、画像Foundation Model (SAM: Segmentation Anything)が提案されたが、自然画像で学習したモデルなので、医用画像に適用すると精度が低下する。本研究では、SAMの医用画像に適用するための効率的なadaptation法(Spatial Prior Adaptor)を開発した。
(3) 2023年6月に大会長として国際学会International Conference on Innovation in Medicine and Healthcareをイタリアのローマで主催した。その論文集を本としてSpringer社より出版した。また、2023年11月に国際学会Digital Medicine and Image Processingにて「Recent Advances in Deep Learning for Medical Image Analysis」というKeynote Talkを行った。

Current Status of Research Progress
Current Status of Research Progress

1: Research has progressed more than it was originally planned.

Reason

当初目標にしていた医用軽量化三次元深層学習モデルを開発しただけでなく、現在注目されているFoundation model (SAM)を医用画像に適用するための効率的なAdaptorを開発した。

Strategy for Future Research Activity

現在のFoundation model (SAM)は2次元画像にしか適用できない。医用ボリューム画像にも適用できるよう、その三次元化と効率的なadaptation法を開発する。

Report

(4 results)
  • 2023 Research-status Report
  • 2022 Research-status Report
  • 2021 Research-status Report
  • 2020 Research-status Report
  • Research Products

    (39 results)

All 2024 2023 2022 2021 2020 Other

All Int'l Joint Research (3 results) Journal Article (11 results) (of which Int'l Joint Research: 8 results,  Peer Reviewed: 9 results) Presentation (22 results) (of which Int'l Joint Research: 14 results,  Invited: 3 results) Book (2 results) Funded Workshop (1 results)

  • [Int'l Joint Research] 浙江大学計算機学院/浙江大学医学部附属病院(中国)

    • Related Report
      2023 Research-status Report
  • [Int'l Joint Research] 浙江大学計算機学院/浙江大学医学部附属病院(中国)

    • Related Report
      2022 Research-status Report
  • [Int'l Joint Research] Zhejiang University/Zhejiang Lab(中国)

    • Related Report
      2020 Research-status Report
  • [Journal Article] 3D Multiple-Contextual ROI-Attention Network for Efficient and Accurate Volumetric Medical Image Segmentation2023

    • Author(s)
      He Li, Yutaro Iwamoto, Xianhua Han, Lanfen Lin, Akira Furukawa, Shuzo Kanasaki, and Yen-Wei Chen
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E106.D Issue: 5 Pages: 1027-1037

    • DOI

      10.1587/transinf.2022EDP7193

    • ISSN
      0916-8532, 1745-1361
    • Year and Date
      2023-05-01
    • Related Report
      2022 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Adaptive Decomposition and Shared Weight Volumetric Transformer Blocks for Efficient Patch-Free 3D Medical Image Segmentation2023

    • Author(s)
      Wang Hongyi、Xu Yingying、Chen Qingqing、Tong Ruofeng、Chen Yen-Wei、Hu Hongjie、Lin Lanfen
    • Journal Title

      IEEE Journal of Biomedical and Health Informatics (Impact factor: 7.021)

      Volume: 27 Issue: 10 Pages: 4854-4865

    • DOI

      10.1109/jbhi.2023.3305830

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] ModalityFormer for Preoperative Early Recurrence Prediction of Hepatocellular Carcinoma Using Multimodality MRI or CT and Clinical Data2023

    • Author(s)
      Gan Zhan, Fang Wang, Yinhao Li, Weibin Wang, Qingqing Chen, Hongjie Hu, Lanfen Lin, Yen-Wei Chen
    • Journal Title

      IIEEJ Transactions on Image Electronics and Visual Computing

      Volume: 11 Pages: 30-37

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Multi-Modal Tumor Segmentation With Deformable Aggregation and Uncertain Region Inpainting2023

    • Author(s)
      Zhang Yue、Peng Chengtao、Tong Ruofeng、Lin Lanfen、Chen Yen-Wei、Chen Qingqing、Hu Hongjie、Zhou S. Kevin
    • Journal Title

      IEEE Transactions on Medical Imaging, (Impact Factor: 11.037)

      Volume: 42 Issue: 10 Pages: 3091-3103

    • DOI

      10.1109/tmi.2023.3275592

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Unsupervised MRI Super-Resolution using Deep External Learning and Guided Residual Dense Network with Multimodal Image Priors2023

    • Author(s)
      Yutaro Iwamoto, Kyohei Takeda, Yinhao Li, Akihiko Shiino, and Yen-Wei Chen
    • Journal Title

      IEEE Transactions on Emerging Topics in Computational Intelligence (Impact Factor: 4.851 )

      Volume: Vol.7, No.2 Issue: 2 Pages: 426-435

    • DOI

      10.1109/tetci.2022.3215137

    • Related Report
      2022 Research-status Report
    • Peer Reviewed
  • [Journal Article] Characterisation of Focal Liver Lesions in Multi-phase CT images Using Textural and Pathological Descriptors2022

    • Author(s)
      Saeed Moslehi; Amir Hossein Foruzan; Yen-Wei Chen, Hongjie Hu
    • Journal Title

      Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization (Impact Factor: 2.269 )

      Volume: Published Online Issue: 4 Pages: 1523-1531

    • DOI

      10.1080/21681163.2022.2156390

    • Related Report
      2022 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] IDH Mutation Status Prediction by a Radiomics Associated Modality Attention Network2022

    • Author(s)
      Xinran Zhang, Xiaoyu Shi, Yutaro Iwamoto, Jingliang Cheng, Jie Bai, Guohua Zhao, Xian-hua Han and *Yen-Wei Chen
    • Journal Title

      The Visual Computer (Impact Factor: 2.601 )

      Volume: Published Online Issue: 6 Pages: 2367-2379

    • DOI

      10.1007/s00371-022-02452-y

    • Related Report
      2022 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] An Efficient Deep Learning Based Coarse-to-Fine Cephalometric Landmark Detection Method2021

    • Author(s)
      SONG Yu、QIAO Xu、IWAMOTO Yutaro、CHEN Yen-Wei、CHEN Yili
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E104.D Issue: 8 Pages: 1359-1366

    • DOI

      10.1587/transinf.2021EDP7001

    • NAID

      130008070344

    • ISSN
      0916-8532, 1745-1361
    • Year and Date
      2021-08-01
    • Related Report
      2021 Research-status Report
  • [Journal Article] VolumeNet: A Lightweight Parallel Network for Super-Resolution of MR and CT Volumetric Data2021

    • Author(s)
      Yinhao Li, Yutaro Iwamoto, Lanfen Lin, Rui Xu, Ruofeng Tong, Yen-Wei Chen
    • Journal Title

      IEEE Transactions on Image Processing

      Volume: - Pages: 4840-4854

    • DOI

      10.1109/tip.2021.3076285

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Attention-RefNet: Interactive Attention Refinement Network for Infected Area Segmentation of COVID-192021

    • Author(s)
      Kitrungrotsakul Titinunt、Chen Qingqing、Wu Huitao、Iwamoto Yutaro、Hu Hongjie、Zhu Wenchao、Chen Chao、Xu Fangyi、Zhou Yong、Lin Lanfen、Tong Ruofeng、Li Jingsong、Chen Yen-Wei
    • Journal Title

      IEEE Journal of Biomedical and Health Informatics

      Volume: 25 Issue: 7 Pages: 2363-2373

    • DOI

      10.1109/jbhi.2021.3082527

    • Related Report
      2021 Research-status Report
  • [Journal Article] PA‐ResSeg: A phase attention residual network for liver tumor segmentation from multiphase CT images2021

    • Author(s)
      Xu Yingying、Cai Ming、Lin Lanfen、Zhang Yue、Hu Hongjie、Peng Zhiyi、Zhang Qiaowei、Chen Qingqing、Mao Xiongwei、Iwamoto Yutaro、Han Xian‐Hua、Chen Yen‐Wei、Tong Ruofeng
    • Journal Title

      Medical Physics

      Volume: 48 Issue: 7 Pages: 3752-3766

    • DOI

      10.1002/mp.14922

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Presentation] Dividing and Non-dividing Cell Detection by Segmentation on Arabidopsis Root Images Using Light-weight U-Net2024

    • Author(s)
      Yu Song, Zeping Deng, Yinhao Li, Tatsuaki Goh, Keiji Nakajima, Yen-Wei Chen
    • Organizer
      International Workshop on Computer Vision and Artificial Intelligence (IWCVAI2024)
    • Related Report
      2023 Research-status Report
    • Int'l Joint Research
  • [Presentation] Recent Advances in Medical Image Segmentation Using Deep Learning (Keynote Talk)2023

    • Author(s)
      Yen-Wei Chen
    • Organizer
      2023 6th International Conference on Digital Medicine and Image Processing (DMIP 2024)
    • Related Report
      2023 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] Integrating Spatial Prior Adapter for Enhancing SAM Performance in Medical Image Segmentation2023

    • Author(s)
      HU Jihong, LI Yinhao, LIN Lanfen, CHEN Yen-Wei
    • Organizer
      2023 IEEE 12th Global Conference on Consumer Electronics (GCCE2023)
    • Related Report
      2023 Research-status Report
    • Int'l Joint Research
  • [Presentation] A Multi-View Weighted Fusion Model for Segmentation of Infant Brain Ventricles with Hydrocephalus in MRI2023

    • Author(s)
      Maeda Hikari、Iwamoto Yutaro、Nonaka Masahiro、Li Yinhao、Chen Yen-Wei
    • Organizer
      2023 IEEE 12th Global Conference on Consumer Electronics (GCCE2023)
    • Related Report
      2023 Research-status Report
    • Int'l Joint Research
  • [Presentation] AIと医用画像解析2022

    • Author(s)
      陳延偉
    • Organizer
      第22回日本術中画像情報学会(特別講演)(招待講演)
    • Related Report
      2022 Research-status Report
    • Invited
  • [Presentation] Automatic Segmentation of Infant Brain Ventricles with Hydrocephalus in MRI Based on Deep Multi-Path Learning2022

    • Author(s)
      Hikari Jinbo, Yutaro Iwamoto, Masahiro Nonaka, Yen-Wei Chen
    • Organizer
      40th IEEE International Conference on Consumer Electronics (IEEE ICCE2022)
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] 3D Facial Ethnicity Identification Based on Cylindrical Projection and Deep Learning2022

    • Author(s)
      Takuma Terada, Ryusuke Kimura, Yen-Wei Chen
    • Organizer
      40th IEEE International Conference on Consumer Electronics (IEEE ICCE2022)
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] An Accurate Unsupervised Liver Lesion Detection Method Using Pseudo-lesions2022

    • Author(s)
      He Li, Yutaro Iwamoto, Xianhua Han, *Lanfen Lin, Hongjie Hu and *Yen-Wei Chen・
    • Organizer
      International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI 2022(国際学会)(H5 index: 78)
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] An Intra- and Inter-Modality Fusion Model Using MR Images for Prediction of Glioma Isocitrate Dehydrogenase (IDH) Mutation2022

    • Author(s)
      Xiaoyu Shi, Xinran Zhang, Yutaro Iwamoto, Jingliang Cheng, Jie Bai, Guohua Zhao and Yen-Wei Chen*
    • Organizer
      44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (IEEE EMBC 2022)(国際学会)(H5 index: 43)
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] Dual Discriminator-Based Unsupervised Domain Adaptation Using Adversarial Learning for Liver Segmentation on Multiphase CT Images2022

    • Author(s)
      Swathi Ananda, Yutaro Iwamoto, Xianhua HAN, *Lanfen Lin, *Hongjie Hu and *Yen-Wei Chen
    • Organizer
      44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (IEEE EMBC 2022)(国際学会)(H5 index: 43)
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] Mixed Transformer U-Net for Medical Image Segmentation2022

    • Author(s)
      Hongyi Wang, Shiao Xie, Lanfen Lin, Yutaro Iwamoto, Xian-Hua Han, Yen-Wei Chen, Ruofeng Tong
    • Organizer
      2022 IEEE International Conference on Acoustics, Speech and Signal Processing (IEEE ICASSP2022)(国際学会)(H5 index:110 )
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] Patch-Free 3D Medical Image Segmentation Driven by Super-Resolution Technique and Self-Supervised Guidance2021

    • Author(s)
      Hongyi Wang, Lanfen Lin, Hongjie Hu, Qingqing Chen, Yinhao Li, Yutaro Iwamoto, Xian-Hua Han, Yen-Wei Chen, and Ruofeng Tong
    • Organizer
      International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI 2021)
    • Related Report
      2021 Research-status Report
  • [Presentation] An Efficient and Accurate 3D Multiple-Contextual Semantic Segmentation Network for Medical Volumetric Images2021

    • Author(s)
      He Li, Yutaro Iwamoto, Xian-Hua Han, Lanfen Lin*, and Yen-Wei Chen*
    • Organizer
      43st International Engineering in Medicine and Biology Conference (IEEE EMBC2021)
    • Related Report
      2021 Research-status Report
  • [Presentation] Multi-phase Liver Tumor Segmentation with Spatial Aggregation and Uncertain Region Inpainting2021

    • Author(s)
      Yue Zhang, Chengtao Peng, Liying Peng, Huimin Huang, Ruofeng Tong, Lanfen Lin, Jingsong Li, Yen-Wei Chen, Qingqing Chen, Hongjie Hu, and Zhiyi Peng
    • Organizer
      International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI 2021)
    • Related Report
      2021 Research-status Report
  • [Presentation] M-DFNet: Multi-phase Discriminative Feature Network for Retrieval of Focal Liver Lesions2021

    • Author(s)
      Yingying Xu, Jing Liu, Lanfen Lin, Hongjie Hu, Ruofeng Tong, Jingsong Li, Yen-Wei Chen
    • Organizer
      ACM International Conference on Multimedia Retrieval 2021 (ICMR 2021)
    • Related Report
      2021 Research-status Report
  • [Presentation] Case Discrimination: Self-supervised Feature Learning for the classication of Focal Liver Lesions2021

    • Author(s)
      Haohua DONG, Yutaro IWAMOTO, Xianhua HAN, Lanfen LIN, Hongjie HU, Xiujun CAI, and Yen-Wei CHEN
    • Organizer
      International Conference on Innovation in Medicine and Healthcare
    • Related Report
      2021 Research-status Report
  • [Presentation] Automatic Detection and Segmentation of Liver Tumors in Multi-Phase CT Images by Phase Attention Mask R-CNN2021

    • Author(s)
      Ryo Hasegawa, Yutaro IWAMOTO, Xianhua HAN, Lanfen LIN, Hongjie HU, Xiujun CAI, and Yen-Wei CHEN
    • Organizer
      39th IEEE International Conference on Consumer Electronics (IEEE ICCE2021)
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] 高効率かつ高精度な三次元ボリューム画像のセグメンテーション法2021

    • Author(s)
      He Li,岩本祐太郎, 韓先花, 陳延偉
    • Organizer
      日本生体医工学会生体画像と医用人工知能研究会
    • Related Report
      2020 Research-status Report
  • [Presentation] Deep Learning for Computer-aided Diagnosis and Surgery Support2020

    • Author(s)
      Yen-Wei Chen
    • Organizer
      2020 3rd International Conference on Digital Medicine and Image Processing (DMIP 2020)
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] A Lightweight Deep Network for 3D Medical Image Segmentation2020

    • Author(s)
      Kawahara Toshiki, Yinhao Li and Yutaro Iwamoto, Lanfen Lin, Yen-Wei Chen
    • Organizer
      2020 IEEE 9th Global Conference on Consumer Electronics(GCCE)
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] A 3D Shrinking-and-Expanding Module with Channel Attention for Efficient Deep Learning-Based Super-Resolution2020

    • Author(s)
      Yinhao Li, Yutaro Iwamoto, and Yen-Wei Chen
    • Organizer
      International Conference on Innovation in Medicine and Healthcare(InMed2020)
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] Attention Mask R-CNNを用いたマルチフェ ーズCT画像における肝臓腫瘍候補の自動検出2020

    • Author(s)
      長谷川諒・岩本祐太郎・Lanfen Lin・Hongjie Hu・陳延偉
    • Organizer
      電子情報通信学会医用画像研究会
    • Related Report
      2020 Research-status Report
  • [Book] Innovation in Medicine and Healthcare2022

    • Author(s)
      Yen-Wei Chen, Satoshi Tanaka, Robert I. Howlett and Lakhmi C. Jain
    • Total Pages
      314
    • Publisher
      Springer
    • ISBN
      9789811934407
    • Related Report
      2022 Research-status Report
  • [Book] Innovation in Medicine and Healthcare: Proceedings of 9th KES-InMed 20212021

    • Author(s)
      Yen-Wei Chen, Satoshi Tanaka, Robert I. Howlett and Lakhmi C. Jain
    • Total Pages
      282
    • Publisher
      Springer
    • ISBN
      9789811630125
    • Related Report
      2021 Research-status Report
  • [Funded Workshop] International Workshop on Intelligent Image Processing2023

    • Related Report
      2023 Research-status Report

URL: 

Published: 2020-08-03   Modified: 2024-12-25  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi