Tensor Sparse Coding for Temporal and Spatial Feature Extraction and Classification of Liver Lesions in Multi-phase CT Images

2020 Fiscal Year Annual Research Report

• Project/Area Number: 18H03267
• Research Institution: Ritsumeikan University
• Principal Investigator: 陳 延偉 立命館大学, 情報理工学部, 教授 (60236841)
• Co-Investigator(Kenkyū-buntansha): 岩本 祐太郎 立命館大学, 情報理工学部, 助教 (30779054) ; 韓 先花 山口大学, 大学院創成科学研究科, 准教授 (60469195) ; 古川 顕 東京都立大学, 人間健康科学研究科, 教授 (80199421) [Withdrawn] ; 金崎 周造 滋賀医科大学, 医学部, 非常勤講師 (90464180)
• Project Period (FY): 2018-04-01 – 2021-03-31
• Keywords: 肝臓腫瘍病変 / 多重線型理論 / スパース符号化法 / 計算機診断支援 / 深層学習 / 肝臓腫瘍の分類 / 類似症例検索

Outline of Annual Research Achievements

肝臓がんは、平均5年生存率が30%程度とがん全体の中でも極めて低く、正確な診断に基づく早期発見が求められる。肝臓がんの診断には、多時相CT画像(造影剤を急速注入してから経時的に複数回の撮像を行なって得られたCT画像)がよく用いられる。本研究では、肝腫瘍性病変の計算機支援診断法の確立を目的とし、多時相CT画像から有効な時空間特徴抽出のフレームワークを構築するとともに、AIを用いた診断支援システムを開発した。 既存手法は、個々の時相CT画像から特徴を抽出し、それらの特徴ベクトルを繋いで時空間特徴として使用していたが、時相間の共起関係を記述することができず、分類または検索の精度は十分ではなかった。本研究では、多時相CT画像を一つのテンソルとして取り扱い、我々が開発したテンソルスパース表現法を用いた時相間の共起を考慮した時空間特徴抽出法を提案し、多時相CT画像を用いた肝腫瘍性病変の分類精度ならびに類似症例の検索精度を向上させた。また、提案法の有効性について計算機実験による検証だけではなく、医師による検証実験も行い、その有効性を確認した。さらに、近年注目されている深層学習法を用いた肝臓腫瘍の分類と類似症例検索法を開発したことで、より高精度な分類と検索ができるようになった。それらの成果は、国際学術誌Pattern Recognition Letter,TIP, TMI, およびトップ国際学会ACM ICMR2021, MICCAI2022 などで発表した。
General Chairとして、2020年6月、2021年6月、2022年6月にそれぞれ国際学会InMed2020, InMed2021, InMed2022を主催し、国際連携ネットワークを構築した。また、2023年2月から3月まで約１か月中国浙江大学でAIを用いた肝臓がん支援診断に関する国際共同研究を実施してきた。

Research Progress Status

令和2年度が最終年度であるため、記入しない。

Strategy for Future Research Activity

令和2年度が最終年度であるため、記入しない。

Research Products

• [Int'l Joint Research] 浙江大学計算機学院/浙江大学医学部附属病院(中国)
  • Country Name: CHINA
  • Counterpart Institution: 浙江大学計算機学院/浙江大学医学部附属病院
• [Journal Article] Unsupervised MRI Super Resolution Using Deep External Learning and Guided Residual Dense Network With Multimodal Image Priors (2023)
  • Author(s): Iwamoto Yutaro、Takeda Kyohei、Li Yinhao、Shiino Akihiko、Chen Yen-Wei
  • Journal Title: IEEE Transactions on Emerging Topics in Computational Intelligence Volume: 7 Pages: 426～435
  • DOI: 10.1109/TETCI.2022.3215137
  • Peer Reviewed
• [Journal Article] MTL-ABS3Net: Atlas-Based Semi-Supervised Segmentation Network with Multi-Task Learning for Medical Images (2022)
  • Author(s): Huimin Huang, Qingqing Chen, Lanfen Lin, Ming Cai, Hongjie Hu, Qiaowei Zhang, Yutaro Iwamoto, Xianhua Han, Akira Furukawa, Shuzo Kanasaki, Yen-Wei Chen, Ruofeng Tong
  • Journal Title: IEEE Journal of Biomedical and Health Informatics Volume: Vol.26, Pages: 3988-3998
  • DOI: 10.1109/JBHI.2022.3153406
  • Peer Reviewed / Int'l Joint Research
• [Journal Article] Phase Attention Model for Prediction of Early Recurrence of Hepatocellular Carcinoma with Multi-phase CT Images and Clinical Data (2022)
  • Author(s): Weibin WANG, Fang WANG, Qingqing CHEN, Shuyi OUYANG, Yutaro IWAMOTO, Xianhua HAN, Lanfen Lin, Hongjie Hu, Ruofeng Tong, Yen-Wei CHEN
  • Journal Title: Frontiers in Radiology Volume: Vol.2, Pages: -
  • DOI: 10.3389/fradi.2022.856460
  • Peer Reviewed / Open Access / Int'l Joint Research
• [Journal Article] Characterization of Focal Liver Lesions in Multi-phase CT images Using Textural and Pathological Descriptors (2022)
  • Author(s): Saeed Moslehi; Amir Hossein Foruzan; Yen-Wei Chen, Hongjie Hu
  • Journal Title: Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization Volume: - Pages: -
  • DOI: 10.1080/21681163.2022.2156390
  • Peer Reviewed / Int'l Joint Research
• [Journal Article] PA-ResSeg: A Phase Attention Residual Network for Liver Tumor Segmentation from Multi-phase CT Images (2021)
  • Author(s): Yingying Xu, Ming Cai, Lanfen Lin, Yue Zhang, Hongjie Hu, Zhiyi Peng, Qiaowei Zhang, Qingqing Chen, Xiongwei Mao, Yutaro Iwamoto, Xian-Hua Han, Yen-Wei Chen, Ruofeng Tong
  • Journal Title: Medical Physics Volume: Vol.48, Pages: 3752-3766
  • DOI: 10.1002/mp.14922
  • Peer Reviewed / Int'l Joint Research
• [Journal Article] Medical Image Segmentation with Deep Atlas Prior (2021)
  • Author(s): Huiminng Huang, Han Zheng, Lanfen Lin, Ming Cai, Hongjie Hu, Qiaowei Zhang, Qingqing Chen, Yutaro Iwamoto, Xianhua Han, Yen-Wei Chen, Ruofeng Tong
  • Journal Title: IEEE Trans. Medical Imaging Volume: Vol.40, Pages: 3519-3530
  • DOI: 10.1109/TMI.2021.3089661
  • Int'l Joint Research
• [Journal Article] VolumeNet: A Lightweight Parallel Network for Super-Resolution of Medical Volumetric Data (2021)
  • Author(s): Yinhao Li, Yutaro Iwamoto, Lanfen Lin, Rui Xu, Ruofen Tong, Yen-Wei Chen
  • Journal Title: IEEE Trans. Image Processing Volume: Vol. 30 Pages: 4840-4854
  • DOI: 10.1109/TIP.2021.3076285
  • Int'l Joint Research
• [Presentation] AIと医用画像解析 (2022)
  • Author(s): 陳延偉
  • Organizer: 第22回日本術中画像情報学会（特別講演）
  • Invited
• [Presentation] ClassFormer: Exploring Class-aware Dependency with Transformer for Medical Image Segmentation (2022)
  • Author(s): Huimin Huang, Shiao Xie, Lanfen Lin, Ruofeng Tong, Yen-Wei Chen, Hong Wang, Yuexiang Li, Yawen Huang, Yefeng Zheng
  • Organizer: 2022 Association for the Advancement of Artificial Intelligence（AAAI 2022）
  • Int'l Joint Research
• [Presentation] ScaleFormer: Revisiting the Transformer-based Backbones from a Scale-wise Perspective for Medical Image Segmentation (2022)
  • Author(s): Huimin Huang, Shiao Xie, Lanfen Lin, Yutaro Iwamoto, Xian-Hua Han, Yen-Wei Chen, Ruofeng Tong
  • Organizer: International Joint Conference on Artificial Intelligence (IJCAI2022)
  • Int'l Joint Research
• [Presentation] An Accurate Unsupervised Liver Lesion Detection Method Using Pseudo-lesions (2022)
  • Author(s): He Li, Yutaro Iwamoto, Xianhua Han, Lanfen Lin, Hongjie Hu, Yen-Wei Chen
  • Organizer: International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI 2022）
  • Int'l Joint Research
• [Presentation] Unsupervised Domain Adaptation Using Adversarial Learning and Maximum Square Loss for Liver Tumors Detection in Multi-phase CT Images (2022)
  • Author(s): Rahul Kumar JAIN, Takahiro SATO, Taro WATASUE, Tomohiro NAKAGAWA, Yutaro IWAMOTO, Xianhua HAN, Lanfen LIN, Hongjie HU Xiang RUAN, Yen-Wei CHEN
  • Organizer: 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (IEEE EMBC 2022)
  • Int'l Joint Research
• [Presentation] Synthesizing Contrast-Enhanced Computed Tomography Images with an Improved Conditional Generative Adversarial Network (2022)
  • Author(s): Yulin Yang, Caie Xu, Qingqing Chen, Yutaro Iwamoto, Xian-Hua Han, Lanfen Lin, Hongjie Hu, Ruofeng Tong, Yen-Wei Chen
  • Organizer: 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (IEEE EMBC 2022)
  • Int'l Joint Research
• [Presentation] Residual Multilayer Perceptrons for Genotype-Guided Recurrence Prediction of Non-Small Cell Lung Cancer (2022)
  • Author(s): Yang Ai, Panyanat Aonpong, Weibin Wang, Yinhao Li, Yutaro Iwamoto, Xianhua Han, Yen- Wei Chen
  • Organizer: 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (IEEE EMBC 2022)
  • Int'l Joint Research
• [Presentation] Dual Discriminator-Based Unsupervised Domain Adaptation Using Adversarial Learning for Liver Segmentation on Multiphase CT Images (2022)
  • Author(s): Swathi Ananda, Yutaro Iwamoto, Xianhua HAN, Lanfen Lin, Hongjie Hu, Yen-Wei Chen
  • Organizer: 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (IEEE EMBC 2022)
  • Int'l Joint Research
• [Presentation] Mixed Transformer U-Net for Medical Image Segmentation (2022)
  • Author(s): Hongyi Wang, Shiao Xie, Lanfen Lin, Yutaro Iwamoto, Xian-Hua Han, Yen-Wei Chen, Ruofeng Tong
  • Organizer: 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (IEEE ICASSP2022)
  • Int'l Joint Research
• [Presentation] Deep Learning-based Risk Prediction Model for Recurrence-free Survival in Patients with Hepatocellular Carcinoma Using Multi-phase CT Images (2022)
  • Author(s): Weibin Wang, Fang Wang, YunjunYang, YinhaoLi, Jing Liu, Xianhua Han, Lanfen Lin, Ruofeng Tong, Hongjie Hu, Yen-Wei Chen
  • Organizer: IEEE Global Conference on Consumer Electronics (GCCE2022)
  • Int'l Joint Research
• [Presentation] Improved Mask R-CNN with Deformable Convolutions for Accurate Liver Lesion Detection in Multiphase CT Images (2022)
  • Author(s): Chanyu LEE, Yutaro IWAMOTO, Lanfen LIN, Hongjie HU, Yen-Wei CHEN
  • Organizer: International Conference on Innovation in Medicine and Healthcare (InMed-2022)
  • Int'l Joint Research
• [Presentation] Deep Learning for Computer-aided Diagnosis of COVID-19 (2021)
  • Author(s): Yen-Wei Chen
  • Organizer: The 28th International Display Workshops (IDW2021)
  • Invited
• [Presentation] A Tensor Sparse Representation-Based CBMIR System for Computer-Aided Diagnosis of Focal Liver Lesions and its Pilot Trial (2021)
  • Author(s): Jian Wang, Xian-Hua Han, Lanfen Lin, Hongjie Hu, Yen-Wei Chen
  • Organizer: ACM International Conference on Multimedia Retrieval 2021 (ICMR 2021)
  • Int'l Joint Research
• [Presentation] M-DFNet: Multi-phase Discriminative Feature Network for Retrieval of Focal Liver Lesions (2021)
  • Author(s): Yingying Xu, Jing Liu, Lanfen Lin, Hongjie Hu, Ruofeng Tong, Jingsong Li, Yen-Wei Chen
  • Organizer: ACM International Conference on Multimedia Retrieval 2021 (ICMR 2021)
  • Int'l Joint Research
• [Presentation] Automatic Detection and Segmentation of Liver Tumors in Multi-Phase CT Images by Phase Attention Mask R-CNN (2021)
  • Author(s): Ryo Hasegawa, Yutaro IWAMOTO, Xianhua HAN, Lanfen LIN, Hongjie HU, Xiujun CAI, Yen-Wei CHEN
  • Organizer: 9th IEEE International Conference on Consumer Electronics (IEEE ICCE2021)
  • Int'l Joint Research
• [Presentation] Deep Learning for Computer-aided Diagnosis and Surgery Support (2020)
  • Author(s): Yen-Wei Chen
  • Organizer: 2020 3rd International Conference on Digital Medicine and Image Processing (DMIP2020)
  • Invited
• [Presentation] UNET 3+: A Full-Scale Connected UNET for Medical Image Segmentation (2020)
  • Author(s): Huiming Huang, Lanfen Lin, Ruofeng Tong, Hongjie Hu, Qiaowei Zhang, Yutaro Iwamoto, Xian-Hua Han
  • Organizer: 45th IEEE International Conference on Acoustics, Speech, and Signal Processing (IEEE ICASSP2020)
  • Int'l Joint Research
• [Presentation] Deep Learning Method for Content-Based Retrieval of Focal Liver Lesions Using Multiphase Contrast-Enhanced Computer Tomography Images (2020)
  • Author(s): Yusuke YOSHINOBU, Yutaro IWAMOTO, Xianhua HAN, Lanfen LIN, Hongjie HU, Qiaowei ZHANG, Yen-Wei CHEN
  • Organizer: 38th IEEE International Conference on Consumer Electronics (IEEE ICCE2020)
  • Int'l Joint Research
• [Book] Innovation in Medicine and Healthcare (2022)
  • Author(s): Yen-Wei Chen, Satoshi Tanaka, Robert I. Howlett and Lakhmi C. Jain
  • Total Pages: 314
  • Publisher: Springer
  • ISBN: 978-981-19-3440-7
• [Book] Deep Learning in Healthcare (2020)
  • Author(s): Yen-Wei Chen and Lahmi C. Jain
  • Total Pages: 218
  • Publisher: Springer
  • ISBN: 978-3-030-32606-7