• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Developing a diagnostic thinking strategy to maximize the diagnostic accuracy when using AI-based automated medical history taking systems

Research Project

Project/Area Number 21K10355
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Review Section Basic Section 58010:Medical management and medical sociology-related
Research InstitutionDokkyo Medical University

Principal Investigator

Harada Yukinori  獨協医科大学, 医学部, 講師 (40810502)

Co-Investigator(Kenkyū-buntansha) 志水 太郎  獨協医科大学, 医学部, 教授 (50810529)
Project Period (FY) 2021-04-01 – 2024-03-31
Project Status Completed (Fiscal Year 2023)
Budget Amount *help
¥2,990,000 (Direct Cost: ¥2,300,000、Indirect Cost: ¥690,000)
Fiscal Year 2023: ¥520,000 (Direct Cost: ¥400,000、Indirect Cost: ¥120,000)
Fiscal Year 2022: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2021: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
KeywordsAI自動問診 / 診断エラー / 自動問診AI / Diagnostic Excellence / 自動AI問診 / 診断精度 / 診断思考理論開発
Outline of Research at the Start

人工知能(Artificial Intelligence:AI)が自動で患者の問診を行い、鑑別診断を挙げる自動問診AIが医療現場に導入されている。自動問診AI利用による診断精度向上効果が期待されるが、利用する医師の診断思考に誤りがあれば診断精度は下がりうる。本研究では、自動問診AIを利用した際に医師の診断精度が下がる場合の原因を明らかにした上で、自動問診AIを利用した際に医師の診断精度が最大となる診断思考方法を理論化する。自動問診AIの利用によって医師の診断精度が変化する理由が分かることで、自動問診AIの有効利用に関する研究が進み、日常診療での診断の誤りや遅れが減り、医療の質の向上につながる。

Outline of Final Research Achievements

In our study, we demonstrated that while the presence of an AI-generated differential diagnosis list does not inherently influence physicians' diagnostic accuracy, the accuracy of the AI's diagnoses does. Additionally, we found that the use of AI for medical history taking in general internal medicine outpatient clinics could marginally decrease diagnostic errors. The diagnostic precision of AI improved with the increase in shared diagnoses across different AI systems, highlighting the benefit of utilizing multiple AI tools. However, we observed that the diagnostic capability of AI has not advanced over time and remains limited for uncommon diseases and atypical presentations. Moreover, we showed that physicians cannot correctly assess the reliability of diagnoses provided by AI-driven medical history taking systems.

Academic Significance and Societal Importance of the Research Achievements

本研究の結果から、現在日本で利用されているAI自動問診の診断精度は全面的に信用してよいほどの水準にはないこと、特に稀な疾患や非典型的な病像など診断に誤りや遅れが生じる危険性が高い患者においてはさらに低くなることから、そのような患者であると感じた場合にはAIを頼らない方がよいことが示唆されるほか、AIの診断が正しいか否かの判断は医師の直観は当てにはならないため、他のAIを併用して共通する鑑別が多いかどうかで判断する方が安全であることも示唆される。このように、本研究はAI自動問診を安全に使用する際の具体的な方法を推奨することができた。

Report

(4 results)
  • 2023 Annual Research Report   Final Research Report ( PDF )
  • 2022 Research-status Report
  • 2021 Research-status Report
  • Research Products

    (30 results)

All 2023 2022 2021

All Journal Article (14 results) (of which Int'l Joint Research: 3 results,  Peer Reviewed: 14 results,  Open Access: 10 results) Presentation (16 results) (of which Int'l Joint Research: 5 results,  Invited: 4 results)

  • [Journal Article] Effects of Combinational Use of Additional Differential Diagnostic Generators on the Diagnostic Accuracy of the Differential Diagnosis List Developed by an Artificial Intelligence?Driven Automated History?Taking System: Pilot Cross-Sectional Study2023

    • Author(s)
      Harada Yukinori、Tomiyama Shusaku、Sakamoto Tetsu、Sugimoto Shu、Kawamura Ren、Yokose Masashi、Hayashi Arisa、Shimizu Taro
    • Journal Title

      JMIR Formative Research

      Volume: 7 Pages: e49034-e49034

    • DOI

      10.2196/49034

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] The first diagnostic excellence conference in Japan2023

    • Author(s)
      Shimizu Taro、Harada Yukinori
    • Journal Title

      Diagnosis

      Volume: - Issue: 4 Pages: 353-355

    • DOI

      10.1515/dx-2023-0027

    • Related Report
      2022 Research-status Report
    • Peer Reviewed
  • [Journal Article] Diagnostic Accuracy of Differential-Diagnosis Lists Generated by Generative Pretrained Transformer 3 Chatbot for Clinical Vignettes with Common Chief Complaints: A Pilot Study2023

    • Author(s)
      Hirosawa Takanobu、Harada Yukinori、Yokose Masashi、Sakamoto Tetsu、Kawamura Ren、Shimizu Taro
    • Journal Title

      International Journal of Environmental Research and Public Health

      Volume: 20 Issue: 4 Pages: 3378-3378

    • DOI

      10.3390/ijerph20043378

    • Related Report
      2022 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] “Pivot and Cluster Strategy” in the light of Kahneman’s “Decision Hygiene” template2023

    • Author(s)
      Shimizu Taro、Lim Tow Keang
    • Journal Title

      Diagnosis

      Volume: - Issue: 3 Pages: 215-217

    • DOI

      10.1515/dx-2022-0129

    • Related Report
      2022 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Effect of contextual factors on the prevalence of diagnostic errors among patients managed by physicians of the same specialty: a single-centre retrospective observational study2023

    • Author(s)
      Harada Yukinori、Otaka Yumi、Katsukura Shinichi、Shimizu Taro
    • Journal Title

      BMJ Quality & Safety

      Volume: - Issue: 6 Pages: 386-394

    • DOI

      10.1136/bmjqs-2022-015436

    • Related Report
      2022 Research-status Report
    • Peer Reviewed
  • [Journal Article] Effectual Diagnostic Approach: A New Strategy to Achieve Diagnostic Excellence in High Diagnostic Uncertainty2022

    • Author(s)
      Amano Masayuki、Harada Yukinori、Shimizu Taro
    • Journal Title

      International Journal of General Medicine

      Volume: Volume 15 Pages: 8327-8332

    • DOI

      10.2147/ijgm.s389691

    • Related Report
      2022 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] An equation for excellence in clinical reasoning2022

    • Author(s)
      Shimizu Taro、Graber Mark L.
    • Journal Title

      Diagnosis

      Volume: - Issue: 2 Pages: 61-63

    • DOI

      10.1515/dx-2022-0060

    • Related Report
      2022 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Factors associated with delayed diagnosis of appendicitis in adults: A single-center, retrospective, observational study2022

    • Author(s)
      Harada Taku、Harada Yukinori、Hiroshige Juichi、Shimizu Taro
    • Journal Title

      PLOS ONE

      Volume: 17 Issue: 10 Pages: e0276454-e0276454

    • DOI

      10.1371/journal.pone.0276454

    • Related Report
      2022 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Outcomes of General Internal Medicine Consultations for Diagnosis from Specialists in a Tertiary Hospital: A Retrospective Observational Study2022

    • Author(s)
      Yokose Masashi、Harada Yukinori、Hanai Shogo、Tomiyama Shusaku、Shimizu Taro
    • Journal Title

      International Journal of General Medicine

      Volume: Volume 15 Pages: 7209-7217

    • DOI

      10.2147/ijgm.s378146

    • Related Report
      2022 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] How insight contributes to diagnostic excellence2022

    • Author(s)
      Shimizu Taro、Graber Mark
    • Journal Title

      Diagnosis

      Volume: 9 Issue: 3 Pages: 311-315

    • DOI

      10.1515/dx-2022-0007

    • Related Report
      2022 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] The Clinical and Biological Manifestations in Women with Iron Deficiency Without Anemia Compared to Iron Deficiency Anemia in a General Internal Medicine Setting: A Retrospective Cohort Study2022

    • Author(s)
      Hirosawa Takanobu、Hayashi Arisa、Harada Yukinori、Shimizu Taro
    • Journal Title

      International Journal of General Medicine

      Volume: Volume 15 Pages: 6765-6773

    • DOI

      10.2147/ijgm.s376405

    • Related Report
      2022 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Incidence of Diagnostic Errors Among Unexpectedly Hospitalized Patients Using an Automated Medical History?Taking System With a Differential Diagnosis Generator: Retrospective Observational Study2022

    • Author(s)
      Kawamura Ren、Harada Yukinori、Sugimoto Shu、Nagase Yuichiro、Katsukura Shinichi、Shimizu Taro
    • Journal Title

      JMIR Medical Informatics

      Volume: 10 Issue: 1 Pages: e35225-e35225

    • DOI

      10.2196/35225

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Efficacy of Artificial-Intelligence-Driven Differential-Diagnosis List on the Diagnostic Accuracy of Physicians: An Open-Label Randomized Controlled Study2021

    • Author(s)
      Harada Yukinori、Katsukura Shinichi、Kawamura Ren、Shimizu Taro
    • Journal Title

      International Journal of Environmental Research and Public Health

      Volume: 18 Issue: 4 Pages: 2086-2086

    • DOI

      10.3390/ijerph18042086

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Effects of a Differential Diagnosis List of Artificial Intelligence on Differential Diagnoses by Physicians: An Exploratory Analysis of Data from a Randomized Controlled Study2021

    • Author(s)
      Harada Yukinori、Katsukura Shinichi、Kawamura Ren、Shimizu Taro
    • Journal Title

      International Journal of Environmental Research and Public Health

      Volume: 18 Issue: 11 Pages: 5562-5562

    • DOI

      10.3390/ijerph18115562

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access
  • [Presentation] Accuracy of DDx generator based on the number of shared DDx with other DDx generators2023

    • Author(s)
      Harada Y, Tomiyama S, Sakamoto T, Yokose M, Kawamura R, Hayashi A, Shimizu T
    • Organizer
      SIDM 2023 Cleveland
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 病院総合診療医のための外来での診断学2022

    • Author(s)
      原田侑典
    • Organizer
      第2回 シン・若手病院総合診療医カンファレンス
    • Related Report
      2022 Research-status Report
    • Invited
  • [Presentation] 総合診療科外来における貧血を伴わない鉄欠乏症の女性と鉄欠乏性貧血の女性との比較:後方視的コホート研究2022

    • Author(s)
      廣澤孝信, 志水太郎
    • Organizer
      第50回獨協医学会学術集会
    • Related Report
      2022 Research-status Report
  • [Presentation] Characteristics of diagnostic errors in outpatients referred for diagnosis in a tertiary care setting2022

    • Author(s)
      Shinichi Katsukura, Yukinori Harada, Yumi Otaka, Taro Shimizu
    • Organizer
      SIDM’s 15th Annual Society to Improve Diagnosis in Medicine conference, SIDM 2022
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] Prevalence of diagnostic errors in outpatients consulted by generalists in a tertiary care setting2022

    • Author(s)
      Yukinori Harada, Yumi Otaka, Shinichi Katsukura, Taro Shimizu
    • Organizer
      SIDM’s 15th Annual Society to Improve Diagnosis in Medicine conference, SIDM 2022
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] Improvement of diagnostic accuracy of artificial intelligence-based differential diagnosis lists by using multiple artificial intelligence systems2022

    • Author(s)
      Arisa Hayashi, Yukinori Harada, Shusaku Tomiyama, Masashi Yokose, Tetsu Sakamoto, Ren Kawamura, Taro Shimizu
    • Organizer
      SIDM’s 15th Annual Society to Improve Diagnosis in Medicine conference, SIDM 2022
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] The diagnostic buddy system: enhancing the meta-cognition during the diagnostic process2022

    • Author(s)
      Yukinori Harada
    • Organizer
      SIDM’s 15th Annual Society to Improve Diagnosis in Medicine conference, SIDM 2022
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] 診断クリニカルパールズ~診断エラー症例から良質な真珠を手に入れよう~2022

    • Author(s)
      鈴木智晴, 原田侑典, 冨山周作, 原田拓, 會田哲朗, 鈴木森香, 日吉哲也, 宮上泰樹
    • Organizer
      第25回日本病院総合診療医学会学術総会
    • Related Report
      2022 Research-status Report
  • [Presentation] 大学病院入院患者における、院内他科から総合診療科へのコンサルテーション研究2022

    • Author(s)
      川村廉, 横瀬允史, 花井翔悟, 鈴木有大, 原田侑典, 志水太郎
    • Organizer
      第25回日本病院総合診療医学会学術総会
    • Related Report
      2022 Research-status Report
  • [Presentation] 大学病院総合診療科の外来患者における主訴と診断エラーとの関連について2022

    • Author(s)
      大高由美, 原田侑典, 勝倉真一, 志水太郎
    • Organizer
      第25回日本病院総合診療医学会学術総会
    • Related Report
      2022 Research-status Report
  • [Presentation] 診断エラーについて2022

    • Author(s)
      志水太郎, 原田拓
    • Organizer
      第25回日本病院総合診療医学会学術総会
    • Related Report
      2022 Research-status Report
    • Invited
  • [Presentation] Outcomes of general internal medicine consultations for diagnosis from specialists in a general hospital: a retrospective observational study2022

    • Author(s)
      Masashi Yokose, Shogo Hanai, Shusaku Tomiyama, Yukinori Harada, Taro Shimizu
    • Organizer
      米国内科学会(ACP)日本支部年次総会・講演会2022
    • Related Report
      2022 Research-status Report
  • [Presentation] 診療所家庭医×病院総合診療医:リサーチ Special Interest Groups~セッティングの垣根を越えて2022

    • Author(s)
      金子惇,原田侑典,藤沼康樹,綿貫聡,岩浪悟,青木拓也,浜野淳,鋪野紀好,小坂鎮太郎,吉田絵理子,水本潤希,弓野綾,西岡大輔
    • Organizer
      第13回日本プライマリ・ケア連合学会学術大会
    • Related Report
      2022 Research-status Report
    • Invited
  • [Presentation] 実はあなたがキーパーソン?!多職種で目指す、診断的安全性が高い組織への道2022

    • Author(s)
      原田侑典,國友耕太郎,畑拓磨,山口章江,芦野朱,幌沙小里,坂田一樹,林良典,原田拓,石塚晃介,相馬渉,相馬渉,鈴木智晴,倉澤康之,杉原大輔
    • Organizer
      第13回日本プライマリ・ケア連合学会学術大会
    • Related Report
      2022 Research-status Report
  • [Presentation] 診断戦略開発カンファレンス(DSDC)2022

    • Author(s)
      志水太郎,原田拓,山里一志
    • Organizer
      第13回日本プライマリ・ケア連合学会学術大会
    • Related Report
      2022 Research-status Report
    • Invited
  • [Presentation] The AI-driven differential diagnosis list was not associated with the diagnostic accuracy of physicians when using the AI-driven automated medical history taking systems: a randomized trial2021

    • Author(s)
      Katsukura S, Harada Y, Kawamura R, Shimizu T
    • Organizer
      ACP(米国内科学会)日本支部年次総会・講演会2021
    • Related Report
      2021 Research-status Report

URL: 

Published: 2021-04-28   Modified: 2025-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi