Quantitative evaluation of the diagnostic thinking process in medical students

2001 Fiscal Year Final Research Report Summary

• Project/Area Number: 12672188
• Research Category: Grant-in-Aid for Scientific Research (C)
• Allocation Type: Single-year Grants
• Section: 一般
• Research Field: Medical sociology
• Research Institution: KYOTO UNIVERSITY
• Principal Investigator: NOGUCHI Yoshinori Kyoto University, Graduate School of Medicine, Instructor, 医学研究科, 助手 (30293872)
• Co-Investigator(Kenkyū-buntansha): MATSUI Kunihiko Kyoto University, Graduate School of Medicine, Instructor, 医学研究科, 助手 (80314201) ; FUKUI Tsuguya Kyoto University, Graduate School of Medicine, Professor, 医学研究科, 教授 (50208930)
• Project Period (FY): 2000 – 2001
• Keywords: Diagnostic thinking process / Bayes' theorem / test characteristics / pre-test probability / post-test probability / medical education

Research Abstract

OBJECTIVE : To explore the diagnostic thinking process of medical students
SUBJECTS AND METHODS : Two hundred twenty-four medical students were presented with three clinical scenarios corresponding to high, low, and intermediate pre-test probability of coronary artery disease. Estimates of test characteristics of exercise stress test, pre-test and post-test probability for each scenario were elicited from the students (Intuitive estimates) or from the literature (Reference estimates). Post-test probabilities were calculated using Bayes' theorem based upon the Intuitive estimates (Bayesian estimates) or upon the Reference estimates (Reference estimates). The differences between the Reference estimates and the Intuitive estimates (Reference error), and between Bayesian estimates and the Intuitive estimates (Bayesian error) were used for assessing knowledge of test characteristics, ability of estimating pretest and posttest probability of disease. For students who took a short course focus ing on interpretation of test performance, changes between pre- and post-course estimates were also studied.
RESULTS : For chest pain scenario, the Reference and Bayesian error showed gross deviations toward overestimating from the reference estimates. The estimates of pretest probability and predictive value positive significantly improved in high pretest setting after the course, but the estimates in low- and intermediate- scenarios did not.
CONCLUSIONS : Medical students could not rule out disease in low or intermediate pre-test probability settings, mainly because of poor pre-test estimates of disease probability and inaptitude in applying Bayes' theorem to real clinical situations. These diagnostic thinking patterns account for why medical students end up repeating unnecessary examinations and may be related to the traditional medical education, i.e., focusing on acquiring basic science/medical knowledge in the framework of biomedical model. The short course as currently offered improves diagnostic ability of ruling in but not ruling out. It is necessary to develop a well-designed educational program targeted on ruling out disease.