Fig. 5: Convergent validity of LLMDP-based assessments against real patient evaluations.
From: A large language model digital patient system enhances ophthalmology history taking skills
Evaluation of the correlation between the assessment methods of real patient encounters and LLMDP-based scenarios. a Study process: Another set of 50 fourth-year medical students from the Zhongshan School of Medicine, Sun Yat-sen University, who were undergoing traditional clinical internships were included. Participants were consecutively evaluated twice using both assessment methods (real patient encounters and LLMDP-based scenarios) for their medical history-taking assessment (MHTA). b Scatter plot comparing the evaluation scores measured using the two methods. Each data point on the graph represents a participant, with the position on the plot corresponding to the scores from the two methods. A moderate positive correlation between the two methods was shown. Pearson’s correlation coefficient r = 0.88 (95% CI: [0.79, 0.93]). LLMDP large language model-based digital patient; MHTA: medical history-taking assessment;.
