Fig. 7: Influence of training data cut-off and test data versions on GPT model response accuracy for text-only questions. | npj Digital Medicine

Fig. 7: Influence of training data cut-off and test data versions on GPT model response accuracy for text-only questions.

From: Benchmarking proprietary and open-source language and vision-language models for gastroenterology clinical reasoning

Fig. 7

a Effect of ACG self-assessment (test) publication date on ACG question sets published in 2021, 2022, and 2023. b Impact of model training data cut-off date. Training cut-offs refer to the dates of data used for training LLMs. GPT generations are shown using different colors.

Back to article page