Sir, on reading how ChatGPT could pass an anatomy exam,1 we tested its ability to clear the standard Overseas Registration Exam (ORE) (an exam that overseas-qualified dentists have to pass in order to register with the GDC in the UK) exam template.2 The exam consists of two parts, Part 1 being written and Part 2 being clinical. Part 1 consists of two computer-based exam papers: Paper A covers clinically applied dental science and clinically applied human disease; Paper B covers aspects of clinical dentistry, including law and ethics and health and safety.3
We tested the Part 1 ORE Sample Questions available on the official website.3 ChatGPT was able to get 90% of answers correct in Paper A but for Paper B, which covers decision-making questions, ChatGPT could only get 20% correct answers. ORE requires any candidate to clear both papers to proceed to Part 2. Thus, due to its significantly low scores in Paper B, ChatGPT was unable to successfully pass the sample ORE. This pilot test demonstrated that ChatGPT could give correct answers to straightforward theoretical questions with high accuracy, whereas it was unable to answer analytical questions correctly. Additionally, ChatGPT struggled to find correct answers to ethical and law-related questions.
References
Mehrabanian M, Zariat Y. ChatGPT passes anatomy exam. Br Dent J 2023; 235: 295.
General Dental Council. Overseas Registration Exam. Available at: https://www.gdc-uk.org/registration/overseas-registration-exam (accessed September 2023).
General Dental Council. ORE Part 1. Available at: https://www.gdc-uk.org/registration/overseas-registration-exam/ore-part-1 (accessed September 2023).
Author information
Authors and Affiliations
Corresponding authors
Rights and permissions
About this article
Cite this article
Kurian, N., Varghese, V. & Wadhwa, S. ChatGPT fails in ORE. Br Dent J 235, 448–449 (2023). https://doi.org/10.1038/s41415-023-6395-3
Received:
Accepted:
Published:
Version of record:
Issue date:
DOI: https://doi.org/10.1038/s41415-023-6395-3
This article is cited by
-
ChatGPT-4o passes Part 1 of ORE
British Dental Journal (2024)