Fig. 1: ChatCAD: an AI-assisted medical diagnosis and advice system.
From: Interactive computer-aided diagnosis on medical image using large language models
a Overview of our proposed strategy. The image is processed by various networks to generate diverse outputs, which are then transformed into text descriptions. The descriptions, served as a link between visual and linguistic information, are combined as inputs to a large language model (LLM). With its ability to reason and its knowledge of the medical field, the LLM can provide a condensed report. b Interactive explanations and medical advice from ChatCAD.
